00000001:02000400:3.0F:1789049229.506082:0:2961:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg626-server.virtnet: executing set_hostid 00000001:02000400:1.0F:1789049249.882981:0:3185:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg626-server.virtnet: executing load_modules_local 00000001:01000000:2.0F:1789049251.967634:0:3244:0:(lnet-crypto.c:360:cfs_crypto_performance_test()) Crypto hash algorithm adler32 speed = 567 MB/s 00000001:01000000:2.0:1789049252.217449:0:3244:0:(lnet-crypto.c:360:cfs_crypto_performance_test()) Crypto hash algorithm crc32 speed = 543 MB/s 00000001:01000000:3.0:1789049252.473908:0:3244:0:(lnet-crypto.c:360:cfs_crypto_performance_test()) Crypto hash algorithm crc32c speed = 3287 MB/s 00000020:02000000:0.0F:1789049253.211343:0:3277:0:(class_obd.c:771:obdclass_init()) Lustre: Build Version: 2.17.58_40_gb4686d2 00000400:02000000:0.0:1789049254.392123:0:3292:0:(api-ni.c:2828:lnet_startup_lndni()) Added LNI 192.168.206.126@tcp [8/256/0/180] 00008000:02000000:3.0:1789049258.329581:0:3441:0:(echo_client.c:2575:obdecho_init()) Echo OBD driver; http://www.lustre.org/ 00000001:02000400:2.0:1789049307.642201:0:5249:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg626-server.virtnet: executing load_modules_local 00000020:01000004:3.0:1789049320.088516:0:5831:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:3.0:1789049320.088526:0:5831:0:(obd_mount.c:926:lmd_print()) device: lustre-mdt1/mdt1 00000080:01200004:3.0:1789049320.088773:0:5831:0:(super25.c:131:lustre_fill_super()) VFS Op: sb 0000000006d9cab9 00000080:02000400:3.0:1789049320.088789:0:5831:0:(super25.c:149:lustre_fill_super()) lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' 00000020:01000004:3.0:1789049320.093464:0:5831:0:(tgt_mount.c:2502:osd_start()) Attempting to start lustre-MDT0000, type=osd-zfs, lsifl=200065, mountfl=0 00000020:01000004:3.0:1789049320.093486:0:5831:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-zfs) 00000020:00000080:3.0:1789049320.093544:0:5831:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (0000000012a0db0d) 00000020:00000080:3.0:1789049320.093577:0:5831:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-zfs with refcount 2 00100000:10000000:3.0:1789049320.112823:0:5831:0:(scrub.c:230:scrub_file_store()) lustre-MDT0000: store scrub file: rc = 0 00100000:10000000:2.0:1789049320.114084:0:5831:0:(scrub.c:230:scrub_file_store()) lustre-MDT0000: store scrub file: rc = 0 00100000:10000000:2.0:1789049320.138435:0:5831:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x1017:0x0] => 0 (CONFIGS): rc = 1 00100000:10000000:2.0:1789049320.138474:0:5831:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:2.0:1789049320.138492:0:5831:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x3:0x0] => 0 (fld): rc = 1 00100000:10000000:2.0:1789049320.138537:0:5831:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:2.0:1789049320.138559:0:5831:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00000020:00000080:2.0:1789049320.139116:0:5831:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:2.0:1789049320.139128:0:5831:0:(osd_handler.c:1574:osd_obd_connect()) connect #0 00000020:00000080:2.0:1789049320.139142:0:5831:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xf4f48ce5e1bbea4a 00000020:01000004:2.0:1789049320.139152:0:5831:0:(tgt_mount.c:2587:server_fill_super()) Found service lustre-MDT0000 on device lustre-mdt1/mdt1 00000020:01000000:2.0:1789049320.139159:0:5831:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:2.0:1789049320.139164:0:5831:0:(tgt_mount.c:101:server_register_mount()) register mount 0000000006d9cab9 from MGS 00000020:01000004:2.0:1789049320.139169:0:5831:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:2.0:1789049320.139191:0:5831:0:(genops.c:413:class_newdev()) Allocate new device MGS (00000000e7546e7b) 00000020:00000080:2.0:1789049320.139204:0:5831:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:2.0:1789049320.139274:0:5831:0:(tgt_mount.c:153:server_get_mount()) get mount 0000000006d9cab9 from MGS, refs=2 00080000:01000000:2.0:1789049320.139280:0:5831:0:(osd_handler.c:1574:osd_obd_connect()) connect #1 00000020:00000080:2.0:1789049320.139287:0:5831:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xf4f48ce5e1bbea58 00000100:00100000:2.0:1789049320.139389:0:5831:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/1 left), rc = 0 00000100:00100000:2.0:1789049320.139520:0:5831:0:(service.c:3467:ptlrpc_start_thread()) ldlm_cbd[0] started 0 min 2 max 56 00000100:00100000:2.0:1789049320.139527:0:5831:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cb00_000' 00000100:00100000:3.0:1789049320.140378:0:5831:0:(service.c:3467:ptlrpc_start_thread()) ldlm_cbd[0] started 1 min 2 max 56 00000100:00100000:3.0:1789049320.140388:0:5831:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cb00_001' 00000100:00100000:3.0:1789049320.141332:0:5831:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1789049320.141524:0:5831:0:(service.c:3467:ptlrpc_start_thread()) ldlm_canceld[0] started 0 min 3 max 56 00000100:00100000:3.0:1789049320.141531:0:5831:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cn00_000' 00000100:00100000:2.0:1789049320.143444:0:5831:0:(service.c:3467:ptlrpc_start_thread()) ldlm_canceld[0] started 1 min 3 max 56 00000100:00100000:2.0:1789049320.143471:0:5831:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cn00_001' 00000100:00100000:3.0:1789049320.145311:0:5831:0:(service.c:3467:ptlrpc_start_thread()) ldlm_canceld[0] started 2 min 3 max 56 00000100:00100000:3.0:1789049320.145327:0:5831:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cn00_002' 00010000:00010000:0.0:1789049320.146262:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789049320.146268:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789049320.146269:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789049320.146782:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789049320.146786:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789049320.146787:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789049320.147566:0:5831:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGS-0 is initialized 00010000:00010000:0.0:1789049320.150726:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:01000000:0.0:1789049320.397049:0:5831:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10ip512 speed = 2843 MB/s 00000001:01000000:3.0:1789049320.647601:0:5831:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10ip4K speed = 3463 MB/s 00000001:01000000:2.0:1789049320.897735:0:5831:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10crc512 speed = 451 MB/s 00000001:01000000:1.0:1789049321.147313:0:5831:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10crc4K speed = 503 MB/s 00080000:10000000:1.0:1789049321.152728:0:5831:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x3:0x0] (8/8/4) registered 00000040:01000000:1.0:1789049321.166243:0:5831:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 20000000:01000000:1.0:1789049321.166269:0:5831:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:1.0:1789049321.166272:0:5831:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 10000000:01000000:3.0:1789049321.171540:0:5841:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:1.0:1789049321.171681:0:5831:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:1.0:1789049321.171742:0:5831:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000040:00080000:1.0:1789049321.172110:0:5831:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:01000000:1.0:1789049321.172144:0:5831:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:1.0:1789049321.172462:0:5831:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1789049321.172650:0:5831:0:(service.c:3467:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:1.0:1789049321.172658:0:5831:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:0.0:1789049321.176061:0:5831:0:(service.c:3467:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:0.0:1789049321.176077:0:5831:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:0.0:1789049321.176542:0:5831:0:(service.c:3467:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:0.0:1789049321.176548:0:5831:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00010000:00010000:1.0:1789049321.180229:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1789049321.180485:0:5831:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:0.0:1789049321.180514:0:5831:0:(obd_mount.c:411:lustre_start_mgc()) Start MGC 'MGC192.168.206.126@tcp' 00000020:01000004:0.0:1789049321.180516:0:5831:0:(obd_mount.c:420:lustre_start_mgc()) mgs NIDs (null). 00000020:01000004:0.0:1789049321.180581:0:5831:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGC192.168.206.126@tcp (typ=mgc) 00000020:00000080:0.0:1789049321.180610:0:5831:0:(genops.c:413:class_newdev()) Allocate new device MGC192.168.206.126@tcp (00000000d8872206) 00000020:00000080:0.0:1789049321.180631:0:5831:0:(obd_config.c:720:class_attach_name()) OBD: dev 2 attached type mgc with refcount 2 00010000:00080000:0.0:1789049321.180780:0:5831:0:(ldlm_lib.c:102:import_set_conn()) imp 00000000c0f83cba@MGC192.168.206.126@tcp: add connection 192.168.206.126@tcp at head 00010000:00010000:0.0:1789049321.181000:0:5831:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGC192.168.206.126@tcp-0 is initialized 00000040:01000000:0.0:1789049321.181008:0:5831:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.206.126@tcp ctxt 1 is initialized 00000100:00080000:1.0:1789049321.187697:0:5846:0:(pinger.c:466:ping_evictor_main()) Starting Ping Evictor 10000000:01000000:1.0:1789049321.188273:0:5848:0:(mgc_request.c:631:mgc_requeue_thread()) Starting requeue thread 00000020:00000080:2.0:1789049321.188357:0:5831:0:(obd_config.c:826:class_setup()) finished setup of obd MGC192.168.206.126@tcp (uuid 7ef694ec-1ea0-4f02-800c-d1279b4fdf12) 00000020:00000080:2.0:1789049321.188395:0:5831:0:(genops.c:1384:class_connect()) connect: client 7ef694ec-1ea0-4f02-800c-d1279b4fdf12, cookie 0xf4f48ce5e1bbea66 00000100:00080000:2.0:1789049321.188411:0:5831:0:(import.c:545:import_select_connection()) MGC192.168.206.126@tcp: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1789049321.188422:0:5831:0:(import.c:666:import_select_connection()) MGC192.168.206.126@tcp: import 00000000c0f83cba using connection 192.168.206.126@tcp/0@lo 00000100:00100000:2.0:1789049321.188474:0:5831:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@00000000456995d0 x1875954110562432/t0(0) o250->MGC192.168.206.126@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1789049321.188615:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000456995d0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:7ef694ec-1ea0-4f02-800c-d1279b4fdf12:3307:1875954110562432:0@lo:250: 00000100:00100000:0.0:1789049321.188701:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789049321.188805:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954110562432 00000100:00100000:1.0:1789049321.188816:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954110562432 00000100:00100000:1.0:1789049321.188905:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1789049321.188913:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000008b7621cb pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3307:x1875954110562432:12345-0@lo:250: 00010000:00080000:1.0:1789049321.188943:0:5843:0:(ldlm_lib.c:1453:target_handle_connect()) MGS: connection from 7ef694ec-1ea0-4f02-800c-d1279b4fdf12@0@lo t0 exp 0000000000000000 cur 147 last 0 00000020:00000080:1.0:1789049321.188985:0:5843:0:(genops.c:1384:class_connect()) connect: client 7ef694ec-1ea0-4f02-800c-d1279b4fdf12, cookie 0xf4f48ce5e1bbea6d 00000100:00080000:1.0:1789049321.189150:0:5843:0:(import.c:65:import_set_state_nolock()) 00000000e12f77b2 : changing import state from RECOVER to FULL 00000100:00080000:2.0:1789049321.189281:0:5831:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import 7ef694ec-1ea0-4f02-800c-d1279b4fdf12->MGS 00000020:01000004:2.0:1789049321.189306:0:5831:0:(tgt_mount.c:1808:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:2.0:1789049321.189313:0:5831:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000020:00000080:2.0:1789049321.189330:0:5831:0:(genops.c:413:class_newdev()) Allocate new device MDS (0000000021d6ab1a) 00000020:00000080:2.0:1789049321.189343:0:5831:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00000100:00100000:1.0:1789049321.190839:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000008b7621cb pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7ef694ec-1ea0-4f02-800c-d1279b4fdf12+5:3307:x1875954110562432:12345-0@lo:250: Request processed in 1918us (2131us total) trans 0 rc 0/0 00000100:00100000:1.0:1789049321.190868:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1789049321.191715:0:3307:0:(client.c:3126:ptlrpc_free_committed()) MGC192.168.206.126@tcp: committing for last_committed 0 gen 1 00000100:00080000:0.0:1789049321.191731:0:3307:0:(import.c:1177:ptlrpc_connect_interpret()) MGC192.168.206.126@tcp: connect to target with instance 0 00000100:00080000:0.0:1789049321.191739:0:3307:0:(import.c:1001:ptlrpc_connect_set_flags()) MGC192.168.206.126@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:0.0:1789049321.191745:0:3307:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:0.0:1789049321.191749:0:3307:0:(import.c:65:import_set_state_nolock()) 00000000c0f83cba MGS: changing import state from CONNECTING to FULL 10000000:01000000:0.0:1789049321.191753:0:3307:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:0.0:1789049321.191772:0:3307:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:0.0:1789049321.191779:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000456995d0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:7ef694ec-1ea0-4f02-800c-d1279b4fdf12:3307:1875954110562432:0@lo:250: 00000100:00100000:3.0:1789049321.239373:0:5831:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1789049321.239584:0:5831:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:3.0:1789049321.239592:0:5831:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt00_000' 00000100:00100000:3.0:1789049321.247175:0:5831:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:3.0:1789049321.247195:0:5831:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:0.0:1789049321.248280:0:5831:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:0.0:1789049321.248291:0:5831:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:3.0:1789049321.249549:0:5831:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1789049321.255192:0:5831:0:(service.c:3467:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:2.0:1789049321.255203:0:5831:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:0.0:1789049321.256316:0:5831:0:(service.c:3467:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:0.0:1789049321.256332:0:5831:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00000100:00100000:2.0:1789049321.426344:0:5831:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1789049321.426542:0:5831:0:(service.c:3467:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:2.0:1789049321.426550:0:5831:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:2.0:1789049321.438276:0:5831:0:(service.c:3467:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:2.0:1789049321.438297:0:5831:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:2.0:1789049321.443579:0:5831:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1789049321.443828:0:5831:0:(service.c:3467:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:2.0:1789049321.443834:0:5831:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:2.0:1789049321.444764:0:5831:0:(service.c:3467:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:2.0:1789049321.444771:0:5831:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:2.0:1789049321.454486:0:5831:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1789049321.454757:0:5831:0:(service.c:3467:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:2.0:1789049321.454765:0:5831:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:2.0:1789049321.457154:0:5831:0:(service.c:3467:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:2.0:1789049321.457168:0:5831:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:2.0:1789049321.458204:0:5831:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1789049321.458817:0:5831:0:(service.c:3467:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:2.0:1789049321.458825:0:5831:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:2.0:1789049321.461167:0:5831:0:(service.c:3467:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:2.0:1789049321.461180:0:5831:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:1.0:1789049321.512989:0:5831:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1789049321.513265:0:5831:0:(service.c:3467:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:1.0:1789049321.513332:0:5831:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:3.0:1789049321.515387:0:5831:0:(service.c:3467:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:3.0:1789049321.515400:0:5831:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:3.0:1789049321.516588:0:5831:0:(service.c:3467:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:3.0:1789049321.516598:0:5831:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:3.0:1789049321.518038:0:5831:0:(obd_config.c:826:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:3.0:1789049321.518062:0:5831:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-mdt1/mdt1 10000000:01000000:3.0:1789049321.518074:0:5831:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.206.126@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:3.0:1789049321.518255:0:5831:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.206.126@tcp ctxt 0 is initialized 00000020:01000004:3.0:1789049321.518294:0:5831:0:(tgt_mount.c:1416:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.206.126@tcp, index=0000, flags=0x20065 00000020:01000004:3.0:1789049321.518299:0:5831:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:3.0:1789049321.518301:0:5831:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1789049321.518302:0:5831:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789049321.518303:0:5831:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1789049321.518304:0:5831:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789049321.518305:0:5831:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789049321.518306:0:5831:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1789049321.518308:0:5831:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1789049321.518310:0:5831:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1789049321.518311:0:5831:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1789049321.518312:0:5831:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789049321.518314:0:5831:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1789049321.518316:0:5831:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020065 00000020:01000004:3.0:1789049321.518318:0:5831:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1789049321.518319:0:5831:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1789049321.518320:0:5831:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789049321.518322:0:5831:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1789049321.518322:0:5831:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789049321.518323:0:5831:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789049321.518324:0:5831:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1789049321.518325:0:5831:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1789049321.518326:0:5831:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1789049321.518327:0:5831:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1789049321.518328:0:5831:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789049321.518328:0:5831:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1789049321.518361:0:5831:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:3.0:1789049321.518377:0:5831:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000002195f6a pname:cluuid:pid:xid:nid:opc:job mount.lustre:7ef694ec-1ea0-4f02-800c-d1279b4fdf12:5831:1875954110562560:0@lo:253: 00000100:00100000:3.0:1789049321.518448:0:5831:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789049321.518506:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954110562560 00000100:00100000:2.0:1789049321.518513:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954110562560 00000100:00100000:3.0:1789049321.518538:0:5831:0:(client.c:2716:ptlrpc_set_wait()) set 0000000018baae03 going to sleep for 11 seconds 00000100:00100000:2.0:1789049321.518551:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1789049321.518558:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000c9a1b219 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7ef694ec-1ea0-4f02-800c-d1279b4fdf12+5:5831:x1875954110562560:12345-0@lo:253: 20000000:01000000:2.0:1789049321.518599:0:5845:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:2.0:1789049321.518602:0:5845:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 10000000:01000000:2.0:1789049321.519219:0:5866:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:3.0:1789049321.519405:0:5845:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 00000040:00080000:3.0:1789049321.520412:0:5845:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1789049321.521521:0:5867:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 1 20000000:01000000:2.0:1789049321.521887:0:5845:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:2.0:1789049321.521892:0:5845:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-MDT0000, index=0 20000000:01000000:2.0:1789049321.521898:0:5845:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-MDT0000 to 0 20000000:01000000:2.0:1789049321.521901:0:5845:0:(mgs_llog.c:3612:mgs_write_log_mdt()) writing new mdt lustre-MDT0000 20000000:01000000:2.0:1789049321.521919:0:5845:0:(mgs_llog.c:3172:mgs_write_log_lov()) Writing lov(lustre-MDT0000-mdtlov) log for lustre-MDT0000 00000040:00080000:2.0:1789049321.522169:0:5845:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1789049321.522422:0:5845:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 20000000:01000000:2.0:1789049321.522437:0:5845:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf001 lov lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:2.0:1789049321.522487:0:5845:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 136 off8552 00000040:00080000:2.0:1789049321.522535:0:5845:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 176 off8728 00000040:00080000:2.0:1789049321.522572:0:5845:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8952 00000040:00080000:2.0:1789049321.523109:0:5845:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9176 20000000:01000000:2.0:1789049321.523122:0:5845:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000 0xcf001 mdt lustre-MDT0000_UUID (null) (null) 00000040:00080000:2.0:1789049321.523175:0:5845:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9296 20000000:01000000:2.0:1789049321.523184:0:5845:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf007 lustre-MDT0000 lustre-MDT0000-mdtlov (null) (null) 00000040:00080000:2.0:1789049321.523217:0:5845:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 112 off9408 20000000:01000000:2.0:1789049321.523224:0:5845:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000 0xcf003 lustre-MDT0000_UUID 0 lustre-MDT0000-mdtlov f 00000040:00080000:2.0:1789049321.523253:0:5845:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 160 off9568 00000040:00080000:2.0:1789049321.523386:0:5845:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9792 00000040:00080000:2.0:1789049321.523802:0:5845:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:01000000:2.0:1789049321.523810:0:5845:0:(mgs_llog.c:3172:mgs_write_log_lov()) Writing lov(lustre-clilov) log for lustre-client 00000040:00080000:2.0:1789049321.523828:0:5845:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1789049321.524227:0:5845:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 20000000:01000000:2.0:1789049321.524241:0:5845:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf001 lov lustre-clilov_UUID (null) (null) 00000040:00080000:2.0:1789049321.524281:0:5845:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 120 off8536 00000040:00080000:2.0:1789049321.524330:0:5845:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 168 off8704 00000040:00080000:2.0:1789049321.524395:0:5845:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].4, 224 off8928 20000000:01000000:2.0:1789049321.524411:0:5845:0:(mgs_llog.c:3129:mgs_write_log_lmv()) Writing lmv(lustre-clilmv) log for lustre-client 00000040:00080000:2.0:1789049321.524491:0:5845:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].5, 224 off9152 20000000:01000000:2.0:1789049321.524500:0:5845:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilmv 0xcf001 lmv lustre-clilmv_UUID (null) (null) 00000040:00080000:2.0:1789049321.524543:0:5845:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].6, 120 off9272 00000040:00080000:2.0:1789049321.524580:0:5845:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].7, 168 off9440 00000040:00080000:2.0:1789049321.524616:0:5845:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].8, 224 off9664 20000000:01000000:2.0:1789049321.524627:0:5845:0:(mgs_llog.c:3094:mgs_write_log_mount_opt()) Writing mount options log for lustre-client 00000040:00080000:2.0:1789049321.524803:0:5845:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].9, 224 off9888 20000000:01000000:2.0:1789049321.524812:0:5845:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf007 lustre-client lustre-clilov lustre-clilmv (null) 00000040:00080000:2.0:1789049321.524894:0:5845:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].10, 120 off10008 00000040:00080000:2.0:1789049321.524934:0:5845:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].11, 224 off10232 00000040:00080000:2.0:1789049321.525116:0:5845:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 12 count 12 20000000:01000000:2.0:1789049321.525168:0:5845:0:(mgs_llog.c:3309:mgs_write_log_mdc_to_lmv()) adding mdc for lustre-MDT0000 to log lustre-client:lmv(lustre-clilmv) 20000000:01000000:2.0:1789049321.525175:0:5845:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre-MDT0000/add mdc fl=4 00000040:00080000:1.0:1789049321.527061:0:5868:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 12 count 12 00000040:00080000:2.0:1789049321.527461:0:5845:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].12, 224 off10456 20000000:01000000:2.0:1789049321.527488:0:5845:0:(mgs_llog.c:3355:mgs_write_log_mdc_to_lmv()) add nid 192.168.206.126@tcp for mdt 20000000:01000000:2.0:1789049321.527490:0:5845:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.206.126@tcp (null) (null) (null) 00000040:00080000:2.0:1789049321.527527:0:5845:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].13, 88 off10544 20000000:01000000:2.0:1789049321.527534:0:5845:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdc 0xcf001 mdc lustre-clilmv_UUID (null) (null) 00000040:00080000:2.0:1789049321.527562:0:5845:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].14, 128 off10672 20000000:01000000:2.0:1789049321.527569:0:5845:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdc 0xcf003 lustre-MDT0000_UUID 192.168.206.126@tcp (null) (null) 00000040:00080000:2.0:1789049321.528056:0:5845:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].15, 144 off10816 20000000:01000000:2.0:1789049321.528068:0:5845:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilmv 0xcf014 lustre-MDT0000_UUID 0 1 lustre-MDT0000-mdc_UUID 00000040:00080000:2.0:1789049321.528108:0:5845:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].16, 160 off10976 00000040:00080000:2.0:1789049321.528146:0:5845:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].17, 224 off11200 20000000:01000000:2.0:1789049321.528217:0:5845:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' sys.timeout=20 ', param: 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:2.0:1789049321.528220:0:5845:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:2.0:1789049321.528225:0:5845:0:(mgs_llog.c:5072:mgs_write_log_param()) mdt param identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity 20000000:01000000:2.0:1789049321.528241:0:5845:0:(mgs_llog.c:1379:mgs_modify_param()) modify lustre-MDT0000/lustre-MDT0000/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity del=0 00000040:00080000:1.0:1789049321.528839:0:5869:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 10 count 10 20000000:02000000:2.0:1789049321.529097:0:5845:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 00000040:00080000:2.0:1789049321.540957:0:5845:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 224 off10016 00000040:00080000:2.0:1789049321.541008:0:5845:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 160 off10176 00000040:00080000:2.0:1789049321.541101:0:5845:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10400 20000000:01000000:2.0:1789049321.541234:0:5845:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'sys.timeout=20' 20000000:01000000:2.0:1789049321.541237:0:5845:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:2.0:1789049321.541241:0:5845:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:2.0:1789049321.541265:0:5845:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:2.0:1789049321.541568:0:5845:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:2.0:1789049321.541603:0:5845:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:2.0:1789049321.541606:0:5845:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 00000040:00080000:0.0:1789049321.542340:0:5870:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 18 count 18 00000040:00080000:2.0:1789049321.542728:0:5845:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].18, 224 off11424 00000040:00080000:2.0:1789049321.542776:0:5845:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].19, 80 off11504 00000040:00080000:2.0:1789049321.542816:0:5845:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].20, 224 off11728 20000000:01000000:2.0:1789049321.542828:0:5845:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:2.0:1789049321.542830:0:5845:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 00000040:00080000:1.0:1789049321.543532:0:5871:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 13 count 13 00000040:00080000:2.0:1789049321.543758:0:5845:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 224 off10624 00000040:00080000:2.0:1789049321.543794:0:5845:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 80 off10704 00000040:00080000:2.0:1789049321.544067:0:5845:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 224 off10928 00000020:00000080:2.0:1789049321.544082:0:5845:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1789049321.544085:0:5845:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 100 to 20 10000000:01000000:2.0:1789049321.544093:0:5845:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:2.0:1789049321.544116:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 0000000040a9fa71/0xf4f48ce5e1bbea7b lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049321.544133:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000040a9fa71/0xf4f48ce5e1bbea7b lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049321.544143:0:5845:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 0000000040a9fa71/0xf4f48ce5e1bbea7b lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049321.544149:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 0000000040a9fa71/0xf4f48ce5e1bbea7b lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049321.544161:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 0000000040a9fa71/0xf4f48ce5e1bbea7b lrc: 3/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049321.544167:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 0000000040a9fa71/0xf4f48ce5e1bbea7b lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049321.544174:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 0000000040a9fa71 already unused, calling callback (0000000002254c5f) 00010000:00010000:2.0:1789049321.544177:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 0000000040a9fa71/0xf4f48ce5e1bbea7b lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049321.544184:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 0000000040a9fa71/0xf4f48ce5e1bbea7b lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049321.544195:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 0000000040a9fa71/0xf4f48ce5e1bbea7b lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049321.544201:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 0000000040a9fa71/0xf4f48ce5e1bbea7b lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049321.544207:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 0000000040a9fa71/0xf4f48ce5e1bbea7b lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1789049321.544222:0:5845:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:0.0:1789049321.768902:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000c9a1b219 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7ef694ec-1ea0-4f02-800c-d1279b4fdf12+5:5831:x1875954110562560:12345-0@lo:253: Request processed in 250336us (250447us total) trans 0 rc 0/0 00000100:00100000:0.0:1789049321.768923:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1789049321.769085:0:5831:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000002195f6a pname:cluuid:pid:xid:nid:opc:job mount.lustre:7ef694ec-1ea0-4f02-800c-d1279b4fdf12:5831:1875954110562560:0@lo:253: 10000000:01000000:3.0:1789049321.769103:0:5831:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:3.0:1789049321.769119:0:5831:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1789049321.769122:0:5831:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1789049321.769123:0:5831:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789049321.769124:0:5831:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-MDT0000_UUID 00000020:01000004:3.0:1789049321.769125:0:5831:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789049321.769126:0:5831:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789049321.769128:0:5831:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1789049321.769129:0:5831:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1789049321.769130:0:5831:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:3.0:1789049321.769132:0:5831:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789049321.769133:0:5831:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:3.0:1789049321.769150:0:5831:0:(tgt_mount.c:101:server_register_mount()) register mount 0000000006d9cab9 from lustre-MDT0000 10000000:01000000:3.0:1789049321.769179:0:5831:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:3.0:1789049321.769182:0:5831:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:3.0:1789049321.769185:0:5831:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-sptlrpc-ffff8cb8c59599c0 10000000:01000000:3.0:1789049321.769189:0:5831:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1789049321.769196:0:5831:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff8cb8c59599c0 from 1 10000000:01000000:3.0:1789049321.769198:0:5831:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:3.0:1789049321.769301:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.126@tcp lock: 000000005641f1fd/0xf4f48ce5e1bbea82 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049321.769312:0:5831:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.126@tcp lock: 000000005641f1fd/0xf4f48ce5e1bbea82 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049321.769322:0:5831:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.126@tcp lock: 000000005641f1fd/0xf4f48ce5e1bbea82 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789049321.769340:0:5831:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000002195f6a pname:cluuid:pid:xid:nid:opc:job mount.lustre:7ef694ec-1ea0-4f02-800c-d1279b4fdf12:5831:1875954110562688:0@lo:101: 00000100:00100000:3.0:1789049321.769382:0:5831:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789049321.769438:0:5831:0:(client.c:2716:ptlrpc_set_wait()) set 000000006720169b going to sleep for 11 seconds 00000100:00100000:2.0:1789049321.769500:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954110562688 00000100:00100000:2.0:1789049321.769508:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954110562688 00000100:00100000:2.0:1789049321.769542:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1789049321.769550:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000984516ec pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7ef694ec-1ea0-4f02-800c-d1279b4fdf12+5:5831:x1875954110562688:12345-0@lo:101: 00010000:00010000:2.0:1789049321.769561:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789049321.769573:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000040a9fa71/0xf4f48ce5e1bbea89 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xf4f48ce5e1bbea82 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049321.769601:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000040a9fa71/0xf4f48ce5e1bbea89 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf4f48ce5e1bbea82 expref: 6 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049321.769611:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000040a9fa71/0xf4f48ce5e1bbea89 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf4f48ce5e1bbea82 expref: 6 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049321.769619:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000040a9fa71, rc 0) 00000100:00100000:2.0:1789049321.769659:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000984516ec pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7ef694ec-1ea0-4f02-800c-d1279b4fdf12+6:5831:x1875954110562688:12345-0@lo:101: Request processed in 111us (278us total) trans 0 rc 0/0 00000100:00100000:2.0:1789049321.769666:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1789049321.769742:0:5831:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000002195f6a pname:cluuid:pid:xid:nid:opc:job mount.lustre:7ef694ec-1ea0-4f02-800c-d1279b4fdf12:5831:1875954110562688:0@lo:101: 00010000:00010000:3.0:1789049321.769754:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.126@tcp lock: 000000005641f1fd/0xf4f48ce5e1bbea82 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf4f48ce5e1bbea89 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049321.769773:0:5831:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.126@tcp lock: 000000005641f1fd/0xf4f48ce5e1bbea82 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xf4f48ce5e1bbea89 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789049321.769822:0:5831:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000002195f6a pname:cluuid:pid:xid:nid:opc:job mount.lustre:7ef694ec-1ea0-4f02-800c-d1279b4fdf12:5831:1875954110562816:0@lo:501: 00000100:00100000:3.0:1789049321.769892:0:5831:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789049321.769914:0:5831:0:(client.c:2716:ptlrpc_set_wait()) set 000000006720169b going to sleep for 11 seconds 00000100:00100000:3.0:1789049321.769932:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954110562816 00000100:00100000:3.0:1789049321.769936:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954110562816 00000100:00100000:3.0:1789049321.769968:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1789049321.769977:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000ae561e6d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7ef694ec-1ea0-4f02-800c-d1279b4fdf12+6:5831:x1875954110562816:12345-0@lo:501: 00000100:00100000:3.0:1789049321.770180:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000ae561e6d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7ef694ec-1ea0-4f02-800c-d1279b4fdf12+6:5831:x1875954110562816:12345-0@lo:501: Request processed in 203us (287us total) trans 0 rc -2/-2 00000100:00100000:3.0:1789049321.770187:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1789049321.770218:0:5831:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000002195f6a pname:cluuid:pid:xid:nid:opc:job mount.lustre:7ef694ec-1ea0-4f02-800c-d1279b4fdf12:5831:1875954110562816:0@lo:501: 10000000:01000000:3.0:1789049321.770459:0:5831:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.126@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:3.0:1789049321.770513:0:5831:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.126@tcp lock: 000000005641f1fd/0xf4f48ce5e1bbea82 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf4f48ce5e1bbea89 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049321.770522:0:5831:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.126@tcp lock: 000000005641f1fd/0xf4f48ce5e1bbea82 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf4f48ce5e1bbea89 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789049321.770530:0:5831:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff8cb8e01c3000 10000000:01000000:3.0:1789049321.770534:0:5831:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:3.0:1789049321.770538:0:5831:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff8cb8e01c3000 10000000:01000000:3.0:1789049321.770539:0:5831:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:3.0:1789049321.770542:0:5831:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff8cb8e01c3000 from 1 10000000:01000000:3.0:1789049321.770551:0:5831:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:3.0:1789049321.770570:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.126@tcp lock: 00000000c439d16b/0xf4f48ce5e1bbea90 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049321.770577:0:5831:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.126@tcp lock: 00000000c439d16b/0xf4f48ce5e1bbea90 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049321.770584:0:5831:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.126@tcp lock: 00000000c439d16b/0xf4f48ce5e1bbea90 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789049321.770596:0:5831:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000002195f6a pname:cluuid:pid:xid:nid:opc:job mount.lustre:7ef694ec-1ea0-4f02-800c-d1279b4fdf12:5831:1875954110562944:0@lo:101: 00000100:00100000:3.0:1789049321.770623:0:5831:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789049321.770647:0:5831:0:(client.c:2716:ptlrpc_set_wait()) set 000000006720169b going to sleep for 11 seconds 00000100:00100000:1.0:1789049321.770701:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954110562944 00000100:00100000:1.0:1789049321.770706:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954110562944 00000100:00100000:1.0:1789049321.770739:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1789049321.770745:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000f7a97353 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7ef694ec-1ea0-4f02-800c-d1279b4fdf12+6:5831:x1875954110562944:12345-0@lo:101: 00010000:00010000:1.0:1789049321.770753:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789049321.770764:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000ff0b03c1/0xf4f48ce5e1bbea97 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xf4f48ce5e1bbea90 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049321.770778:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000ff0b03c1/0xf4f48ce5e1bbea97 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf4f48ce5e1bbea90 expref: 7 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049321.770786:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000ff0b03c1/0xf4f48ce5e1bbea97 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf4f48ce5e1bbea90 expref: 7 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049321.770793:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000ff0b03c1, rc 0) 00000100:00100000:1.0:1789049321.770911:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000f7a97353 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7ef694ec-1ea0-4f02-800c-d1279b4fdf12+7:5831:x1875954110562944:12345-0@lo:101: Request processed in 166us (287us total) trans 0 rc 0/0 00000100:00100000:1.0:1789049321.770918:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1789049321.771047:0:5831:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000002195f6a pname:cluuid:pid:xid:nid:opc:job mount.lustre:7ef694ec-1ea0-4f02-800c-d1279b4fdf12:5831:1875954110562944:0@lo:101: 00010000:00010000:3.0:1789049321.771060:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.126@tcp lock: 00000000c439d16b/0xf4f48ce5e1bbea90 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf4f48ce5e1bbea97 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049321.771068:0:5831:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.126@tcp lock: 00000000c439d16b/0xf4f48ce5e1bbea90 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xf4f48ce5e1bbea97 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789049321.771078:0:5831:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.126@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:3.0:1789049321.771126:0:5831:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.126@tcp lock: 00000000c439d16b/0xf4f48ce5e1bbea90 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf4f48ce5e1bbea97 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049321.771133:0:5831:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.126@tcp lock: 00000000c439d16b/0xf4f48ce5e1bbea90 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf4f48ce5e1bbea97 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789049321.771138:0:5831:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:3.0:1789049321.771141:0:5831:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1789049321.771145:0:5831:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff8cb8e01c3000 10000000:01000000:3.0:1789049321.771152:0:5831:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:3.0:1789049321.771155:0:5831:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:3.0:1789049321.771157:0:5831:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:3.0:1789049321.771172:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.126@tcp lock: 00000000b2b735dc/0xf4f48ce5e1bbea9e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049321.771178:0:5831:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.126@tcp lock: 00000000b2b735dc/0xf4f48ce5e1bbea9e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049321.771184:0:5831:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.126@tcp lock: 00000000b2b735dc/0xf4f48ce5e1bbea9e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789049321.771194:0:5831:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000002195f6a pname:cluuid:pid:xid:nid:opc:job mount.lustre:7ef694ec-1ea0-4f02-800c-d1279b4fdf12:5831:1875954110563072:0@lo:101: 00000100:00100000:3.0:1789049321.771220:0:5831:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789049321.771255:0:5831:0:(client.c:2716:ptlrpc_set_wait()) set 000000006720169b going to sleep for 11 seconds 00000100:00100000:2.0:1789049321.771309:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954110563072 00000100:00100000:2.0:1789049321.771314:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954110563072 00000100:00100000:2.0:1789049321.771343:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1789049321.771349:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000009abec73f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7ef694ec-1ea0-4f02-800c-d1279b4fdf12+7:5831:x1875954110563072:12345-0@lo:101: 00010000:00010000:2.0:1789049321.771356:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789049321.771363:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000099930708/0xf4f48ce5e1bbeaa5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xf4f48ce5e1bbea9e expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049321.771376:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000099930708/0xf4f48ce5e1bbeaa5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf4f48ce5e1bbea9e expref: 8 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049321.771383:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000099930708/0xf4f48ce5e1bbeaa5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf4f48ce5e1bbea9e expref: 8 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049321.771390:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000099930708, rc 0) 00000100:00100000:2.0:1789049321.771429:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000009abec73f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7ef694ec-1ea0-4f02-800c-d1279b4fdf12+8:5831:x1875954110563072:12345-0@lo:101: Request processed in 80us (209us total) trans 0 rc 0/0 00000100:00100000:2.0:1789049321.771435:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1789049321.771611:0:5831:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000002195f6a pname:cluuid:pid:xid:nid:opc:job mount.lustre:7ef694ec-1ea0-4f02-800c-d1279b4fdf12:5831:1875954110563072:0@lo:101: 00010000:00010000:3.0:1789049321.771623:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.126@tcp lock: 00000000b2b735dc/0xf4f48ce5e1bbea9e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf4f48ce5e1bbeaa5 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049321.771629:0:5831:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.126@tcp lock: 00000000b2b735dc/0xf4f48ce5e1bbea9e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xf4f48ce5e1bbeaa5 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789049321.771666:0:5831:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000002195f6a pname:cluuid:pid:xid:nid:opc:job mount.lustre:7ef694ec-1ea0-4f02-800c-d1279b4fdf12:5831:1875954110563200:0@lo:501: 00000100:00100000:3.0:1789049321.771692:0:5831:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789049321.771713:0:5831:0:(client.c:2716:ptlrpc_set_wait()) set 000000006720169b going to sleep for 11 seconds 00000100:00100000:2.0:1789049321.771768:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954110563200 00000100:00100000:2.0:1789049321.771772:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954110563200 00000100:00100000:2.0:1789049321.771801:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1789049321.771808:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000db7dc3af pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7ef694ec-1ea0-4f02-800c-d1279b4fdf12+8:5831:x1875954110563200:12345-0@lo:501: 00000100:00100000:2.0:1789049321.772055:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000db7dc3af pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7ef694ec-1ea0-4f02-800c-d1279b4fdf12+9:5831:x1875954110563200:12345-0@lo:501: Request processed in 248us (361us total) trans 0 rc 0/0 00000100:00100000:2.0:1789049321.772061:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1789049321.772173:0:5831:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000002195f6a pname:cluuid:pid:xid:nid:opc:job mount.lustre:7ef694ec-1ea0-4f02-800c-d1279b4fdf12:5831:1875954110563200:0@lo:501: 00000100:00100000:3.0:1789049321.772203:0:5831:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000002195f6a pname:cluuid:pid:xid:nid:opc:job mount.lustre:7ef694ec-1ea0-4f02-800c-d1279b4fdf12:5831:1875954110563328:0@lo:503: 00000100:00100000:3.0:1789049321.772254:0:5831:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789049321.772288:0:5831:0:(client.c:2716:ptlrpc_set_wait()) set 000000006720169b going to sleep for 11 seconds 00000100:00100000:1.0:1789049321.772389:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954110563328 00000100:00100000:1.0:1789049321.772394:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954110563328 00000100:00100000:1.0:1789049321.772424:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1789049321.772430:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000908fa314 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7ef694ec-1ea0-4f02-800c-d1279b4fdf12+9:5831:x1875954110563328:12345-0@lo:503: 00000100:00100000:1.0:1789049321.772588:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000908fa314 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7ef694ec-1ea0-4f02-800c-d1279b4fdf12+9:5831:x1875954110563328:12345-0@lo:503: Request processed in 159us (334us total) trans 0 rc 0/0 00000100:00100000:1.0:1789049321.772595:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1789049321.772680:0:5831:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000002195f6a pname:cluuid:pid:xid:nid:opc:job mount.lustre:7ef694ec-1ea0-4f02-800c-d1279b4fdf12:5831:1875954110563328:0@lo:503: 00000100:00100000:3.0:1789049321.773092:0:5873:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000002195f6a pname:cluuid:pid:xid:nid:opc:job llog_process_th:7ef694ec-1ea0-4f02-800c-d1279b4fdf12:5873:1875954110563456:0@lo:502: 00000100:00100000:3.0:1789049321.773130:0:5873:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789049321.773158:0:5873:0:(client.c:2716:ptlrpc_set_wait()) set 0000000027f4e6ef going to sleep for 11 seconds 00000100:00100000:1.0:1789049321.773211:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954110563456 00000100:00100000:1.0:1789049321.773216:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954110563456 00000100:00100000:1.0:1789049321.773257:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1789049321.773263:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000003fee88f7 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7ef694ec-1ea0-4f02-800c-d1279b4fdf12+9:5873:x1875954110563456:12345-0@lo:502: 00000100:00100000:1.0:1789049321.773425:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000003fee88f7 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7ef694ec-1ea0-4f02-800c-d1279b4fdf12+9:5873:x1875954110563456:12345-0@lo:502: Request processed in 161us (294us total) trans 0 rc 0/0 00000100:00100000:1.0:1789049321.773431:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1789049321.773570:0:5873:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000002195f6a pname:cluuid:pid:xid:nid:opc:job llog_process_th:7ef694ec-1ea0-4f02-800c-d1279b4fdf12:5873:1875954110563456:0@lo:502: 00000020:01000000:2.0:1789049321.773596:0:5873:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789049321.773607:0:5873:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789049321.773609:0:5873:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:2.0:1789049321.773615:0:5873:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:2.0:1789049321.773618:0:5873:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1789049321.773632:0:5873:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (00000000b0386bd9) 00000020:00000080:2.0:1789049321.773651:0:5873:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:2.0:1789049321.773657:0:5873:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:2.0:1789049321.773734:0:5873:0:(osd_handler.c:1574:osd_obd_connect()) connect #2 00000020:00000080:2.0:1789049321.773740:0:5873:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xf4f48ce5e1bbeab3 00000020:00000080:2.0:1789049321.774011:0:5873:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:2.0:1789049321.774016:0:5873:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789049321.774020:0:5873:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789049321.774021:0:5873:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:2.0:1789049321.774024:0:5873:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789049321.774027:0:5873:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789049321.774028:0:5873:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:2.0:1789049321.774031:0:5873:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1789049321.774039:0:5873:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (0000000021234405) 00000020:00000080:2.0:1789049321.774048:0:5873:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:2.0:1789049321.774052:0:5873:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:2.0:1789049321.774053:0:5873:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:2.0:1789049321.774057:0:5873:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:2.0:1789049321.774068:0:5873:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:2.0:1789049321.774110:0:5873:0:(tgt_mount.c:153:server_get_mount()) get mount 0000000006d9cab9 from lustre-MDT0000, refs=3 00000020:00000080:2.0:1789049321.774130:0:5873:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (00000000c971e02c) 00000020:00000080:2.0:1789049321.774139:0:5873:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:2.0:1789049321.774188:0:5873:0:(lod_dev.c:2292:lod_obd_connect()) connect #0 00000020:00000080:2.0:1789049321.774193:0:5873:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xf4f48ce5e1bbeac8 00000020:00000080:2.0:1789049321.774360:0:5873:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:2.0:1789049321.774367:0:5873:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:2.0:1789049321.774372:0:5873:0:(genops.c:1384:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0xf4f48ce5e1bbeacf 00080000:01000000:2.0:1789049321.774376:0:5873:0:(osd_handler.c:1574:osd_obd_connect()) connect #3 00000020:00000080:2.0:1789049321.774379:0:5873:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xf4f48ce5e1bbead6 00080000:10000000:2.0:1789049321.774754:0:5873:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000001:0x3:0x0] (8/8/3) registered 40000000:02000000:2.0:1789049321.775060:0:5873:0:(fid_handler.c:560:seq_server_init()) ctl-lustre-MDT0000: No data found on store. Initialize space. 40000000:02000000:2.0:1789049321.780274:0:5873:0:(fid_handler.c:560:seq_server_init()) srv-lustre-MDT0000: No data found on store. Initialize space. 00010000:00010000:3.0:1789049321.858960:0:5873:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-1 is initialized 00000001:02000400:3.0:1789049321.859516:0:5873:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-MDT0000: new disk, initializing 00000001:00000004:3.0:1789049321.862664:0:5873:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 0 00000001:00080000:3.0:1789049321.863011:0:5873:0:(tgt_lastrcvd.c:240:tgt_reply_header_write()) lustre-MDT0000: write reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:3.0:1789049321.893051:0:5873:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (000000009f4daf5f) 00000020:00000080:3.0:1789049321.893073:0:5873:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:3.0:1789049321.893135:0:5873:0:(osd_handler.c:1574:osd_obd_connect()) connect #4 00000020:00000080:3.0:1789049321.893142:0:5873:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xf4f48ce5e1bbeae4 00000020:00000080:0.0:1789049321.896957:0:5873:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00080000:10000000:3.0:1789049321.904067:0:5873:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x10000:0x0] (8/8/4) registered 00080000:10000000:3.0:1789049321.942830:0:5873:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x1010000:0x0] (8/8/4) registered 00080000:10000000:0.0:1789049321.974777:0:5873:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x2010000:0x0] (8/8/4) registered 00080000:10000000:2.0:1789049322.009994:0:5873:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x20000:0x0] (8/8/4) registered 00080000:10000000:2.0:1789049322.053689:0:5873:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x1020000:0x0] (8/8/4) registered 00080000:10000000:1.0:1789049322.088500:0:5873:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x2020000:0x0] (8/8/4) registered 00000020:00000080:1.0:1789049322.118046:0:5873:0:(genops.c:1384:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0xf4f48ce5e1bbeaeb 00000020:00000080:1.0:1789049322.118558:0:5873:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:1.0:1789049322.118569:0:5873:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789049322.118575:0:5873:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789049322.118577:0:5873:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:1.0:1789049322.118580:0:5873:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789049322.118585:0:5873:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789049322.118586:0:5873:0:(obd_config.c:1563:class_process_config()) marker 8 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:1.0:1789049322.118589:0:5873:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:1.0:1789049322.118625:0:5873:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:1.0:1789049322.118638:0:5873:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789049322.118642:0:5873:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789049322.118643:0:5873:0:(obd_config.c:1563:class_process_config()) marker 8 (0x2) lustre-MDT0000 mdt.identity_upcall 00000020:01000000:1.0:1789049322.118645:0:5873:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789049322.118732:0:5873:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789049322.118733:0:5873:0:(obd_config.c:1563:class_process_config()) marker 10 (0x1) lustre sys.timeout 00000020:00000080:1.0:1789049322.118738:0:5873:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1789049322.118739:0:5873:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:1.0:1789049322.118792:0:5873:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000939dc344 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7ef694ec-1ea0-4f02-800c-d1279b4fdf12:5873:1875954110563584:0@lo:502: 00000100:00100000:1.0:1789049322.118907:0:5873:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789049322.118997:0:5873:0:(client.c:2716:ptlrpc_set_wait()) set 00000000f43934f8 going to sleep for 11 seconds 00000100:00100000:0.0:1789049322.119083:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954110563584 00000100:00100000:0.0:1789049322.119090:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954110563584 00000100:00100000:0.0:1789049322.119163:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1789049322.119172:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000a4d43831 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7ef694ec-1ea0-4f02-800c-d1279b4fdf12+9:5873:x1875954110563584:12345-0@lo:502: 00000100:00100000:0.0:1789049322.119531:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000a4d43831 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7ef694ec-1ea0-4f02-800c-d1279b4fdf12+9:5873:x1875954110563584:12345-0@lo:502: Request processed in 360us (623us total) trans 0 rc 0/0 00000100:00100000:0.0:1789049322.119538:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1789049322.120122:0:5873:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000939dc344 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7ef694ec-1ea0-4f02-800c-d1279b4fdf12:5873:1875954110563584:0@lo:502: 00000020:01000000:3.0:1789049322.120343:0:5873:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789049322.120351:0:5873:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789049322.120353:0:5873:0:(obd_config.c:1563:class_process_config()) marker 10 (0x2) lustre sys.timeout 00000040:00080000:3.0:1789049322.120357:0:5873:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 16 count 16 00000020:01000000:1.0:1789049322.120526:0:5831:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-15 (rc=0) 10000000:01000000:1.0:1789049322.120545:0:5831:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.126@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:1.0:1789049322.120599:0:5831:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.126@tcp lock: 00000000b2b735dc/0xf4f48ce5e1bbea9e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf4f48ce5e1bbeaa5 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049322.120623:0:5831:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.126@tcp lock: 00000000b2b735dc/0xf4f48ce5e1bbea9e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf4f48ce5e1bbeaa5 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789049322.120631:0:5831:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8cb8e01c3000 from 1 10000000:01000000:1.0:1789049322.120634:0:5831:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1789049322.120680:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.126@tcp lock: 00000000d7606e19/0xf4f48ce5e1bbeaf2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049322.120688:0:5831:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.126@tcp lock: 00000000d7606e19/0xf4f48ce5e1bbeaf2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049322.120696:0:5831:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.126@tcp lock: 00000000d7606e19/0xf4f48ce5e1bbeaf2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789049322.120713:0:5831:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000005215d7c9 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7ef694ec-1ea0-4f02-800c-d1279b4fdf12:5831:1875954110563712:0@lo:101: 00000100:00100000:1.0:1789049322.120758:0:5831:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789049322.120794:0:5831:0:(client.c:2716:ptlrpc_set_wait()) set 00000000aaf4e574 going to sleep for 11 seconds 00000100:00100000:3.0:1789049322.120932:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954110563712 00000100:00100000:3.0:1789049322.120939:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954110563712 00000100:00100000:3.0:1789049322.120979:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1789049322.120986:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000047199940 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7ef694ec-1ea0-4f02-800c-d1279b4fdf12+9:5831:x1875954110563712:12345-0@lo:101: 00010000:00010000:3.0:1789049322.120997:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789049322.121010:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000bb020e1d/0xf4f48ce5e1bbeaf9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xf4f48ce5e1bbeaf2 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049322.121031:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000bb020e1d/0xf4f48ce5e1bbeaf9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf4f48ce5e1bbeaf2 expref: 10 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049322.121053:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000bb020e1d/0xf4f48ce5e1bbeaf9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf4f48ce5e1bbeaf2 expref: 10 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049322.121060:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000bb020e1d, rc 0) 00000100:00100000:3.0:1789049322.121107:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000047199940 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7ef694ec-1ea0-4f02-800c-d1279b4fdf12+10:5831:x1875954110563712:12345-0@lo:101: Request processed in 122us (349us total) trans 0 rc 0/0 00000100:00100000:3.0:1789049322.121114:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1789049322.121206:0:5831:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000005215d7c9 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7ef694ec-1ea0-4f02-800c-d1279b4fdf12:5831:1875954110563712:0@lo:101: 00010000:00010000:2.0:1789049322.121219:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.126@tcp lock: 00000000d7606e19/0xf4f48ce5e1bbeaf2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf4f48ce5e1bbeaf9 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049322.121239:0:5831:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.126@tcp lock: 00000000d7606e19/0xf4f48ce5e1bbeaf2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xf4f48ce5e1bbeaf9 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789049322.121801:0:5831:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000057d35a22 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7ef694ec-1ea0-4f02-800c-d1279b4fdf12:5831:1875954110563840:0@lo:256: 00000100:00100000:2.0:1789049322.121894:0:5831:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789049322.121928:0:5831:0:(client.c:2716:ptlrpc_set_wait()) set 00000000c05bcfb0 going to sleep for 11 seconds 00000100:00100000:3.0:1789049322.122062:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954110563840 00000100:00100000:3.0:1789049322.122068:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954110563840 00000100:00100000:3.0:1789049322.122106:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1789049322.122113:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000726b0163 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7ef694ec-1ea0-4f02-800c-d1279b4fdf12+10:5831:x1875954110563840:12345-0@lo:256: 20000000:01000000:3.0:1789049322.122129:0:5844:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:3.0:1789049322.122134:0:5844:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 0, version 1 00000100:00100000:3.0:1789049322.122200:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000726b0163 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7ef694ec-1ea0-4f02-800c-d1279b4fdf12+10:5831:x1875954110563840:12345-0@lo:256: Request processed in 87us (307us total) trans 0 rc 0/0 00000100:00100000:3.0:1789049322.122207:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1789049322.122408:0:5831:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000057d35a22 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7ef694ec-1ea0-4f02-800c-d1279b4fdf12:5831:1875954110563840:0@lo:256: 10000000:01000000:2.0:1789049322.123080:0:5831:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.126@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1789049322.123405:0:5831:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.126@tcp lock: 00000000d7606e19/0xf4f48ce5e1bbeaf2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf4f48ce5e1bbeaf9 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049322.123417:0:5831:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.126@tcp lock: 00000000d7606e19/0xf4f48ce5e1bbeaf2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf4f48ce5e1bbeaf9 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789049322.123523:0:5831:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8cb8e01c3000 from 1 10000000:01000000:3.0:1789049322.123527:0:5831:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1789049322.123560:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.126@tcp lock: 0000000006902404/0xf4f48ce5e1bbeb00 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049322.123567:0:5831:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.126@tcp lock: 0000000006902404/0xf4f48ce5e1bbeb00 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049322.123576:0:5831:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.126@tcp lock: 0000000006902404/0xf4f48ce5e1bbeb00 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789049322.123595:0:5831:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000000e904311 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7ef694ec-1ea0-4f02-800c-d1279b4fdf12:5831:1875954110563968:0@lo:101: 00000100:00100000:3.0:1789049322.123730:0:5831:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789049322.123807:0:5831:0:(client.c:2716:ptlrpc_set_wait()) set 00000000b8daea7f going to sleep for 11 seconds 00000100:00100000:0.0:1789049322.124020:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954110563968 00000100:00100000:0.0:1789049322.124028:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954110563968 00000100:00100000:1.0:1789049322.124179:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1789049322.124187:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000007f169fe0 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7ef694ec-1ea0-4f02-800c-d1279b4fdf12+10:5831:x1875954110563968:12345-0@lo:101: 00010000:00010000:1.0:1789049322.124200:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789049322.124214:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000a3f94b78/0xf4f48ce5e1bbeb07 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xf4f48ce5e1bbeb00 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049322.124247:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000a3f94b78/0xf4f48ce5e1bbeb07 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf4f48ce5e1bbeb00 expref: 11 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049322.124256:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000a3f94b78/0xf4f48ce5e1bbeb07 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf4f48ce5e1bbeb00 expref: 11 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049322.124276:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000a3f94b78, rc 0) 00000100:00100000:1.0:1789049322.124320:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000007f169fe0 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7ef694ec-1ea0-4f02-800c-d1279b4fdf12+11:5831:x1875954110563968:12345-0@lo:101: Request processed in 134us (591us total) trans 0 rc 0/0 00000100:00100000:1.0:1789049322.124326:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1789049322.124392:0:5831:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000000e904311 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7ef694ec-1ea0-4f02-800c-d1279b4fdf12:5831:1875954110563968:0@lo:101: 00010000:00010000:3.0:1789049322.124405:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.126@tcp lock: 0000000006902404/0xf4f48ce5e1bbeb00 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf4f48ce5e1bbeb07 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049322.124413:0:5831:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.126@tcp lock: 0000000006902404/0xf4f48ce5e1bbeb00 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xf4f48ce5e1bbeb07 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789049322.124470:0:5831:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000000e904311 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7ef694ec-1ea0-4f02-800c-d1279b4fdf12:5831:1875954110564096:0@lo:501: 00000100:00100000:3.0:1789049322.124497:0:5831:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789049322.124634:0:5831:0:(client.c:2716:ptlrpc_set_wait()) set 00000000b8daea7f going to sleep for 11 seconds 00000100:00100000:2.0:1789049322.124781:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954110564096 00000100:00100000:2.0:1789049322.124786:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954110564096 00000100:00100000:2.0:1789049322.124808:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1789049322.124813:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000005f25219e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7ef694ec-1ea0-4f02-800c-d1279b4fdf12+11:5831:x1875954110564096:12345-0@lo:501: 00000100:00100000:2.0:1789049322.125594:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000005f25219e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7ef694ec-1ea0-4f02-800c-d1279b4fdf12+11:5831:x1875954110564096:12345-0@lo:501: Request processed in 778us (1094us total) trans 0 rc 0/0 00000100:00100000:2.0:1789049322.125603:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1789049322.126054:0:5831:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000000e904311 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7ef694ec-1ea0-4f02-800c-d1279b4fdf12:5831:1875954110564096:0@lo:501: 00000100:00100000:3.0:1789049322.126097:0:5831:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000000e904311 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7ef694ec-1ea0-4f02-800c-d1279b4fdf12:5831:1875954110564224:0@lo:503: 00000100:00100000:3.0:1789049322.126149:0:5831:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789049322.126213:0:5831:0:(client.c:2716:ptlrpc_set_wait()) set 00000000b8daea7f going to sleep for 11 seconds 00000100:00100000:2.0:1789049322.126308:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954110564224 00000100:00100000:2.0:1789049322.126314:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954110564224 00000100:00100000:2.0:1789049322.126390:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1789049322.126398:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000dad5285f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7ef694ec-1ea0-4f02-800c-d1279b4fdf12+11:5831:x1875954110564224:12345-0@lo:503: 00000040:00080000:2.0:1789049322.126441:0:5845:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1789049322.126525:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000dad5285f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7ef694ec-1ea0-4f02-800c-d1279b4fdf12+11:5831:x1875954110564224:12345-0@lo:503: Request processed in 128us (376us total) trans 0 rc 0/0 00000100:00100000:2.0:1789049322.126533:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1789049322.126612:0:5831:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000000e904311 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7ef694ec-1ea0-4f02-800c-d1279b4fdf12:5831:1875954110564224:0@lo:503: 00000040:00080000:1.0:1789049322.127499:0:5877:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 1 00000020:01000000:3.0:1789049322.127641:0:5831:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-0 (rc=0) 10000000:01000000:3.0:1789049322.127735:0:5831:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.126@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1789049322.127756:0:5831:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.126@tcp lock: 0000000006902404/0xf4f48ce5e1bbeb00 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf4f48ce5e1bbeb07 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049322.127767:0:5831:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.126@tcp lock: 0000000006902404/0xf4f48ce5e1bbeb00 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf4f48ce5e1bbeb07 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789049322.127808:0:5831:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:3.0:1789049322.127811:0:5831:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff8cb8e01c3000 10000000:01000000:3.0:1789049322.127823:0:5831:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff8cb8e01c3000 10000000:01000000:3.0:1789049322.127826:0:5831:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1789049322.127832:0:5831:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8cb8e01c3000 from 1 10000000:01000000:3.0:1789049322.127834:0:5831:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1789049322.127903:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.126@tcp lock: 00000000d7e13274/0xf4f48ce5e1bbeb0e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049322.127911:0:5831:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.126@tcp lock: 00000000d7e13274/0xf4f48ce5e1bbeb0e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049322.127920:0:5831:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.126@tcp lock: 00000000d7e13274/0xf4f48ce5e1bbeb0e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789049322.127937:0:5831:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000000e904311 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7ef694ec-1ea0-4f02-800c-d1279b4fdf12:5831:1875954110564352:0@lo:101: 00000100:00100000:3.0:1789049322.127986:0:5831:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789049322.128019:0:5831:0:(client.c:2716:ptlrpc_set_wait()) set 000000002ae36fae going to sleep for 11 seconds 00000100:00100000:1.0:1789049322.128082:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954110564352 00000100:00100000:1.0:1789049322.128089:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954110564352 00000100:00100000:1.0:1789049322.128127:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1789049322.128134:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000d0df8a47 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7ef694ec-1ea0-4f02-800c-d1279b4fdf12+11:5831:x1875954110564352:12345-0@lo:101: 00010000:00010000:1.0:1789049322.128145:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789049322.128156:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000b2543cf9/0xf4f48ce5e1bbeb15 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xf4f48ce5e1bbeb0e expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049322.128176:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000b2543cf9/0xf4f48ce5e1bbeb15 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf4f48ce5e1bbeb0e expref: 12 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049322.128186:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000b2543cf9/0xf4f48ce5e1bbeb15 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf4f48ce5e1bbeb0e expref: 12 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049322.128193:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000b2543cf9, rc 0) 00000100:00100000:1.0:1789049322.128298:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000d0df8a47 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7ef694ec-1ea0-4f02-800c-d1279b4fdf12+12:5831:x1875954110564352:12345-0@lo:101: Request processed in 164us (312us total) trans 0 rc 0/0 00000100:00100000:1.0:1789049322.128305:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1789049322.128380:0:5831:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000000e904311 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7ef694ec-1ea0-4f02-800c-d1279b4fdf12:5831:1875954110564352:0@lo:101: 00010000:00010000:3.0:1789049322.128393:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.126@tcp lock: 00000000d7e13274/0xf4f48ce5e1bbeb0e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf4f48ce5e1bbeb15 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049322.128400:0:5831:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.126@tcp lock: 00000000d7e13274/0xf4f48ce5e1bbeb0e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xf4f48ce5e1bbeb15 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789049322.128446:0:5831:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000000e904311 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7ef694ec-1ea0-4f02-800c-d1279b4fdf12:5831:1875954110564480:0@lo:501: 00000100:00100000:3.0:1789049322.128473:0:5831:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789049322.128527:0:5831:0:(client.c:2716:ptlrpc_set_wait()) set 000000002ae36fae going to sleep for 11 seconds 00000100:00100000:2.0:1789049322.128644:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954110564480 00000100:00100000:2.0:1789049322.128658:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954110564480 00000100:00100000:2.0:1789049322.128689:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1789049322.128696:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000006b10b4c3 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7ef694ec-1ea0-4f02-800c-d1279b4fdf12+12:5831:x1875954110564480:12345-0@lo:501: 00000100:00100000:2.0:1789049322.128971:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000006b10b4c3 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7ef694ec-1ea0-4f02-800c-d1279b4fdf12+12:5831:x1875954110564480:12345-0@lo:501: Request processed in 276us (497us total) trans 0 rc 0/0 00000100:00100000:2.0:1789049322.128979:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1789049322.129126:0:5831:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000000e904311 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7ef694ec-1ea0-4f02-800c-d1279b4fdf12:5831:1875954110564480:0@lo:501: 00000100:00100000:0.0:1789049322.129169:0:5831:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000e4e9b3ad pname:cluuid:pid:xid:nid:opc:job mount.lustre:7ef694ec-1ea0-4f02-800c-d1279b4fdf12:5831:1875954110564608:0@lo:503: 00000100:00100000:0.0:1789049322.129209:0:5831:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789049322.129246:0:5831:0:(client.c:2716:ptlrpc_set_wait()) set 00000000ac9ff7e5 going to sleep for 11 seconds 00000100:00100000:3.0:1789049322.129357:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954110564608 00000100:00100000:3.0:1789049322.129363:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954110564608 00000100:00100000:3.0:1789049322.129383:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1789049322.129388:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000936acb30 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7ef694ec-1ea0-4f02-800c-d1279b4fdf12+12:5831:x1875954110564608:12345-0@lo:503: 00000100:00100000:3.0:1789049322.129711:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000936acb30 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7ef694ec-1ea0-4f02-800c-d1279b4fdf12+12:5831:x1875954110564608:12345-0@lo:503: Request processed in 322us (501us total) trans 0 rc 0/0 00000100:00100000:3.0:1789049322.129718:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1789049322.130118:0:5831:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000e4e9b3ad pname:cluuid:pid:xid:nid:opc:job mount.lustre:7ef694ec-1ea0-4f02-800c-d1279b4fdf12:5831:1875954110564608:0@lo:503: 00000100:00100000:0.0:1789049322.130712:0:5878:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000e4e9b3ad pname:cluuid:pid:xid:nid:opc:job llog_process_th:7ef694ec-1ea0-4f02-800c-d1279b4fdf12:5878:1875954110564736:0@lo:502: 00000100:00100000:0.0:1789049322.130773:0:5878:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789049322.130815:0:5878:0:(client.c:2716:ptlrpc_set_wait()) set 000000004528478a going to sleep for 11 seconds 00000100:00100000:3.0:1789049322.130945:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954110564736 00000100:00100000:3.0:1789049322.130952:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954110564736 00000100:00100000:3.0:1789049322.130988:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1789049322.130995:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000a7771147 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7ef694ec-1ea0-4f02-800c-d1279b4fdf12+12:5878:x1875954110564736:12345-0@lo:502: 00000100:00100000:3.0:1789049322.131304:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000a7771147 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7ef694ec-1ea0-4f02-800c-d1279b4fdf12+12:5878:x1875954110564736:12345-0@lo:502: Request processed in 309us (530us total) trans 0 rc 0/0 00000100:00100000:3.0:1789049322.131311:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1789049322.131449:0:5878:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000e4e9b3ad pname:cluuid:pid:xid:nid:opc:job llog_process_th:7ef694ec-1ea0-4f02-800c-d1279b4fdf12:5878:1875954110564736:0@lo:502: 00000020:01000004:0.0:1789049322.131506:0:5878:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:0.0:1789049322.131528:0:5878:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (000000007123636e) 00000020:00000080:0.0:1789049322.131545:0:5878:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type lwp with refcount 2 00000020:01000004:0.0:1789049322.131619:0:5878:0:(tgt_mount.c:153:server_get_mount()) get mount 0000000006d9cab9 from lustre-MDT0000, refs=4 00000020:01000004:0.0:1789049322.131624:0:5878:0:(tgt_mount.c:187:server_put_mount()) put mount 0000000006d9cab9 from lustre-MDT0000, refs=4 00000020:01000004:0.0:1789049322.131627:0:5878:0:(obd_mount.c:710:lustre_put_lsi()) put 0000000006d9cab9 4 00010000:00080000:0.0:1789049322.131666:0:5878:0:(ldlm_lib.c:102:import_set_conn()) imp 0000000095683905@lustre-MDT0000-lwp-MDT0000: add connection 192.168.206.126@tcp at head 00010000:00010000:0.0:1789049322.133997:0:5878:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-1 is initialized 00000020:00000080:0.0:1789049322.134189:0:5878:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:0.0:1789049322.134294:0:5878:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1789049322.134306:0:5878:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0xf4f48ce5e1bbeb23 00000100:00080000:0.0:1789049322.134315:0:5878:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1789049322.134325:0:5878:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import 0000000095683905 using connection 192.168.206.126@tcp/0@lo 00000100:00100000:0.0:1789049322.134356:0:5878:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@00000000e4e9b3ad x1875954110564864/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1789049322.134391:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000e4e9b3ad pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3307:1875954110564864:0@lo:38: 00000100:00100000:0.0:1789049322.134469:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789049322.134532:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954110564864 00000100:00100000:0.0:1789049322.134540:0:5850:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954110564864 00000100:00100000:0.0:1789049322.134569:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1789049322.134575:0:5850:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000014bdc1bf pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3307:x1875954110564864:12345-0@lo:38: 00000100:00100000:0.0:1789049322.134624:0:5850:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000014bdc1bf pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3307:x1875954110564864:12345-0@lo:38: Request processed in 48us (156us total) trans 0 rc -11/-11 00000100:00100000:0.0:1789049322.134631:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1789049322.134679:0:3307:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1789049322.134687:0:3307:0:(import.c:65:import_set_state_nolock()) 0000000095683905 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1789049322.134700:0:3307:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:0.0:1789049322.134704:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000e4e9b3ad pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3307:1875954110564864:0@lo:38: 00000100:00080000:0.0:1789049322.134732:0:5878:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:3.0:1789049322.136703:0:5878:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000c5627cab pname:cluuid:pid:xid:nid:opc:job llog_process_th:7ef694ec-1ea0-4f02-800c-d1279b4fdf12:5878:1875954110564992:0@lo:502: 00000100:00100000:3.0:1789049322.136775:0:5878:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789049322.136811:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954110564992 00000100:00100000:3.0:1789049322.136818:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954110564992 00000100:00100000:3.0:1789049322.136907:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1789049322.136916:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000f38f32a9 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7ef694ec-1ea0-4f02-800c-d1279b4fdf12+12:5878:x1875954110564992:12345-0@lo:502: 00000100:00100000:3.0:1789049322.137119:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000f38f32a9 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7ef694ec-1ea0-4f02-800c-d1279b4fdf12+12:5878:x1875954110564992:12345-0@lo:502: Request processed in 204us (344us total) trans 0 rc 0/0 00000100:00100000:3.0:1789049322.137127:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1789049322.137233:0:5878:0:(client.c:2716:ptlrpc_set_wait()) set 0000000068399e5e going to sleep for 11 seconds 00000100:00100000:3.0:1789049322.137252:0:5878:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000c5627cab pname:cluuid:pid:xid:nid:opc:job llog_process_th:7ef694ec-1ea0-4f02-800c-d1279b4fdf12:5878:1875954110564992:0@lo:502: 00000040:00080000:3.0:1789049322.137276:0:5878:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 21 count 21 00000020:01000000:3.0:1789049322.137320:0:5831:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-20 (rc=0) 10000000:01000000:3.0:1789049322.137336:0:5831:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.126@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1789049322.137350:0:5831:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.126@tcp lock: 00000000d7e13274/0xf4f48ce5e1bbeb0e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf4f48ce5e1bbeb15 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049322.137369:0:5831:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.126@tcp lock: 00000000d7e13274/0xf4f48ce5e1bbeb0e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf4f48ce5e1bbeb15 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:3.0:1789049322.137405:0:5831:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:3.0:1789049322.137407:0:5831:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1789049322.137408:0:5831:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789049322.137409:0:5831:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1789049322.137410:0:5831:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789049322.137412:0:5831:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789049322.137413:0:5831:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1789049322.137414:0:5831:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1789049322.137415:0:5831:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1789049322.137417:0:5831:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1789049322.137418:0:5831:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789049322.137419:0:5831:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1789049322.137423:0:5831:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020065 00000020:01000004:3.0:1789049322.137425:0:5831:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1789049322.137426:0:5831:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1789049322.137427:0:5831:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789049322.137428:0:5831:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1789049322.137429:0:5831:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789049322.137430:0:5831:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789049322.137431:0:5831:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1789049322.137432:0:5831:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1789049322.137433:0:5831:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1789049322.137434:0:5831:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1789049322.137434:0:5831:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789049322.137436:0:5831:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1789049322.137451:0:5831:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:3.0:1789049322.137459:0:5831:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000c5627cab pname:cluuid:pid:xid:nid:opc:job mount.lustre:7ef694ec-1ea0-4f02-800c-d1279b4fdf12:5831:1875954110565120:0@lo:253: 00000100:00100000:3.0:1789049322.137488:0:5831:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789049322.137500:0:5831:0:(client.c:2716:ptlrpc_set_wait()) set 00000000b8daea7f going to sleep for 11 seconds 00000100:00100000:1.0:1789049322.137865:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954110565120 00000100:00100000:1.0:1789049322.137872:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954110565120 00000100:00100000:1.0:1789049322.137916:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1789049322.137923:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000009e1ca964 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7ef694ec-1ea0-4f02-800c-d1279b4fdf12+12:5831:x1875954110565120:12345-0@lo:253: 20000000:01000000:1.0:1789049322.137958:0:5843:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:1.0:1789049322.137970:0:5843:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:1.0:1789049322.179032:0:5843:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:1.0:1789049322.179052:0:5843:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:2.0:1789049322.179238:0:5866:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1789049322.179244:0:5866:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:2.0:1789049322.179267:0:5866:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 00000000965d1f06/0xf4f48ce5e1bbeb2a lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5866 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049322.179288:0:5866:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 00000000bb020e1d/0xf4f48ce5e1bbeaf9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf4f48ce5e1bbeaf2 expref: 12 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049322.179295:0:5866:0:(ldlm_resource.c:1751:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 00000000965d1f06/0xf4f48ce5e1bbeb2a lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5866 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049322.179334:0:5866:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 00000000bb020e1d/0xf4f48ce5e1bbeaf9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf4f48ce5e1bbeaf2 expref: 12 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049322.179350:0:5866:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 00000000bb020e1d/0xf4f48ce5e1bbeaf9 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf4f48ce5e1bbeaf2 expref: 12 pid: 5845 timeout: 298 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789049322.179364:0:5866:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000057d35a22 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5866:1875954110565248:0@lo:104: 00000100:00100000:2.0:1789049322.179441:0:5866:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789049322.179541:0:5866:0:(client.c:2716:ptlrpc_set_wait()) set 00000000d36fafe8 going to sleep for 11 seconds 00000100:00100000:3.0:1789049322.179681:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954110565248 00000100:00100000:3.0:1789049322.179690:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954110565248 00000100:00100000:3.0:1789049322.179745:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1789049322.179767:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000010d0d54d pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:7ef694ec-1ea0-4f02-800c-d1279b4fdf12+3:5866:x1875954110565248:12345-0@lo:104: 00010000:00010000:3.0:1789049322.179780:0:5833:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.126@tcp lock: 00000000d7606e19/0xf4f48ce5e1bbeaf2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xf4f48ce5e1bbeaf9 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049322.179837:0:5833:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1789049322.179864:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000010d0d54d pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:7ef694ec-1ea0-4f02-800c-d1279b4fdf12+3:5866:x1875954110565248:12345-0@lo:104: Request processed in 78us (402us total) trans 0 rc 0/0 00000100:00100000:3.0:1789049322.179871:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1789049322.180034:0:5866:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000057d35a22 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5866:1875954110565248:0@lo:104: 00010000:00010000:2.0:1789049322.180068:0:5866:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 00000000965d1f06/0xf4f48ce5e1bbeb2a lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5866 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049322.180743:0:5838:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789049322.180750:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.126@tcp lock: 00000000d7606e19/0xf4f48ce5e1bbeaf2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xf4f48ce5e1bbeaf9 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049322.180757:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000d7606e19 already unused, calling callback (00000000e4237f11) 10000000:00010000:0.0:1789049322.180761:0:5838:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.126@tcp lock: 00000000d7606e19/0xf4f48ce5e1bbeaf2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xf4f48ce5e1bbeaf9 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049322.180768:0:5838:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.126@tcp lock: 00000000d7606e19/0xf4f48ce5e1bbeaf2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xf4f48ce5e1bbeaf9 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789049322.180774:0:5838:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.126@tcp lock: 00000000d7606e19/0xf4f48ce5e1bbeaf2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xf4f48ce5e1bbeaf9 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789049322.180780:0:5838:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1789049322.180824:0:5838:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.126@tcp lock: 00000000d7606e19/0xf4f48ce5e1bbeaf2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf4f48ce5e1bbeaf9 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049322.180831:0:5838:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789049322.180883:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.126@tcp lock: 00000000d7606e19/0xf4f48ce5e1bbeaf2 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf4f48ce5e1bbeaf9 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049322.180890:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.126@tcp lock: 00000000d7606e19/0xf4f48ce5e1bbeaf2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf4f48ce5e1bbeaf9 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049322.180911:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789049322.180913:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789049322.180914:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789049322.180970:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789049322.180983:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000e4e9b3ad pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7ef694ec-1ea0-4f02-800c-d1279b4fdf12:3308:1875954110565376:0@lo:103: 00000100:00100000:0.0:1789049322.181028:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789049322.181091:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954110565376 00000100:00100000:0.0:1789049322.181097:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954110565376 00010000:00010000:0.0:1789049322.181119:0:5835:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 00000000bb020e1d/0xf4f48ce5e1bbeaf9 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf4f48ce5e1bbeaf2 expref: 13 pid: 5845 timeout: 298 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789049322.181143:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1789049322.181151:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000690a3099 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7ef694ec-1ea0-4f02-800c-d1279b4fdf12+13:3308:x1875954110565376:12345-0@lo:103: 00010000:00010000:0.0:1789049322.181162:0:5835:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789049322.181166:0:5835:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 00000000bb020e1d/0xf4f48ce5e1bbeaf9 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf4f48ce5e1bbeaf2 expref: 13 pid: 5845 timeout: 298 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049322.181175:0:5835:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 00000000bb020e1d/0xf4f48ce5e1bbeaf9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf4f48ce5e1bbeaf2 expref: 13 pid: 5845 timeout: 298 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049322.181188:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000bb020e1d/0xf4f48ce5e1bbeaf9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf4f48ce5e1bbeaf2 expref: 13 pid: 5845 timeout: 298 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049322.181203:0:5835:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 00000000965d1f06/0xf4f48ce5e1bbeb2a lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5866 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049322.181210:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000965d1f06/0xf4f48ce5e1bbeb2a lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5866 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1789049322.181405:0:5835:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.002161291s 00010000:00010000:0.0:1789049322.181410:0:5835:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000965d1f06/0xf4f48ce5e1bbeb2a lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5866 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049322.181417:0:5835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000965d1f06/0xf4f48ce5e1bbeb2a lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5866 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049322.181424:0:5835:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 00000000965d1f06/0xf4f48ce5e1bbeb2a lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5866 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049322.181439:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 00000000965d1f06/0xf4f48ce5e1bbeb2a lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5866 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049322.181445:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000965d1f06 already unused, calling callback (0000000002254c5f) 00010000:00010000:0.0:1789049322.181448:0:5835:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 00000000965d1f06/0xf4f48ce5e1bbeb2a lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5866 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049322.181455:0:5835:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 00000000965d1f06/0xf4f48ce5e1bbeb2a lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5866 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049322.185395:0:5866:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 00000000965d1f06/0xf4f48ce5e1bbeb2a lrc: 5/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5866 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049322.185414:0:5866:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 00000000965d1f06/0xf4f48ce5e1bbeb2a lrc: 5/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5866 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049322.185499:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 00000000965d1f06/0xf4f48ce5e1bbeb2a lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5866 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049322.185510:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000965d1f06/0xf4f48ce5e1bbeb2a lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5866 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049322.185528:0:5835:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789049322.185601:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000690a3099 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7ef694ec-1ea0-4f02-800c-d1279b4fdf12+12:3308:x1875954110565376:12345-0@lo:103: Request processed in 4448us (4570us total) trans 0 rc 0/0 00000100:00100000:0.0:1789049322.185612:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1789049322.185769:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000e4e9b3ad pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7ef694ec-1ea0-4f02-800c-d1279b4fdf12:3308:1875954110565376:0@lo:103: 00000100:00100000:2.0:1789049322.189083:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000009e1ca964 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7ef694ec-1ea0-4f02-800c-d1279b4fdf12+11:5831:x1875954110565120:12345-0@lo:253: Request processed in 51153us (51587us total) trans 0 rc 0/0 00000100:00100000:2.0:1789049322.189099:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1789049322.189183:0:5831:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000c5627cab pname:cluuid:pid:xid:nid:opc:job mount.lustre:7ef694ec-1ea0-4f02-800c-d1279b4fdf12:5831:1875954110565120:0@lo:253: 10000000:01000000:3.0:1789049322.189198:0:5831:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:3.0:1789049322.189201:0:5831:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1789049322.189203:0:5831:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1789049322.189204:0:5831:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789049322.189205:0:5831:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1789049322.189206:0:5831:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789049322.189208:0:5831:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789049322.189209:0:5831:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1789049322.189210:0:5831:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1789049322.189211:0:5831:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1789049322.189212:0:5831:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1789049322.189214:0:5831:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789049322.189215:0:5831:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:3.0:1789049322.189292:0:5831:0:(tgt_mount.c:2694:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:2.0:1789049322.196460:0:5831:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/8/4) registered 00080000:10000000:2.0:1789049322.197094:0:5831:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:2.0:1789049322.197520:0:5831:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/8/4) registered 00080000:10000000:2.0:1789049322.198204:0:5831:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:2.0:1789049322.198625:0:5831:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/8/4) registered 00080000:10000000:2.0:1789049322.199015:0:5831:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00080000:10000000:2.0:1789049322.199957:0:5831:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/8/4) registered 00080000:10000000:2.0:1789049322.200179:0:5831:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8/1) registered 00080000:10000000:2.0:1789049322.200469:0:5831:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/8/4) registered 00080000:10000000:2.0:1789049322.200736:0:5831:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8/1) registered 00080000:10000000:2.0:1789049322.201298:0:5831:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xf:0x0] (8/8/4) registered 00080000:10000000:2.0:1789049322.201787:0:5831:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8/1) registered 00010000:00010000:2.0:1789049322.203045:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 40000000:02000000:3.0:1789049322.247946:0:5831:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt 00000040:01000000:0.0:1789049322.291550:0:5831:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000040:01000000:0.0:1789049322.291938:0:5884:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000020:00080000:2.0:1789049322.297980:0:5883:0:(update_trans.c:1538:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 0 00000020:00080000:2.0:1789049322.297987:0:5883:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 0 00000040:01000000:3.0:1789049322.299615:0:5831:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:3.0:1789049322.300215:0:5831:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:3.0:1789049322.300622:0:5831:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:3.0:1789049322.300630:0:5831:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:3.0:1789049322.300987:0:5831:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1789049322.303788:0:5831:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:3.0:1789049322.304382:0:5831:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:3.0:1789049322.304416:0:5831:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00000040:00080000:3.0:1789049322.304698:0:5831:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00080000:10000000:3.0:1789049322.307196:0:5831:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x11:0x0] (8/8/4) registered 00100000:10000000:3.0:1789049322.310122:0:5831:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_00: rc = 0 00100000:10000000:3.0:1789049322.310283:0:5831:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_01: rc = 0 00100000:10000000:3.0:1789049322.310447:0:5831:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_02: rc = 0 00100000:10000000:3.0:1789049322.310629:0:5831:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_03: rc = 0 00100000:10000000:3.0:1789049322.310980:0:5831:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_04: rc = 0 00100000:10000000:3.0:1789049322.311141:0:5831:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_05: rc = 0 00100000:10000000:3.0:1789049322.311415:0:5831:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_06: rc = 0 00100000:10000000:3.0:1789049322.311565:0:5831:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_07: rc = 0 00100000:10000000:3.0:1789049322.311786:0:5831:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_08: rc = 0 00100000:10000000:3.0:1789049322.312392:0:5831:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_09: rc = 0 00100000:10000000:3.0:1789049322.312577:0:5831:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_10: rc = 0 00100000:10000000:3.0:1789049322.313019:0:5831:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_11: rc = 0 00100000:10000000:3.0:1789049322.313210:0:5831:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_12: rc = 0 00100000:10000000:3.0:1789049322.313380:0:5831:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_13: rc = 0 00100000:10000000:3.0:1789049322.313535:0:5831:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_14: rc = 0 00100000:10000000:3.0:1789049322.313698:0:5831:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_15: rc = 0 00100000:10000000:3.0:1789049322.314049:0:5831:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_00: rc = 0 00100000:10000000:3.0:1789049322.314205:0:5831:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_01: rc = 0 00100000:10000000:3.0:1789049322.314390:0:5831:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_02: rc = 0 00100000:10000000:3.0:1789049322.314551:0:5831:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_03: rc = 0 00100000:10000000:3.0:1789049322.314721:0:5831:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_04: rc = 0 00100000:10000000:3.0:1789049322.315835:0:5831:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_05: rc = 0 00100000:10000000:3.0:1789049322.316036:0:5831:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_06: rc = 0 00100000:10000000:3.0:1789049322.316343:0:5831:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_07: rc = 0 00100000:10000000:3.0:1789049322.316502:0:5831:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_08: rc = 0 00100000:10000000:1.0:1789049322.317603:0:5831:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_09: rc = 0 00100000:10000000:1.0:1789049322.317996:0:5831:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_10: rc = 0 00100000:10000000:1.0:1789049322.318320:0:5831:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_11: rc = 0 00100000:10000000:1.0:1789049322.318470:0:5831:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_12: rc = 0 00100000:10000000:1.0:1789049322.318607:0:5831:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_13: rc = 0 00100000:10000000:2.0:1789049322.320239:0:5831:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_14: rc = 0 00100000:10000000:2.0:1789049322.320459:0:5831:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_15: rc = 0 00000001:00000004:2.0:1789049322.321291:0:5831:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967296 00000040:00080000:0.0:1789049322.348943:0:5884:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000001:00080000:0.0:1789049322.454614:0:5831:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:0.0:1789049322.454917:0:5831:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffac7501c7f988 00100000:10000000:0.0:1789049322.454926:0:5831:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000020:01000004:1.0:1789049322.455694:0:5831:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:1.0:1789049322.455710:0:5831:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.206.126@tcp: cl_mgc_mutex unlock 00000020:01000004:1.0:1789049322.455726:0:5831:0:(tgt_mount.c:2460:server_fill_super_common()) Server sb, dev=46 00000080:00000004:1.0:1789049322.455768:0:5831:0:(super25.c:182:lustre_fill_super()) lustre-mdt1/mdt1: Mount complete 00000040:00080000:3.0:1789049322.508280:0:5884:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00000004:00080000:3.0:1789049322.508355:0:5884:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000004:00080000:3.0:1789049322.508360:0:5884:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00010000:00010000:0.0:1789049323.227697:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789049324.254019:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789049325.275938:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789049326.301369:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1789049327.254698:0:6127:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg626-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:0.0:1789049327.325785:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1789049327.519293:0:494:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:2.0:1789049327.519303:0:494:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1789049327.519306:0:494:0:(import.c:65:import_set_state_nolock()) 0000000095683905 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1789049327.519322:0:494:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import 0000000095683905 using connection 192.168.206.126@tcp/0@lo 00000100:00100000:2.0:1789049327.519346:0:494:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@000000006fcc2c55 x1875954110565632/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1789049327.519379:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000006fcc2c55 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3307:1875954110565632:0@lo:38: 00000100:00100000:2.0:1789049327.519442:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789049327.519477:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954110565632 00000100:00100000:0.0:1789049327.519491:0:5852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954110565632 00000100:00100000:0.0:1789049327.519531:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1789049327.519537:0:5852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000005389878 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3307:x1875954110565632:12345-0@lo:38: 00010000:00080000:0.0:1789049327.519563:0:5852:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo t0 exp 0000000000000000 cur 153 last 0 00000020:00000080:0.0:1789049327.519598:0:5852:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0xf4f48ce5e1bbeb31 00000004:00100000:0.0:1789049327.519641:0:5852:0:(mdt_handler.c:7315:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00100000:3.0:1789049327.519705:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000057d35a22 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7ef694ec-1ea0-4f02-800c-d1279b4fdf12:3310:1875954110565504:0@lo:400: 00000100:00100000:3.0:1789049327.519744:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1789049327.519767:0:5852:0:(import.c:65:import_set_state_nolock()) 00000000fa67a45f : changing import state from RECOVER to FULL 00000100:00100000:3.0:1789049327.519806:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954110565504 00000100:00100000:3.0:1789049327.519811:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954110565504 00000100:00100000:0.0:1789049327.519815:0:5852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000005389878 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1875954110565632:12345-0@lo:38: Request processed in 278us (373us total) trans 0 rc 0/0 00000100:00100000:0.0:1789049327.519822:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1789049327.519836:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1789049327.519870:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000c924d6e1 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7ef694ec-1ea0-4f02-800c-d1279b4fdf12+11:3310:x1875954110565504:12345-0@lo:400: 00000100:00100000:3.0:1789049327.519902:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000c924d6e1 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7ef694ec-1ea0-4f02-800c-d1279b4fdf12+11:3310:x1875954110565504:12345-0@lo:400: Request processed in 61us (159us total) trans 0 rc 0/0 00000100:00100000:3.0:1789049327.519909:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1789049327.520084:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000057d35a22 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7ef694ec-1ea0-4f02-800c-d1279b4fdf12:3310:1875954110565504:0@lo:400: 00010000:00080000:3.0:1789049327.520979:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@000000006fcc2c55 x1875954110565632/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1789049337 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1789049327.520996:0:3307:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 1 00000100:00080000:3.0:1789049327.521004:0:3307:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:3.0:1789049327.521015:0:3307:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:3.0:1789049327.521018:0:3307:0:(import.c:65:import_set_state_nolock()) 0000000095683905 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1789049327.521023:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000006fcc2c55 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3307:1875954110565632:0@lo:38: 10000000:01000000:3.0:1789049328.027124:0:5848:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1789049328.027132:0:5848:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8cb8e01c3000 from 3 10000000:01000000:3.0:1789049328.027136:0:5848:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1789049328.027175:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.126@tcp lock: 000000005ee8c7aa/0xf4f48ce5e1bbeb38 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049328.027186:0:5848:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.126@tcp lock: 000000005ee8c7aa/0xf4f48ce5e1bbeb38 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049328.027196:0:5848:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.126@tcp lock: 000000005ee8c7aa/0xf4f48ce5e1bbeb38 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789049328.027217:0:5848:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000c5627cab pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7ef694ec-1ea0-4f02-800c-d1279b4fdf12:5848:1875954110565760:0@lo:101: 00000100:00100000:3.0:1789049328.027283:0:5848:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789049328.027346:0:5848:0:(client.c:2716:ptlrpc_set_wait()) set 000000005c4c3c3f going to sleep for 11 seconds 00000100:00100000:1.0:1789049328.027531:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954110565760 00000100:00100000:1.0:1789049328.027540:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954110565760 00000100:00100000:1.0:1789049328.027588:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1789049328.027595:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000001f308ece pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7ef694ec-1ea0-4f02-800c-d1279b4fdf12+11:5848:x1875954110565760:12345-0@lo:101: 00010000:00010000:1.0:1789049328.027608:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789049328.027621:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000043264bb2/0xf4f48ce5e1bbeb3f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xf4f48ce5e1bbeb38 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049328.027641:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000043264bb2/0xf4f48ce5e1bbeb3f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf4f48ce5e1bbeb38 expref: 12 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049328.027651:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000043264bb2/0xf4f48ce5e1bbeb3f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf4f48ce5e1bbeb38 expref: 12 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049328.027659:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000043264bb2, rc 0) 00000100:00100000:1.0:1789049328.027716:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000001f308ece pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7ef694ec-1ea0-4f02-800c-d1279b4fdf12+12:5848:x1875954110565760:12345-0@lo:101: Request processed in 121us (434us total) trans 0 rc 0/0 00000100:00100000:1.0:1789049328.027724:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1789049328.027799:0:5848:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000c5627cab pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7ef694ec-1ea0-4f02-800c-d1279b4fdf12:5848:1875954110565760:0@lo:101: 00010000:00010000:0.0:1789049328.027812:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.126@tcp lock: 000000005ee8c7aa/0xf4f48ce5e1bbeb38 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf4f48ce5e1bbeb3f expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049328.027821:0:5848:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.126@tcp lock: 000000005ee8c7aa/0xf4f48ce5e1bbeb38 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xf4f48ce5e1bbeb3f expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789049328.027902:0:5848:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000004b4604e2 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7ef694ec-1ea0-4f02-800c-d1279b4fdf12:5848:1875954110565888:0@lo:256: 00000100:00100000:0.0:1789049328.027935:0:5848:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789049328.027957:0:5848:0:(client.c:2716:ptlrpc_set_wait()) set 000000009e3a38a5 going to sleep for 11 seconds 00000100:00100000:1.0:1789049328.028219:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954110565888 00000100:00100000:1.0:1789049328.028224:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954110565888 00000100:00100000:1.0:1789049328.028256:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1789049328.028263:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000002a410140 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7ef694ec-1ea0-4f02-800c-d1279b4fdf12+12:5848:x1875954110565888:12345-0@lo:256: 20000000:01000000:1.0:1789049328.028275:0:5844:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1789049328.028290:0:5844:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1789049328.028293:0:5844:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 3 00000100:00100000:1.0:1789049328.028375:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000002a410140 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7ef694ec-1ea0-4f02-800c-d1279b4fdf12+12:5848:x1875954110565888:12345-0@lo:256: Request processed in 112us (439us total) trans 0 rc 0/0 00000100:00100000:1.0:1789049328.028383:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1789049328.028599:0:5848:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000004b4604e2 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7ef694ec-1ea0-4f02-800c-d1279b4fdf12:5848:1875954110565888:0@lo:256: 10000000:01000000:0.0:1789049328.028644:0:5848:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.126@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1789049328.028651:0:5848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.126@tcp lock: 000000005ee8c7aa/0xf4f48ce5e1bbeb38 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf4f48ce5e1bbeb3f expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049328.028659:0:5848:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.126@tcp lock: 000000005ee8c7aa/0xf4f48ce5e1bbeb38 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf4f48ce5e1bbeb3f expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049328.347022:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789049329.373531:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789049330.395612:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789049331.420898:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1789049332.040682:0:6329:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffd3a3f5920 20000000:00000080:3.0:1789049332.040700:0:6329:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff8cb8f798a800 uarg=0000000000000000 20000000:01000000:3.0:1789049332.040735:0:6329:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='debug_raw_pointers=Y' 20000000:01000000:3.0:1789049332.040741:0:6329:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'debug_raw_pointers=Y' 20000000:01000000:3.0:1789049332.040746:0:6329:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/debug_raw_pointers=Y del=0 00000040:00080000:3.0:1789049332.041207:0:6329:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:02000000:3.0:1789049332.041218:0:6329:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Modifying parameter general.debug_raw_pointers=Y in log params 00000040:00080000:2.0:1789049332.048751:0:6329:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1789049332.049124:0:6329:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:2.0:1789049332.049182:0:6329:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 112 off8528 00000040:00080000:2.0:1789049332.049232:0:6329:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 224 off8752 10000000:01000000:2.0:1789049332.049256:0:6329:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:2.0:1789049332.049274:0:6329:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 00000000965d1f06/0xf4f48ce5e1bbeb46 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049332.049293:0:6329:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 00000000a3f94b78/0xf4f48ce5e1bbeb07 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf4f48ce5e1bbeb00 expref: 11 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049332.049301:0:6329:0:(ldlm_resource.c:1751:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 00000000965d1f06/0xf4f48ce5e1bbeb46 lrc: 4/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049332.049339:0:6329:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 00000000a3f94b78/0xf4f48ce5e1bbeb07 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf4f48ce5e1bbeb00 expref: 11 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049332.049358:0:6329:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 00000000a3f94b78/0xf4f48ce5e1bbeb07 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf4f48ce5e1bbeb00 expref: 11 pid: 5844 timeout: 308 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789049332.049370:0:6329:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000006cb1f0e8 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:6329:1875954110566016:0@lo:104: 00000100:00100000:2.0:1789049332.049831:0:6329:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789049332.049910:0:6329:0:(client.c:2716:ptlrpc_set_wait()) set 00000000d8f25c37 going to sleep for 11 seconds 00000100:00100000:0.0:1789049332.049923:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954110566016 00000100:00100000:0.0:1789049332.049931:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954110566016 00000100:00100000:0.0:1789049332.049986:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1789049332.049993:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000093c7e096 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:7ef694ec-1ea0-4f02-800c-d1279b4fdf12+3:6329:x1875954110566016:12345-0@lo:104: 00010000:00010000:0.0:1789049332.050006:0:5834:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.126@tcp lock: 0000000006902404/0xf4f48ce5e1bbeb00 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xf4f48ce5e1bbeb07 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049332.050100:0:5834:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1789049332.050106:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000093c7e096 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:7ef694ec-1ea0-4f02-800c-d1279b4fdf12+3:6329:x1875954110566016:12345-0@lo:104: Request processed in 114us (347us total) trans 0 rc 0/0 00000100:00100000:0.0:1789049332.050112:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1789049332.050296:0:6329:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000006cb1f0e8 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:6329:1875954110566016:0@lo:104: 00010000:00010000:1.0:1789049332.050315:0:6329:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 00000000965d1f06/0xf4f48ce5e1bbeb46 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049332.050353:0:5839:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789049332.050359:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.126@tcp lock: 0000000006902404/0xf4f48ce5e1bbeb00 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xf4f48ce5e1bbeb07 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049332.050380:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 0000000006902404 already unused, calling callback (00000000e4237f11) 10000000:00010000:3.0:1789049332.050383:0:5839:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.126@tcp lock: 0000000006902404/0xf4f48ce5e1bbeb00 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xf4f48ce5e1bbeb07 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049332.050390:0:5839:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.126@tcp lock: 0000000006902404/0xf4f48ce5e1bbeb00 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xf4f48ce5e1bbeb07 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789049332.050396:0:5839:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.126@tcp lock: 0000000006902404/0xf4f48ce5e1bbeb00 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xf4f48ce5e1bbeb07 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789049332.050402:0:5839:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1789049332.050477:0:5839:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.126@tcp lock: 0000000006902404/0xf4f48ce5e1bbeb00 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf4f48ce5e1bbeb07 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049332.050485:0:5839:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789049332.050512:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.126@tcp lock: 0000000006902404/0xf4f48ce5e1bbeb00 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf4f48ce5e1bbeb07 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049332.050518:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.126@tcp lock: 0000000006902404/0xf4f48ce5e1bbeb00 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf4f48ce5e1bbeb07 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049332.050536:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789049332.050538:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789049332.050539:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789049332.050578:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000efc213ac pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:7ef694ec-1ea0-4f02-800c-d1279b4fdf12:3311:1875954110566144:0@lo:103: 00000100:00100000:1.0:1789049332.050615:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789049332.050728:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954110566144 00000100:00100000:3.0:1789049332.050734:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954110566144 00010000:00010000:3.0:1789049332.050752:0:5836:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 00000000a3f94b78/0xf4f48ce5e1bbeb07 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf4f48ce5e1bbeb00 expref: 12 pid: 5844 timeout: 308 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789049332.050780:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1789049332.050804:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000005d0b2b7b pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7ef694ec-1ea0-4f02-800c-d1279b4fdf12+12:3311:x1875954110566144:12345-0@lo:103: 00010000:00010000:3.0:1789049332.050815:0:5836:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789049332.050829:0:5836:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 00000000a3f94b78/0xf4f48ce5e1bbeb07 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf4f48ce5e1bbeb00 expref: 12 pid: 5844 timeout: 308 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049332.050839:0:5836:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 00000000a3f94b78/0xf4f48ce5e1bbeb07 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf4f48ce5e1bbeb00 expref: 12 pid: 5844 timeout: 308 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049332.050872:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000a3f94b78/0xf4f48ce5e1bbeb07 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf4f48ce5e1bbeb00 expref: 12 pid: 5844 timeout: 308 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049332.050884:0:5836:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 00000000965d1f06/0xf4f48ce5e1bbeb46 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049332.050890:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000965d1f06/0xf4f48ce5e1bbeb46 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049332.050902:0:5836:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000965d1f06/0xf4f48ce5e1bbeb46 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049332.050907:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000965d1f06/0xf4f48ce5e1bbeb46 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049332.050912:0:5836:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 00000000965d1f06/0xf4f48ce5e1bbeb46 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049332.050917:0:5836:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 00000000965d1f06/0xf4f48ce5e1bbeb46 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049332.050922:0:5836:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000965d1f06 already unused, calling callback (0000000002254c5f) 00010000:00010000:3.0:1789049332.050926:0:5836:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 00000000965d1f06/0xf4f48ce5e1bbeb46 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049332.050938:0:5836:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 00000000965d1f06/0xf4f48ce5e1bbeb46 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049332.050958:0:5836:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 00000000965d1f06/0xf4f48ce5e1bbeb46 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049332.050968:0:5836:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789049332.050999:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000005d0b2b7b pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7ef694ec-1ea0-4f02-800c-d1279b4fdf12+11:3311:x1875954110566144:12345-0@lo:103: Request processed in 197us (384us total) trans 0 rc 0/0 00000100:00100000:3.0:1789049332.051006:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1789049332.051032:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000efc213ac pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:7ef694ec-1ea0-4f02-800c-d1279b4fdf12:3311:1875954110566144:0@lo:103: 00010000:00010000:2.0:1789049332.051092:0:6329:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 00000000965d1f06/0xf4f48ce5e1bbeb46 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049332.051100:0:6329:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 00000000965d1f06/0xf4f48ce5e1bbeb46 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049332.051105:0:6329:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000965d1f06/0xf4f48ce5e1bbeb46 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049332.443126:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789049332.640763:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000004b4604e2 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3308:1875954110566272:0@lo:400: 00000100:00100000:3.0:1789049332.641065:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789049332.641107:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954110566272 00000100:00100000:1.0:1789049332.641115:0:5851:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954110566272 00000100:00100000:1.0:1789049332.641162:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1789049332.641170:0:5851:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000efc213ac pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1875954110566272:12345-0@lo:400: 00000100:00100000:1.0:1789049332.641220:0:5851:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000efc213ac pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1875954110566272:12345-0@lo:400: Request processed in 52us (157us total) trans 0 rc 0/0 00000100:00100000:1.0:1789049332.641227:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:3.0:1789049332.641358:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@000000004b4604e2 x1875954110566272/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789049348 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789049332.641372:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000004b4604e2 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3308:1875954110566272:0@lo:400: 10000000:01000000:0.0:1789049333.467680:0:5848:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1789049333.467688:0:5848:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8cb8e01c3000 from 1 10000000:01000000:0.0:1789049333.467693:0:5848:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1789049333.467739:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.126@tcp lock: 0000000052d006a1/0xf4f48ce5e1bbeb4d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049333.467751:0:5848:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.126@tcp lock: 0000000052d006a1/0xf4f48ce5e1bbeb4d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049333.467761:0:5848:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.126@tcp lock: 0000000052d006a1/0xf4f48ce5e1bbeb4d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789049333.467782:0:5848:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000dc83fb58 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7ef694ec-1ea0-4f02-800c-d1279b4fdf12:5848:1875954110566400:0@lo:101: 00000100:00100000:0.0:1789049333.467915:0:5848:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789049333.467968:0:5848:0:(client.c:2716:ptlrpc_set_wait()) set 000000009198ecec going to sleep for 11 seconds 00000100:00100000:1.0:1789049333.468048:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954110566400 00000100:00100000:1.0:1789049333.468057:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954110566400 00000100:00100000:1.0:1789049333.468117:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1789049333.468124:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000039c2abff pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7ef694ec-1ea0-4f02-800c-d1279b4fdf12+11:5848:x1875954110566400:12345-0@lo:101: 00010000:00010000:1.0:1789049333.468137:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789049333.468155:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000275129e1/0xf4f48ce5e1bbeb54 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xf4f48ce5e1bbeb4d expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049333.468193:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000275129e1/0xf4f48ce5e1bbeb54 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf4f48ce5e1bbeb4d expref: 12 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049333.468207:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000275129e1/0xf4f48ce5e1bbeb54 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf4f48ce5e1bbeb4d expref: 12 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049333.468217:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000275129e1, rc 0) 00000100:00100000:1.0:1789049333.468266:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000039c2abff pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7ef694ec-1ea0-4f02-800c-d1279b4fdf12+12:5848:x1875954110566400:12345-0@lo:101: Request processed in 142us (353us total) trans 0 rc 0/0 00000100:00100000:1.0:1789049333.468273:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1789049333.468567:0:5848:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000dc83fb58 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7ef694ec-1ea0-4f02-800c-d1279b4fdf12:5848:1875954110566400:0@lo:101: 00010000:00010000:2.0:1789049333.468592:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.126@tcp lock: 0000000052d006a1/0xf4f48ce5e1bbeb4d lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf4f48ce5e1bbeb54 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049333.468620:0:5848:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.126@tcp lock: 0000000052d006a1/0xf4f48ce5e1bbeb4d lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xf4f48ce5e1bbeb54 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789049333.468687:0:5848:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000022d8c147 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7ef694ec-1ea0-4f02-800c-d1279b4fdf12:5848:1875954110566528:0@lo:501: 00000100:00100000:2.0:1789049333.468723:0:5848:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789049333.468759:0:5848:0:(client.c:2716:ptlrpc_set_wait()) set 00000000a9fcdffb going to sleep for 11 seconds 00000100:00100000:0.0:1789049333.468897:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954110566528 00000100:00100000:0.0:1789049333.468902:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954110566528 00000100:00100000:0.0:1789049333.468938:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1789049333.468944:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000039617521 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7ef694ec-1ea0-4f02-800c-d1279b4fdf12+12:5848:x1875954110566528:12345-0@lo:501: 00000100:00100000:0.0:1789049333.469219:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000039617521 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7ef694ec-1ea0-4f02-800c-d1279b4fdf12+12:5848:x1875954110566528:12345-0@lo:501: Request processed in 271us (492us total) trans 0 rc 0/0 00000100:00100000:0.0:1789049333.469226:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1789049333.469900:0:5848:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000022d8c147 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7ef694ec-1ea0-4f02-800c-d1279b4fdf12:5848:1875954110566528:0@lo:501: 00000100:00100000:2.0:1789049333.469947:0:5848:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000022d8c147 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7ef694ec-1ea0-4f02-800c-d1279b4fdf12:5848:1875954110566656:0@lo:503: 00000100:00100000:2.0:1789049333.470003:0:5848:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789049333.470030:0:5848:0:(client.c:2716:ptlrpc_set_wait()) set 00000000a9fcdffb going to sleep for 11 seconds 00000100:00100000:0.0:1789049333.470128:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954110566656 00000100:00100000:0.0:1789049333.470134:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954110566656 00000100:00100000:0.0:1789049333.470186:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1789049333.470195:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000031550691 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7ef694ec-1ea0-4f02-800c-d1279b4fdf12+12:5848:x1875954110566656:12345-0@lo:503: 00000100:00100000:0.0:1789049333.470696:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000031550691 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7ef694ec-1ea0-4f02-800c-d1279b4fdf12+12:5848:x1875954110566656:12345-0@lo:503: Request processed in 499us (695us total) trans 0 rc 0/0 00000100:00100000:0.0:1789049333.470707:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1789049333.472497:0:5848:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000022d8c147 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7ef694ec-1ea0-4f02-800c-d1279b4fdf12:5848:1875954110566656:0@lo:503: 00010000:00010000:0.0:1789049333.474355:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789049333.474466:0:6390:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000678c9b69 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7ef694ec-1ea0-4f02-800c-d1279b4fdf12:6390:1875954110566784:0@lo:502: 00000100:00100000:0.0:1789049333.474546:0:6390:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789049333.474760:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954110566784 00000100:00100000:1.0:1789049333.474768:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954110566784 00000100:00100000:1.0:1789049333.474821:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1789049333.474830:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000014f424b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7ef694ec-1ea0-4f02-800c-d1279b4fdf12+12:6390:x1875954110566784:12345-0@lo:502: 00000100:00100000:1.0:1789049333.475046:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000014f424b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7ef694ec-1ea0-4f02-800c-d1279b4fdf12+12:6390:x1875954110566784:12345-0@lo:502: Request processed in 217us (500us total) trans 0 rc 0/0 00000100:00100000:1.0:1789049333.475054:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1789049333.475354:0:6390:0:(client.c:2716:ptlrpc_set_wait()) set 000000009198ecec going to sleep for 11 seconds 00000100:00100000:0.0:1789049333.475376:0:6390:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000678c9b69 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7ef694ec-1ea0-4f02-800c-d1279b4fdf12:6390:1875954110566784:0@lo:502: 00000020:01000000:0.0:1789049333.475403:0:6390:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789049333.475411:0:6390:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789049333.475413:0:6390:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:0.0:1789049333.475421:0:6390:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8cb8e01c3000 00000020:00000080:0.0:1789049333.475423:0:6390:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:0.0:1789049333.475462:0:6390:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb8fc998e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7ef694ec-1ea0-4f02-800c-d1279b4fdf12:6390:1875954110566912:0@lo:502: 00000100:00100000:0.0:1789049333.475508:0:6390:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789049333.475533:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954110566912 00000100:00100000:0.0:1789049333.475537:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954110566912 00000100:00100000:0.0:1789049333.477318:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1789049333.477331:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8c6295050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7ef694ec-1ea0-4f02-800c-d1279b4fdf12+12:6390:x1875954110566912:12345-0@lo:502: 00000100:00100000:0.0:1789049333.477560:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8c6295050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7ef694ec-1ea0-4f02-800c-d1279b4fdf12+12:6390:x1875954110566912:12345-0@lo:502: Request processed in 232us (2051us total) trans 0 rc 0/0 00000100:00100000:0.0:1789049333.477568:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1789049333.479248:0:6390:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cb8d0545840 going to sleep for 11 seconds 00000100:00100000:0.0:1789049333.479280:0:6390:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb8fc998e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7ef694ec-1ea0-4f02-800c-d1279b4fdf12:6390:1875954110566912:0@lo:502: 00000020:01000000:0.0:1789049333.479316:0:6390:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789049333.479323:0:6390:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789049333.479325:0:6390:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:0.0:1789049333.479332:0:6390:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 00000020:01000000:2.0:1789049333.479550:0:5848:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:2.0:1789049333.479568:0:5848:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.126@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1789049333.479589:0:5848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.126@tcp lock: ffff8cb8c0031800/0xf4f48ce5e1bbeb4d lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf4f48ce5e1bbeb54 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049333.479601:0:5848:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.126@tcp lock: ffff8cb8c0031800/0xf4f48ce5e1bbeb4d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf4f48ce5e1bbeb54 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049334.501152:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789049335.515811:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789049336.539296:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789049337.563131:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789049337.755162:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789049337.755237:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb8f73c4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7ef694ec-1ea0-4f02-800c-d1279b4fdf12:3308:1875954110567040:0@lo:400: 00000100:00100000:3.0:1789049337.755310:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789049337.755365:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb8f73c4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3310:1875954110567168:0@lo:400: 00000100:00100000:3.0:1789049337.755393:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789049337.755426:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954110567040 00000100:00100000:3.0:1789049337.755433:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954110567040 00000100:00100000:3.0:1789049337.755477:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1789049337.755486:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8c6297850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7ef694ec-1ea0-4f02-800c-d1279b4fdf12+12:3308:x1875954110567040:12345-0@lo:400: 00000100:00100000:3.0:1789049337.755553:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8c6297850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7ef694ec-1ea0-4f02-800c-d1279b4fdf12+12:3308:x1875954110567040:12345-0@lo:400: Request processed in 67us (242us total) trans 0 rc 0/0 00000100:00100000:3.0:1789049337.755561:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1789049337.755818:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954110567168 00000100:00100000:0.0:1789049337.755823:0:5850:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954110567168 00000100:00100000:2.0:1789049337.755986:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb8f73c4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7ef694ec-1ea0-4f02-800c-d1279b4fdf12:3308:1875954110567040:0@lo:400: 00000100:00100000:0.0:1789049337.756008:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1789049337.756018:0:5850:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8f73c5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1875954110567168:12345-0@lo:400: 00000100:00100000:0.0:1789049337.756068:0:5850:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8f73c5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1875954110567168:12345-0@lo:400: Request processed in 52us (674us total) trans 0 rc 0/0 00000100:00100000:0.0:1789049337.756074:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:2.0:1789049337.756210:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff8cb8f73c4700 x1875954110567168/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789049353 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789049337.756223:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb8f73c4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3310:1875954110567168:0@lo:400: 00010000:00010000:3.0:1789049338.589459:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:3.0:1789049338.916051:0:6699:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:3.0:1789049338.916055:0:6699:0:(obd_mount.c:926:lmd_print()) device: lustre-ost1/ost1 00000080:01200004:3.0:1789049338.916474:0:6699:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff8cb8d1c83000 00000020:01000004:3.0:1789049338.916489:0:6699:0:(tgt_mount.c:2502:osd_start()) Attempting to start lustre-OST0000, type=osd-zfs, lsifl=200062, mountfl=0 00000020:01000004:3.0:1789049338.916572:0:6699:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-zfs) 00000020:00000080:3.0:1789049338.916587:0:6699:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (ffff8cb8d6b78000) 00000020:00000080:3.0:1789049338.916603:0:6699:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osd-zfs with refcount 2 00100000:10000000:1.0:1789049338.948713:0:6699:0:(scrub.c:230:scrub_file_store()) lustre-OST0000: store scrub file: rc = 0 00100000:10000000:1.0:1789049338.949093:0:6699:0:(scrub.c:230:scrub_file_store()) lustre-OST0000: store scrub file: rc = 0 00100000:10000000:1.0:1789049338.969588:0:6699:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x1017:0x0] => 0 (CONFIGS): rc = 1 00100000:10000000:1.0:1789049338.976198:0:6699:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:1.0:1789049338.976237:0:6699:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x3:0x0] => 0 (fld): rc = 1 00100000:10000000:1.0:1789049338.976308:0:6699:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:1.0:1789049338.976335:0:6699:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00000020:00000080:1.0:1789049338.976663:0:6699:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:1.0:1789049338.976673:0:6699:0:(osd_handler.c:1574:osd_obd_connect()) connect #0 00000020:00000080:1.0:1789049338.976683:0:6699:0:(genops.c:1384:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0xf4f48ce5e1bbeb62 00000020:01000004:1.0:1789049338.976690:0:6699:0:(tgt_mount.c:2587:server_fill_super()) Found service lustre-OST0000 on device lustre-ost1/ost1 00000020:01000004:1.0:1789049338.976709:0:6699:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.206.126@tcp:Set MGC reconnect 1 10000000:01000000:1.0:1789049338.976712:0:6699:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.206.126@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:1.0:1789049338.976717:0:6699:0:(tgt_mount.c:1808:server_start_targets()) starting target lustre-OST0000 00000020:01000004:1.0:1789049338.976721:0:6699:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD OSS (typ=ost) 00000020:00000080:1.0:1789049338.976741:0:6699:0:(genops.c:413:class_newdev()) Allocate new device OSS (ffff8cb8fcbc19c0) 00000020:00000080:1.0:1789049338.976752:0:6699:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type ost with refcount 2 00000100:00100000:3.0:1789049338.988603:0:6699:0:(service.c:155:ptlrpc_grow_req_bufs()) ost: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1789049338.988773:0:6699:0:(service.c:3467:ptlrpc_start_thread()) ost[0] started 0 min 3 max 116 00000100:00100000:3.0:1789049338.988780:0:6699:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost00_000' 00000100:00100000:2.0:1789049338.991390:0:6699:0:(service.c:3467:ptlrpc_start_thread()) ost[0] started 1 min 3 max 116 00000100:00100000:2.0:1789049338.991407:0:6699:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost00_001' 00000100:00100000:2.0:1789049338.991792:0:6699:0:(service.c:3467:ptlrpc_start_thread()) ost[0] started 2 min 3 max 116 00000100:00100000:2.0:1789049338.991799:0:6699:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost00_002' 00000100:00100000:2.0:1789049338.997268:0:6699:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_create: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1789049338.997460:0:6699:0:(service.c:3467:ptlrpc_start_thread()) ost_create[0] started 0 min 2 max 16 00000100:00100000:2.0:1789049338.997467:0:6699:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_create00_000' 00000100:00100000:2.0:1789049339.004000:0:6699:0:(service.c:3467:ptlrpc_start_thread()) ost_create[0] started 1 min 2 max 16 00000100:00100000:2.0:1789049339.004020:0:6699:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_create00_001' 00000100:00100000:3.0:1789049339.043589:0:6699:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1789049339.044106:0:6699:0:(service.c:3467:ptlrpc_start_thread()) ost_io[0] started 0 min 3 max 116 00000100:00100000:3.0:1789049339.044116:0:6699:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_io00_000' 00000100:00100000:1.0:1789049339.046272:0:6699:0:(service.c:3467:ptlrpc_start_thread()) ost_io[0] started 1 min 3 max 116 00000100:00100000:1.0:1789049339.046285:0:6699:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_io00_001' 00000100:00100000:1.0:1789049339.048197:0:6699:0:(service.c:3467:ptlrpc_start_thread()) ost_io[0] started 2 min 3 max 116 00000100:00100000:0.0:1789049339.048290:0:6699:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_io00_002' 00000100:00100000:0.0:1789049339.051278:0:6699:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_seq: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1789049339.051466:0:6699:0:(service.c:3467:ptlrpc_start_thread()) ost_seq[0] started 0 min 2 max 16 00000100:00100000:0.0:1789049339.051473:0:6699:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_seq00_000' 00000100:00100000:2.0:1789049339.052407:0:6699:0:(service.c:3467:ptlrpc_start_thread()) ost_seq[0] started 1 min 2 max 16 00000100:00100000:2.0:1789049339.052416:0:6699:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_seq00_001' 00000100:00100000:2.0:1789049339.139687:0:6699:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1789049339.143036:0:6699:0:(service.c:3467:ptlrpc_start_thread()) ost_out[0] started 0 min 2 max 16 00000100:00100000:3.0:1789049339.143045:0:6699:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_out00_000' 00000100:00100000:3.0:1789049339.146907:0:6699:0:(service.c:3467:ptlrpc_start_thread()) ost_out[0] started 1 min 2 max 16 00000100:00100000:3.0:1789049339.146925:0:6699:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_out00_001' 00000020:00000080:0.0:1789049339.147382:0:6699:0:(obd_config.c:826:class_setup()) finished setup of obd OSS (uuid OSS_uuid) 00000020:01000004:0.0:1789049339.147407:0:6699:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost1/ost1 10000000:01000000:0.0:1789049339.147413:0:6699:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.206.126@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00000040:01000000:0.0:1789049339.197775:0:6699:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.206.126@tcp ctxt 0 is initialized 00000020:01000004:0.0:1789049339.197823:0:6699:0:(tgt_mount.c:1416:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.206.126@tcp, index=0000, flags=0x20062 00000020:01000004:0.0:1789049339.197827:0:6699:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:0.0:1789049339.197829:0:6699:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1789049339.197830:0:6699:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789049339.197831:0:6699:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1789049339.197832:0:6699:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789049339.197834:0:6699:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789049339.197835:0:6699:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1789049339.197837:0:6699:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1789049339.197838:0:6699:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1789049339.197840:0:6699:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789049339.198103:0:6699:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1789049339.198107:0:6699:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020062 00000020:01000004:0.0:1789049339.198110:0:6699:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1789049339.198111:0:6699:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1789049339.198112:0:6699:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789049339.198114:0:6699:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1789049339.198115:0:6699:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789049339.198116:0:6699:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789049339.198117:0:6699:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1789049339.198119:0:6699:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1789049339.198120:0:6699:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1789049339.198121:0:6699:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789049339.198122:0:6699:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1789049339.198146:0:6699:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:0.0:1789049339.198162:0:6699:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb8fc998e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7ef694ec-1ea0-4f02-800c-d1279b4fdf12:6699:1875954110567296:0@lo:253: 00000100:00100000:0.0:1789049339.198287:0:6699:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789049339.198454:0:6699:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cb8c7802240 going to sleep for 11 seconds 00000100:00100000:2.0:1789049339.198512:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954110567296 00000100:00100000:2.0:1789049339.198526:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954110567296 00000100:00100000:2.0:1789049339.198581:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1789049339.198590:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8c6294850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7ef694ec-1ea0-4f02-800c-d1279b4fdf12+12:6699:x1875954110567296:12345-0@lo:253: 20000000:01000000:2.0:1789049339.198629:0:5843:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:2.0:1789049339.198633:0:5843:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-OST0000, index=0 20000000:01000000:2.0:1789049339.198639:0:5843:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-OST0000 to 0 20000000:01000000:2.0:1789049339.198642:0:5843:0:(mgs_llog.c:3862:mgs_write_log_ost()) writing new ost lustre-OST0000 00000040:00080000:2.0:1789049339.199453:0:5843:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1789049339.201916:0:5843:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 20000000:01000000:2.0:1789049339.201945:0:5843:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000 0xcf001 obdfilter lustre-OST0000_UUID (null) (null) 00000040:00080000:2.0:1789049339.202003:0:5843:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 128 off8544 20000000:01000000:2.0:1789049339.202010:0:5843:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000 0xcf003 dev type f (null) 00000040:00080000:2.0:1789049339.202034:0:5843:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 112 off8656 00000040:00080000:2.0:1789049339.202074:0:5843:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8880 00000040:00080000:0.0:1789049339.208078:0:5843:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 224 off11152 20000000:01000000:1.0:1789049339.208908:0:5843:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.206.126@tcp 20000000:01000000:1.0:1789049339.208911:0:5843:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.206.126@tcp (null) (null) (null) 00000040:00080000:1.0:1789049339.209092:0:5843:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 88 off11240 20000000:01000000:1.0:1789049339.209103:0:5843:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0000 0xcf001 osc lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:1.0:1789049339.209170:0:5843:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 144 off11384 20000000:01000000:1.0:1789049339.209178:0:5843:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0000 0xcf003 lustre-OST0000_UUID 192.168.206.126@tcp (null) (null) 00000040:00080000:1.0:1789049339.209275:0:5843:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 152 off11536 20000000:01000000:1.0:1789049339.209286:0:5843:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:1.0:1789049339.209320:0:5843:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 136 off11672 00000040:00080000:1.0:1789049339.209441:0:5843:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11896 00000040:00080000:1.0:1789049339.211177:0:5843:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].21, 224 off11952 20000000:01000000:1.0:1789049339.211279:0:5843:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.206.126@tcp 20000000:01000000:1.0:1789049339.211282:0:5843:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.206.126@tcp (null) (null) (null) 00000040:00080000:1.0:1789049339.211321:0:5843:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].22, 88 off12040 20000000:01000000:1.0:1789049339.211404:0:5843:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc 0xcf001 osc lustre-clilov_UUID (null) (null) 00000040:00080000:1.0:1789049339.211448:0:5843:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].23, 128 off12168 20000000:01000000:1.0:1789049339.211455:0:5843:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc 0xcf003 lustre-OST0000_UUID 192.168.206.126@tcp (null) (null) 00000040:00080000:1.0:1789049339.211530:0:5843:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].24, 144 off12312 20000000:01000000:1.0:1789049339.211540:0:5843:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:1.0:1789049339.211732:0:5843:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].25, 128 off12440 00000040:00080000:1.0:1789049339.211770:0:5843:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].26, 224 off12664 20000000:01000000:1.0:1789049339.211799:0:5843:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' autodegrade=on ', param: 'sys.timeout=20' 20000000:01000000:1.0:1789049339.211803:0:5843:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:1.0:1789049339.211807:0:5843:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:1.0:1789049339.211819:0:5843:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:1.0:1789049339.211822:0:5843:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:1.0:1789049339.212776:0:5843:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:1.0:1789049339.212791:0:5843:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:2.0:1789049339.214097:0:6715:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 18 marker 9 1->4: lustre sys.timeout 20000000:01000000:2.0:1789049339.214181:0:6715:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 20 marker 9 2->4: lustre sys.timeout 00000040:00080000:2.0:1789049339.214435:0:6715:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 27 count 27 00000040:00080000:1.0:1789049339.215046:0:5843:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].27, 224 off12888 00000040:00080000:1.0:1789049339.215094:0:5843:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].28, 80 off12968 00000040:00080000:1.0:1789049339.215129:0:5843:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].29, 224 off13192 20000000:01000000:1.0:1789049339.215143:0:5843:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:1.0:1789049339.215145:0:5843:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.timeout fl=4 00000040:00080000:2.0:1789049339.215890:0:6716:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 5 count 5 00000040:00080000:1.0:1789049339.216186:0:5843:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 224 off9104 00000040:00080000:1.0:1789049339.216308:0:5843:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 80 off9184 00000040:00080000:1.0:1789049339.216447:0:5843:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9408 20000000:01000000:1.0:1789049339.216461:0:5843:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:1.0:1789049339.216463:0:5843:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:3.0:1789049339.219696:0:6717:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 13 marker 10 1->4: lustre sys.timeout 20000000:01000000:3.0:1789049339.220022:0:6717:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 15 marker 10 2->4: lustre sys.timeout 00000040:00080000:3.0:1789049339.220086:0:6717:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 22 count 22 00000040:00080000:1.0:1789049339.220604:0:5843:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 224 off12120 00000040:00080000:1.0:1789049339.220649:0:5843:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 80 off12200 00000040:00080000:1.0:1789049339.220708:0:5843:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 224 off12424 20000000:01000000:1.0:1789049339.220723:0:5843:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'autodegrade=on' 20000000:01000000:1.0:1789049339.220726:0:5843:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'autodegrade=on' 10000000:01000000:1.0:1789049339.220734:0:5843:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:1.0:1789049339.220755:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8cb8c146d800/0xf4f48ce5e1bbeb70 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049339.220774:0:5843:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8cb8d6714600/0xf4f48ce5e1bbea89 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf4f48ce5e1bbea82 expref: 12 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049339.220805:0:5843:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8cb8d6715c00/0xf4f48ce5e1bbeaa5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf4f48ce5e1bbea9e expref: 12 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049339.220812:0:5843:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8cb8c146d600/0xf4f48ce5e1bbeb15 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf4f48ce5e1bbeb0e expref: 12 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049339.220819:0:5843:0:(ldlm_resource.c:1751:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8cb8c146d800/0xf4f48ce5e1bbeb70 lrc: 6/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049339.221121:0:5843:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8cb8c146d600/0xf4f48ce5e1bbeb15 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf4f48ce5e1bbeb0e expref: 12 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049339.221135:0:5843:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8cb8c146d600/0xf4f48ce5e1bbeb15 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf4f48ce5e1bbeb0e expref: 12 pid: 5843 timeout: 315 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789049339.221149:0:5843:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb8d0ab7480 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5843:1875954110567424:0@lo:104: 00000100:00100000:1.0:1789049339.221278:0:5843:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1789049339.221404:0:5843:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8cb8d6715c00/0xf4f48ce5e1bbeaa5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf4f48ce5e1bbea9e expref: 12 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049339.221413:0:5843:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8cb8d6715c00/0xf4f48ce5e1bbeaa5 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf4f48ce5e1bbea9e expref: 12 pid: 5843 timeout: 315 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789049339.221422:0:5843:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb8d0ab4a80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5843:1875954110567552:0@lo:104: 00000100:00100000:1.0:1789049339.221444:0:5843:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1789049339.221476:0:5843:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8cb8d6714600/0xf4f48ce5e1bbea89 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf4f48ce5e1bbea82 expref: 12 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049339.221484:0:5843:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8cb8d6714600/0xf4f48ce5e1bbea89 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf4f48ce5e1bbea82 expref: 12 pid: 5843 timeout: 315 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789049339.221501:0:5843:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb8d0ab4700 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5843:1875954110567680:0@lo:104: 00000100:00100000:0.0:1789049339.221524:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954110567424 00000100:00100000:0.0:1789049339.221534:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954110567424 00000100:00100000:1.0:1789049339.221542:0:5843:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789049339.221555:0:5843:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cb8fc966e40 going to sleep for 11 seconds 00000100:00100000:0.0:1789049339.221573:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954110567552 00000100:00100000:0.0:1789049339.221577:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954110567552 00000100:00100000:0.0:1789049339.221594:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954110567680 00000100:00100000:0.0:1789049339.221597:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954110567680 00000100:00100000:0.0:1789049339.221611:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1789049339.221621:0:5834:0:(service.c:3467:ptlrpc_start_thread()) ldlm_cbd[0] started 2 min 2 max 56 00000100:00100000:0.0:1789049339.221621:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8d0ab5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:7ef694ec-1ea0-4f02-800c-d1279b4fdf12+5:5843:x1875954110567424:12345-0@lo:104: 00000100:00100000:3.0:1789049339.221633:0:5834:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cb00_002' 00010000:00010000:0.0:1789049339.221639:0:5833:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.126@tcp lock: ffff8cb8d776fc00/0xf4f48ce5e1bbeb0e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xf4f48ce5e1bbeb15 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049339.221710:0:5833:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1789049339.221717:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8d0ab5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:7ef694ec-1ea0-4f02-800c-d1279b4fdf12+5:5843:x1875954110567424:12345-0@lo:104: Request processed in 99us (439us total) trans 0 rc 0/0 00000100:00100000:0.0:1789049339.221725:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1789049339.221744:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1789049339.221751:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8d0ab4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:7ef694ec-1ea0-4f02-800c-d1279b4fdf12+4:5843:x1875954110567552:12345-0@lo:104: 00010000:00010000:0.0:1789049339.221759:0:5833:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.126@tcp lock: ffff8cb8d776f000/0xf4f48ce5e1bbea9e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xf4f48ce5e1bbeaa5 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049339.221806:0:5839:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789049339.221811:0:5833:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00010000:00010000:1.0:1789049339.221814:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.126@tcp lock: ffff8cb8d776fc00/0xf4f48ce5e1bbeb0e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xf4f48ce5e1bbeb15 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789049339.221819:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8d0ab4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:7ef694ec-1ea0-4f02-800c-d1279b4fdf12+4:5843:x1875954110567552:12345-0@lo:104: Request processed in 68us (372us total) trans 0 rc 0/0 00010000:00010000:1.0:1789049339.221830:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cb8d776fc00 already unused, calling callback (ffffffffc1ca3c20) 00000100:00100000:0.0:1789049339.221831:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1789049339.221859:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1789049339.221866:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8d0ab5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:7ef694ec-1ea0-4f02-800c-d1279b4fdf12+3:5843:x1875954110567680:12345-0@lo:104: 00010000:00010000:0.0:1789049339.221873:0:5833:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.126@tcp lock: ffff8cb8d776e200/0xf4f48ce5e1bbea82 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xf4f48ce5e1bbea89 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049339.221912:0:5833:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 10000000:00010000:1.0:1789049339.221922:0:5839:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.126@tcp lock: ffff8cb8d776fc00/0xf4f48ce5e1bbeb0e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xf4f48ce5e1bbeb15 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789049339.221922:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8d0ab5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:7ef694ec-1ea0-4f02-800c-d1279b4fdf12+3:5843:x1875954110567680:12345-0@lo:104: Request processed in 55us (378us total) trans 0 rc 0/0 00000100:00100000:0.0:1789049339.221939:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00010000:1.0:1789049339.221946:0:5839:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.126@tcp lock: ffff8cb8d776fc00/0xf4f48ce5e1bbeb0e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xf4f48ce5e1bbeb15 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789049339.221956:0:5839:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.126@tcp lock: ffff8cb8d776fc00/0xf4f48ce5e1bbeb0e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xf4f48ce5e1bbeb15 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789049339.221961:0:5839:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1789049339.221994:0:5839:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.126@tcp lock: ffff8cb8d776fc00/0xf4f48ce5e1bbeb0e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf4f48ce5e1bbeb15 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049339.222000:0:5839:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789049339.222023:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.126@tcp lock: ffff8cb8d776fc00/0xf4f48ce5e1bbeb0e lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf4f48ce5e1bbeb15 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049339.222029:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.126@tcp lock: ffff8cb8d776fc00/0xf4f48ce5e1bbeb0e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf4f48ce5e1bbeb15 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049339.222047:0:5839:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1789049339.222056:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.126@tcp lock: ffff8cb8d776f000/0xf4f48ce5e1bbea9e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xf4f48ce5e1bbeaa5 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049339.222063:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cb8d776f000 already unused, calling callback (ffffffffc1ca3c20) 00010000:00010000:3.0:1789049339.222064:0:5838:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 10000000:00010000:1.0:1789049339.222067:0:5839:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.126@tcp lock: ffff8cb8d776f000/0xf4f48ce5e1bbea9e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xf4f48ce5e1bbeaa5 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049339.222075:0:5839:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.126@tcp lock: ffff8cb8d776f000/0xf4f48ce5e1bbea9e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xf4f48ce5e1bbeaa5 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789049339.222082:0:5839:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.126@tcp lock: ffff8cb8d776f000/0xf4f48ce5e1bbea9e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xf4f48ce5e1bbeaa5 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789049339.222086:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb8d0ab5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:7ef694ec-1ea0-4f02-800c-d1279b4fdf12:3311:1875954110567808:0@lo:103: 10000000:01000000:1.0:1789049339.222089:0:5839:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1789049339.222109:0:5839:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.126@tcp lock: ffff8cb8d776f000/0xf4f48ce5e1bbea9e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf4f48ce5e1bbeaa5 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049339.222115:0:5839:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:3.0:1789049339.222122:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1789049339.222134:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.126@tcp lock: ffff8cb8d776f000/0xf4f48ce5e1bbea9e lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf4f48ce5e1bbeaa5 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049339.222142:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.126@tcp lock: ffff8cb8d776f000/0xf4f48ce5e1bbea9e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf4f48ce5e1bbeaa5 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049339.222153:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789049339.222156:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789049339.222158:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789049339.222165:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1789049339.222181:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb8d0ab7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:7ef694ec-1ea0-4f02-800c-d1279b4fdf12:3309:1875954110567936:0@lo:103: 00000100:00100000:3.0:1789049339.222218:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954110567808 00000100:00100000:3.0:1789049339.222223:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954110567808 00010000:00010000:3.0:1789049339.222249:0:5836:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8cb8c146d600/0xf4f48ce5e1bbeb15 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf4f48ce5e1bbeb0e expref: 13 pid: 5843 timeout: 315 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789049339.222273:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1789049339.222279:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8f73c5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7ef694ec-1ea0-4f02-800c-d1279b4fdf12+13:3311:x1875954110567808:12345-0@lo:103: 00010000:00010000:3.0:1789049339.222289:0:5836:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789049339.222294:0:5836:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8cb8c146d600/0xf4f48ce5e1bbeb15 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf4f48ce5e1bbeb0e expref: 13 pid: 5843 timeout: 315 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049339.222304:0:5836:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8cb8c146d600/0xf4f48ce5e1bbeb15 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf4f48ce5e1bbeb0e expref: 13 pid: 5843 timeout: 315 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049339.222317:0:5836:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789049339.222364:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8f73c5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7ef694ec-1ea0-4f02-800c-d1279b4fdf12+13:3311:x1875954110567808:12345-0@lo:103: Request processed in 85us (242us total) trans 0 rc 0/0 00000100:00100000:3.0:1789049339.222377:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1789049339.222403:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1789049339.222433:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cb8c146d600/0xf4f48ce5e1bbeb15 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf4f48ce5e1bbeb0e expref: 12 pid: 5843 timeout: 315 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789049339.222447:0:5843:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb8d0ab7480 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5843:1875954110567424:0@lo:104: 00000100:00100000:3.0:1789049339.222462:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954110567936 00000100:00100000:3.0:1789049339.222466:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954110567936 00000100:00100000:2.0:1789049339.222476:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb8d0ab5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:7ef694ec-1ea0-4f02-800c-d1279b4fdf12:3311:1875954110567808:0@lo:103: 00010000:00010000:3.0:1789049339.222485:0:5837:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8cb8d6715c00/0xf4f48ce5e1bbeaa5 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf4f48ce5e1bbea9e expref: 12 pid: 5843 timeout: 315 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789049339.222523:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1789049339.222531:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8d0ab4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7ef694ec-1ea0-4f02-800c-d1279b4fdf12+12:3309:x1875954110567936:12345-0@lo:103: 00000100:00100000:2.0:1789049339.222532:0:5836:0:(service.c:3467:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00010000:00010000:3.0:1789049339.222539:0:5837:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1789049339.222545:0:5836:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cn00_003' 00010000:00010000:3.0:1789049339.222546:0:5837:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8cb8d6715c00/0xf4f48ce5e1bbeaa5 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf4f48ce5e1bbea9e expref: 12 pid: 5843 timeout: 315 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049339.222566:0:5837:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8cb8d6715c00/0xf4f48ce5e1bbeaa5 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf4f48ce5e1bbea9e expref: 12 pid: 5843 timeout: 315 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049339.222576:0:5837:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789049339.222616:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8d0ab4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7ef694ec-1ea0-4f02-800c-d1279b4fdf12+12:3309:x1875954110567936:12345-0@lo:103: Request processed in 85us (213us total) trans 0 rc 0/0 00000100:00100000:3.0:1789049339.222622:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00010000:3.0:1789049339.222649:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cb8d6715c00/0xf4f48ce5e1bbeaa5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf4f48ce5e1bbea9e expref: 11 pid: 5843 timeout: 315 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789049339.222661:0:5843:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb8d0ab4a80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5843:1875954110567552:0@lo:104: 00000100:00100000:3.0:1789049339.222672:0:5843:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb8d0ab4700 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5843:1875954110567680:0@lo:104: 00010000:00010000:3.0:1789049339.222690:0:5843:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8cb8c146d800/0xf4f48ce5e1bbeb70 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789049339.222739:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb8d0ab7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:7ef694ec-1ea0-4f02-800c-d1279b4fdf12:3309:1875954110567936:0@lo:103: 00010000:00010000:3.0:1789049339.222980:0:6719:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789049339.222983:0:6719:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789049339.222984:0:6719:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789049339.223024:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.126@tcp lock: ffff8cb8d776e200/0xf4f48ce5e1bbea82 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xf4f48ce5e1bbea89 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049339.223039:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cb8d776e200 already unused, calling callback (ffffffffc1ca3c20) 10000000:00010000:1.0:1789049339.223042:0:5838:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.126@tcp lock: ffff8cb8d776e200/0xf4f48ce5e1bbea82 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xf4f48ce5e1bbea89 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049339.223049:0:5838:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.126@tcp lock: ffff8cb8d776e200/0xf4f48ce5e1bbea82 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xf4f48ce5e1bbea89 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789049339.223056:0:5838:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.126@tcp lock: ffff8cb8d776e200/0xf4f48ce5e1bbea82 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xf4f48ce5e1bbea89 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789049339.223062:0:5838:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1789049339.223080:0:5838:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.126@tcp lock: ffff8cb8d776e200/0xf4f48ce5e1bbea82 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf4f48ce5e1bbea89 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049339.223087:0:5838:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:2.0:1789049339.223127:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb8d0ab6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:7ef694ec-1ea0-4f02-800c-d1279b4fdf12:3309:1875954110568064:0@lo:103: 00000100:00100000:2.0:1789049339.223154:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789049339.223216:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954110568064 00010000:00010000:1.0:1789049339.223221:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.126@tcp lock: ffff8cb8d776e200/0xf4f48ce5e1bbea82 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf4f48ce5e1bbea89 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789049339.223222:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954110568064 00010000:00010000:1.0:1789049339.223231:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.126@tcp lock: ffff8cb8d776e200/0xf4f48ce5e1bbea82 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf4f48ce5e1bbea89 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049339.223240:0:5835:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8cb8d6714600/0xf4f48ce5e1bbea89 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf4f48ce5e1bbea82 expref: 11 pid: 5843 timeout: 315 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049339.223247:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789049339.223251:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789049339.223254:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789049339.223265:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1789049339.223273:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8c59cb800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7ef694ec-1ea0-4f02-800c-d1279b4fdf12+11:3309:x1875954110568064:12345-0@lo:103: 00010000:00010000:3.0:1789049339.223281:0:5835:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789049339.223285:0:5835:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8cb8d6714600/0xf4f48ce5e1bbea89 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf4f48ce5e1bbea82 expref: 11 pid: 5843 timeout: 315 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049339.223303:0:5835:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8cb8d6714600/0xf4f48ce5e1bbea89 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf4f48ce5e1bbea82 expref: 11 pid: 5843 timeout: 315 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049339.223313:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cb8d6714600/0xf4f48ce5e1bbea89 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf4f48ce5e1bbea82 expref: 11 pid: 5843 timeout: 315 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049339.223328:0:5835:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8cb8c146d800/0xf4f48ce5e1bbeb70 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049339.223336:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cb8c146d800/0xf4f48ce5e1bbeb70 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049339.223352:0:5835:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8cb8c146d800/0xf4f48ce5e1bbeb70 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049339.223358:0:5835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8cb8c146d800/0xf4f48ce5e1bbeb70 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049339.223544:0:5835:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8cb8c146d800/0xf4f48ce5e1bbeb70 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049339.223552:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8cb8c146d800/0xf4f48ce5e1bbeb70 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049339.223557:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cb8c146d800 already unused, calling callback (ffffffffc166a8f0) 00010000:00010000:3.0:1789049339.223561:0:5835:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8cb8c146d800/0xf4f48ce5e1bbeb70 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049339.223568:0:5835:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8cb8c146d800/0xf4f48ce5e1bbeb70 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049339.223601:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8cb8c146d800/0xf4f48ce5e1bbeb70 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049339.223612:0:5835:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789049339.223653:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8c59cb800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7ef694ec-1ea0-4f02-800c-d1279b4fdf12+10:3309:x1875954110568064:12345-0@lo:103: Request processed in 380us (497us total) trans 0 rc 0/0 00000100:00100000:3.0:1789049339.223660:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00010000:1.0:1789049339.223716:0:5843:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8cb8c146d800/0xf4f48ce5e1bbeb70 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049339.223725:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8cb8c146d800/0xf4f48ce5e1bbeb70 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049339.223742:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cb8c146d800/0xf4f48ce5e1bbeb70 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1789049339.223754:0:5843:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:2.0:1789049339.224429:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb8d0ab6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:7ef694ec-1ea0-4f02-800c-d1279b4fdf12:3309:1875954110568064:0@lo:103: 00000100:00100000:2.0:1789049339.335489:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8c6294850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7ef694ec-1ea0-4f02-800c-d1279b4fdf12+9:6699:x1875954110567296:12345-0@lo:253: Request processed in 136891us (137193us total) trans 0 rc 0/0 00000100:00100000:2.0:1789049339.335504:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1789049339.335592:0:6699:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb8fc998e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7ef694ec-1ea0-4f02-800c-d1279b4fdf12:6699:1875954110567296:0@lo:253: 10000000:01000000:0.0:1789049339.335607:0:6699:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:0.0:1789049339.335610:0:6699:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1789049339.335612:0:6699:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1789049339.335613:0:6699:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789049339.335615:0:6699:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-OST0000_UUID 00000020:01000004:0.0:1789049339.335616:0:6699:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789049339.335617:0:6699:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789049339.335619:0:6699:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1789049339.335620:0:6699:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:0.0:1789049339.335622:0:6699:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789049339.335623:0:6699:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:0.0:1789049339.335643:0:6699:0:(tgt_mount.c:101:server_register_mount()) register mount ffff8cb8d1c83000 from lustre-OST0000 10000000:01000000:0.0:1789049339.335669:0:6699:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:0.0:1789049339.335672:0:6699:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:0.0:1789049339.335678:0:6699:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff8cb8c59599c0 local copy 10000000:01000000:0.0:1789049339.335681:0:6699:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1789049339.335714:0:6699:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.126@tcp lock: ffff8cb8c0030c00/0xf4f48ce5e1bbeb77 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049339.335725:0:6699:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: MGC192.168.206.126@tcp lock: ffff8cb8c0030c00/0xf4f48ce5e1bbeb77 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049339.335735:0:6699:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.126@tcp lock: ffff8cb8c0030c00/0xf4f48ce5e1bbeb77 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789049339.335751:0:6699:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb8fc998e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7ef694ec-1ea0-4f02-800c-d1279b4fdf12:6699:1875954110568192:0@lo:101: 00000100:00100000:0.0:1789049339.335800:0:6699:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789049339.335935:0:6699:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cb8c7cb0180 going to sleep for 11 seconds 00000100:00100000:3.0:1789049339.336044:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954110568192 00000100:00100000:3.0:1789049339.336053:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954110568192 00000100:00100000:3.0:1789049339.336144:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1789049339.336154:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8c6295c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7ef694ec-1ea0-4f02-800c-d1279b4fdf12+9:6699:x1875954110568192:12345-0@lo:101: 00010000:00010000:3.0:1789049339.336167:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789049339.336188:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cb8d776e400/0xf4f48ce5e1bbeb7e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xf4f48ce5e1bbeb77 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049339.336220:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cb8d776e400/0xf4f48ce5e1bbeb7e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf4f48ce5e1bbeb77 expref: 10 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049339.336232:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cb8d776e400/0xf4f48ce5e1bbeb7e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf4f48ce5e1bbeb77 expref: 10 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049339.336240:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cb8d776e400, rc 0) 00000100:00100000:3.0:1789049339.336284:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8c6295c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7ef694ec-1ea0-4f02-800c-d1279b4fdf12+10:6699:x1875954110568192:12345-0@lo:101: Request processed in 132us (482us total) trans 0 rc 0/0 00000100:00100000:3.0:1789049339.336289:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1789049339.336357:0:6699:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb8fc998e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7ef694ec-1ea0-4f02-800c-d1279b4fdf12:6699:1875954110568192:0@lo:101: 00010000:00010000:0.0:1789049339.336387:0:6699:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.126@tcp lock: ffff8cb8c0030c00/0xf4f48ce5e1bbeb77 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0xf4f48ce5e1bbeb7e expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049339.336396:0:6699:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.126@tcp lock: ffff8cb8c0030c00/0xf4f48ce5e1bbeb77 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0xf4f48ce5e1bbeb7e expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789049339.336490:0:6699:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb8fc998e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7ef694ec-1ea0-4f02-800c-d1279b4fdf12:6699:1875954110568320:0@lo:501: 00000100:00100000:0.0:1789049339.336530:0:6699:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789049339.336883:0:6699:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cb8c7cb0180 going to sleep for 11 seconds 00000100:00100000:2.0:1789049339.337044:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954110568320 00000100:00100000:2.0:1789049339.337049:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954110568320 00000100:00100000:2.0:1789049339.337076:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1789049339.337084:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8c6296c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7ef694ec-1ea0-4f02-800c-d1279b4fdf12+10:6699:x1875954110568320:12345-0@lo:501: 00000100:00100000:2.0:1789049339.337325:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8c6296c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7ef694ec-1ea0-4f02-800c-d1279b4fdf12+10:6699:x1875954110568320:12345-0@lo:501: Request processed in 240us (793us total) trans 0 rc -2/-2 00000100:00100000:2.0:1789049339.337333:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1789049339.337474:0:6699:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb8fc998e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7ef694ec-1ea0-4f02-800c-d1279b4fdf12:6699:1875954110568320:0@lo:501: 10000000:01000000:0.0:1789049339.337490:0:6699:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.206.126@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:0.0:1789049339.337519:0:6699:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.206.126@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:0.0:1789049339.337525:0:6699:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.126@tcp lock: ffff8cb8c0030c00/0xf4f48ce5e1bbeb77 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0xf4f48ce5e1bbeb7e expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049339.337533:0:6699:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.126@tcp lock: ffff8cb8c0030c00/0xf4f48ce5e1bbeb77 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0xf4f48ce5e1bbeb7e expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049339.337540:0:6699:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.126@tcp lock: ffff8cb8c0030c00/0xf4f48ce5e1bbeb77 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0xf4f48ce5e1bbeb7e expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049339.337565:0:6699:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:0.0:1789049339.337584:0:6699:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff8cb8d1c83000 10000000:01000000:0.0:1789049339.337589:0:6699:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:0.0:1789049339.337594:0:6699:0:(mgc_request.c:194:do_config_log_add()) do adding config log nodemap-ffff8cb8c59599c0 10000000:01000000:0.0:1789049339.337596:0:6699:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 10000000:01000000:0.0:1789049339.337599:0:6699:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff8cb8c59599c0 from 1 10000000:01000000:0.0:1789049339.337602:0:6699:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:0.0:1789049339.337625:0:6699:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.126@tcp lock: ffff8cb8c0030000/0xf4f48ce5e1bbeb85 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049339.337641:0:6699:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.126@tcp lock: ffff8cb8c0030000/0xf4f48ce5e1bbeb85 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049339.337650:0:6699:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.126@tcp lock: ffff8cb8c0030000/0xf4f48ce5e1bbeb85 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789049339.337664:0:6699:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb8fc998e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7ef694ec-1ea0-4f02-800c-d1279b4fdf12:6699:1875954110568448:0@lo:101: 00000100:00100000:0.0:1789049339.337693:0:6699:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789049339.337714:0:6699:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cb8c7cb0780 going to sleep for 11 seconds 00010000:00010000:2.0:1789049339.338017:0:5839:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789049339.338023:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.126@tcp lock: ffff8cb8c0030c00/0xf4f48ce5e1bbeb77 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x400000000 nid: local remote: 0xf4f48ce5e1bbeb7e expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049339.338031:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cb8c0030c00 already unused, calling callback (ffffffffc1ca3c20) 10000000:00010000:2.0:1789049339.338035:0:5839:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.126@tcp lock: ffff8cb8c0030c00/0xf4f48ce5e1bbeb77 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x400000000 nid: local remote: 0xf4f48ce5e1bbeb7e expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049339.338042:0:5839:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.126@tcp lock: ffff8cb8c0030c00/0xf4f48ce5e1bbeb77 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x8400000000 nid: local remote: 0xf4f48ce5e1bbeb7e expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789049339.338048:0:5839:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.126@tcp lock: ffff8cb8c0030c00/0xf4f48ce5e1bbeb77 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x9400000000 nid: local remote: 0xf4f48ce5e1bbeb7e expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789049339.338064:0:5839:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1789049339.338083:0:5839:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.126@tcp lock: ffff8cb8c0030c00/0xf4f48ce5e1bbeb77 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0xf4f48ce5e1bbeb7e expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049339.338088:0:5839:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789049339.338115:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.126@tcp lock: ffff8cb8c0030c00/0xf4f48ce5e1bbeb77 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0xf4f48ce5e1bbeb7e expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049339.338123:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.126@tcp lock: ffff8cb8c0030c00/0xf4f48ce5e1bbeb77 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0xf4f48ce5e1bbeb7e expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789049339.338222:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb8c59c8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7ef694ec-1ea0-4f02-800c-d1279b4fdf12:3310:1875954110568576:0@lo:103: 00000100:00100000:0.0:1789049339.338255:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1789049339.338372:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789049339.338374:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789049339.338375:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789049339.338391:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954110568576 00000100:00100000:2.0:1789049339.338396:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954110568576 00000100:00100000:2.0:1789049339.338450:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1789049339.338459:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8fc998700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7ef694ec-1ea0-4f02-800c-d1279b4fdf12+10:3310:x1875954110568576:12345-0@lo:103: 00010000:00010000:2.0:1789049339.338469:0:5836:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789049339.338481:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cb8d776e400/0xf4f48ce5e1bbeb7e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xf4f48ce5e1bbeb77 expref: 10 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049339.338494:0:5836:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789049339.338527:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8fc998700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7ef694ec-1ea0-4f02-800c-d1279b4fdf12+9:3310:x1875954110568576:12345-0@lo:103: Request processed in 69us (271us total) trans 0 rc 0/0 00000100:00100000:2.0:1789049339.338533:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1789049339.338560:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb8c59c8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7ef694ec-1ea0-4f02-800c-d1279b4fdf12:3310:1875954110568576:0@lo:103: 00000100:00100000:2.0:1789049339.338579:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954110568448 00000100:00100000:2.0:1789049339.338590:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954110568448 00000100:00100000:2.0:1789049339.338607:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1789049339.338613:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8c6294450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7ef694ec-1ea0-4f02-800c-d1279b4fdf12+9:6699:x1875954110568448:12345-0@lo:101: 00010000:00010000:2.0:1789049339.338622:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789049339.338633:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cb8d6714800/0xf4f48ce5e1bbeb8c lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xf4f48ce5e1bbeb85 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049339.338649:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cb8d6714800/0xf4f48ce5e1bbeb8c lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf4f48ce5e1bbeb85 expref: 10 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049339.338658:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cb8d6714800/0xf4f48ce5e1bbeb8c lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf4f48ce5e1bbeb85 expref: 10 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049339.338664:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cb8d6714800, rc 0) 00000100:00100000:2.0:1789049339.338691:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8c6294450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7ef694ec-1ea0-4f02-800c-d1279b4fdf12+10:6699:x1875954110568448:12345-0@lo:101: Request processed in 78us (997us total) trans 0 rc 0/0 00000100:00100000:2.0:1789049339.338696:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1789049339.338769:0:6699:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb8fc998e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7ef694ec-1ea0-4f02-800c-d1279b4fdf12:6699:1875954110568448:0@lo:101: 00010000:00010000:0.0:1789049339.338818:0:6699:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.126@tcp lock: ffff8cb8c0030000/0xf4f48ce5e1bbeb85 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf4f48ce5e1bbeb8c expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049339.338827:0:6699:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.126@tcp lock: ffff8cb8c0030000/0xf4f48ce5e1bbeb85 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xf4f48ce5e1bbeb8c expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789049339.338871:0:6699:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.126@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:0.0:1789049339.338879:0:6699:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.126@tcp lock: ffff8cb8c0030000/0xf4f48ce5e1bbeb85 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf4f48ce5e1bbeb8c expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049339.338887:0:6699:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.126@tcp lock: ffff8cb8c0030000/0xf4f48ce5e1bbeb85 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf4f48ce5e1bbeb8c expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789049339.338894:0:6699:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:0.0:1789049339.338898:0:6699:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1789049339.338908:0:6699:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:0.0:1789049339.338910:0:6699:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:0.0:1789049339.338939:0:6699:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.126@tcp lock: ffff8cb7c4c38a00/0xf4f48ce5e1bbeb93 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049339.338946:0:6699:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.126@tcp lock: ffff8cb7c4c38a00/0xf4f48ce5e1bbeb93 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049339.338954:0:6699:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.126@tcp lock: ffff8cb7c4c38a00/0xf4f48ce5e1bbeb93 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789049339.338967:0:6699:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb8fc998e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7ef694ec-1ea0-4f02-800c-d1279b4fdf12:6699:1875954110568704:0@lo:101: 00000100:00100000:0.0:1789049339.338993:0:6699:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789049339.339005:0:6699:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cb8c7cb0780 going to sleep for 11 seconds 00000100:00100000:2.0:1789049339.339579:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954110568704 00000100:00100000:2.0:1789049339.339586:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954110568704 00000100:00100000:2.0:1789049339.339610:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1789049339.339617:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8c6295450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7ef694ec-1ea0-4f02-800c-d1279b4fdf12+10:6699:x1875954110568704:12345-0@lo:101: 00010000:00010000:2.0:1789049339.339626:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789049339.339637:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cb8d6715800/0xf4f48ce5e1bbeb9a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xf4f48ce5e1bbeb93 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049339.339652:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cb8d6715800/0xf4f48ce5e1bbeb9a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf4f48ce5e1bbeb93 expref: 11 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049339.339661:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cb8d6715800/0xf4f48ce5e1bbeb9a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf4f48ce5e1bbeb93 expref: 11 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049339.339679:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cb8d6715800, rc 0) 00000100:00100000:2.0:1789049339.339713:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8c6295450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7ef694ec-1ea0-4f02-800c-d1279b4fdf12+11:6699:x1875954110568704:12345-0@lo:101: Request processed in 96us (719us total) trans 0 rc 0/0 00000100:00100000:2.0:1789049339.339719:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1789049339.339886:0:6699:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb8fc998e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7ef694ec-1ea0-4f02-800c-d1279b4fdf12:6699:1875954110568704:0@lo:101: 00010000:00010000:0.0:1789049339.339898:0:6699:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.126@tcp lock: ffff8cb7c4c38a00/0xf4f48ce5e1bbeb93 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf4f48ce5e1bbeb9a expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049339.339906:0:6699:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.126@tcp lock: ffff8cb7c4c38a00/0xf4f48ce5e1bbeb93 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xf4f48ce5e1bbeb9a expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789049339.339991:0:6699:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb8fc998e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7ef694ec-1ea0-4f02-800c-d1279b4fdf12:6699:1875954110568832:0@lo:501: 00000100:00100000:0.0:1789049339.340017:0:6699:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789049339.340039:0:6699:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cb8c7cb0780 going to sleep for 11 seconds 00000100:00100000:2.0:1789049339.340150:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954110568832 00000100:00100000:2.0:1789049339.340154:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954110568832 00000100:00100000:2.0:1789049339.340183:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1789049339.340190:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8c6296850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7ef694ec-1ea0-4f02-800c-d1279b4fdf12+11:6699:x1875954110568832:12345-0@lo:501: 00000100:00100000:2.0:1789049339.340433:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8c6296850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7ef694ec-1ea0-4f02-800c-d1279b4fdf12+11:6699:x1875954110568832:12345-0@lo:501: Request processed in 243us (414us total) trans 0 rc 0/0 00000100:00100000:2.0:1789049339.340441:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1789049339.341002:0:6699:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb8fc998e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7ef694ec-1ea0-4f02-800c-d1279b4fdf12:6699:1875954110568832:0@lo:501: 00000100:00100000:0.0:1789049339.341039:0:6699:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb8fc998e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7ef694ec-1ea0-4f02-800c-d1279b4fdf12:6699:1875954110568960:0@lo:503: 00000100:00100000:0.0:1789049339.341086:0:6699:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789049339.341111:0:6699:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cb8c7cb0780 going to sleep for 11 seconds 00000100:00100000:3.0:1789049339.341747:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954110568960 00000100:00100000:3.0:1789049339.341755:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954110568960 00000100:00100000:3.0:1789049339.341804:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1789049339.341813:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8c6296050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7ef694ec-1ea0-4f02-800c-d1279b4fdf12+11:6699:x1875954110568960:12345-0@lo:503: 00000100:00100000:3.0:1789049339.342008:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8c6296050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7ef694ec-1ea0-4f02-800c-d1279b4fdf12+11:6699:x1875954110568960:12345-0@lo:503: Request processed in 196us (921us total) trans 0 rc 0/0 00000100:00100000:3.0:1789049339.342014:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1789049339.342352:0:6699:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb8fc998e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7ef694ec-1ea0-4f02-800c-d1279b4fdf12:6699:1875954110568960:0@lo:503: 00000040:00080000:0.0:1789049339.342612:0:6699:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1789049339.342687:0:6699:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb8fc998e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7ef694ec-1ea0-4f02-800c-d1279b4fdf12:6699:1875954110569088:0@lo:502: 00000100:00100000:0.0:1789049339.342725:0:6699:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789049339.342759:0:6699:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cb8c7cb0780 going to sleep for 11 seconds 00000100:00100000:3.0:1789049339.342896:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954110569088 00000100:00100000:3.0:1789049339.342901:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954110569088 00000100:00100000:3.0:1789049339.342928:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1789049339.342935:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8c6befc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7ef694ec-1ea0-4f02-800c-d1279b4fdf12+11:6699:x1875954110569088:12345-0@lo:502: 00000100:00100000:3.0:1789049339.343071:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8c6befc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7ef694ec-1ea0-4f02-800c-d1279b4fdf12+11:6699:x1875954110569088:12345-0@lo:502: Request processed in 136us (344us total) trans 0 rc 0/0 00000100:00100000:3.0:1789049339.343079:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1789049339.343958:0:6699:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb8fc998e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7ef694ec-1ea0-4f02-800c-d1279b4fdf12:6699:1875954110569088:0@lo:502: 00000040:00080000:0.0:1789049339.344456:0:6699:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:0.0:1789049339.344516:0:6699:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 128 off8544 00000040:00080000:0.0:1789049339.344551:0:6699:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 112 off8656 00000040:00080000:0.0:1789049339.344612:0:6699:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8880 00000040:00080000:0.0:1789049339.344653:0:6699:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9104 00000040:00080000:0.0:1789049339.344686:0:6699:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 80 off9184 00000100:00100000:0.0:1789049339.344720:0:6699:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb8fc998e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7ef694ec-1ea0-4f02-800c-d1279b4fdf12:6699:1875954110569216:0@lo:502: 00000100:00100000:0.0:1789049339.344790:0:6699:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789049339.344976:0:6699:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cb8c7cb0780 going to sleep for 11 seconds 00000100:00100000:1.0:1789049339.345646:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954110569216 00000100:00100000:1.0:1789049339.345656:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954110569216 00000100:00100000:3.0:1789049339.347111:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1789049339.347586:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8c6bed850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7ef694ec-1ea0-4f02-800c-d1279b4fdf12+11:6699:x1875954110569216:12345-0@lo:502: 00000100:00100000:2.0:1789049339.347886:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8c6bed850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7ef694ec-1ea0-4f02-800c-d1279b4fdf12+11:6699:x1875954110569216:12345-0@lo:502: Request processed in 368us (3106us total) trans 0 rc 0/0 00000100:00100000:2.0:1789049339.347895:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1789049339.348005:0:6699:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb8fc998e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7ef694ec-1ea0-4f02-800c-d1279b4fdf12:6699:1875954110569216:0@lo:502: 00000040:00080000:0.0:1789049339.348155:0:6699:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9408 00000040:00080000:0.0:1789049339.348178:0:6699:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 7 count 8 00000020:01000000:3.0:1789049339.348941:0:6722:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1789049339.348949:0:6722:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-ost1/ost1 00000020:00000080:3.0:1789049339.348955:0:6722:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789049339.348957:0:6722:0:(obd_config.c:1563:class_process_config()) marker 11 (0x1) lustre-OST0000 add ost 00000020:00000080:3.0:1789049339.348962:0:6722:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1789049339.348975:0:6722:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (ffff8cb8d6b799c0) 00000020:00000080:3.0:1789049339.348994:0:6722:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type obdfilter with refcount 2 00000020:00000080:3.0:1789049339.349001:0:6722:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:3.0:1789049339.349067:0:6722:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8cb8d1c83000 from lustre-OST0000, refs=2 00080000:01000000:3.0:1789049339.349075:0:6722:0:(osd_handler.c:1574:osd_obd_connect()) connect #1 00000020:00000080:3.0:1789049339.349081:0:6722:0:(genops.c:1384:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0xf4f48ce5e1bbeba8 00010000:00010000:2.0:1789049339.361334:0:6722:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-2 is initialized 00000001:02000400:2.0:1789049339.361749:0:6722:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-OST0000: new disk, initializing 00000001:00000004:2.0:1789049339.365778:0:6722:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 0 40000000:02000000:2.0:1789049339.366107:0:6722:0:(fid_handler.c:560:seq_server_init()) srv-lustre-OST0000: No data found on store. Initialize space. 00080000:10000000:2.0:1789049339.381788:0:6722:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000001:0x3:0x0] (8/8/3) registered 00080000:10000000:3.0:1789049339.383073:0:6722:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x3:0x0] (8/8/4) registered 00000020:00000080:3.0:1789049339.385811:0:6722:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:3.0:1789049339.385822:0:6722:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789049339.385829:0:6722:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789049339.385831:0:6722:0:(obd_config.c:1563:class_process_config()) marker 11 (0x2) lustre-OST0000 add ost 00000020:01000000:3.0:1789049339.385835:0:6722:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789049339.385838:0:6722:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789049339.385840:0:6722:0:(obd_config.c:1563:class_process_config()) marker 15 (0x1) lustre sys.timeout 00000020:00000080:3.0:1789049339.385877:0:6722:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1789049339.385878:0:6722:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:3.0:1789049339.385927:0:6722:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789049339.385931:0:6722:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789049339.385933:0:6722:0:(obd_config.c:1563:class_process_config()) marker 15 (0x2) lustre sys.timeout 00000040:00080000:3.0:1789049339.385936:0:6722:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000020:01000000:0.0:1789049339.386109:0:6699:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-7 (rc=0) 10000000:01000000:0.0:1789049339.386148:0:6699:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.126@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:0.0:1789049339.386215:0:6699:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.126@tcp lock: ffff8cb7c4c38a00/0xf4f48ce5e1bbeb93 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf4f48ce5e1bbeb9a expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049339.386229:0:6699:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.126@tcp lock: ffff8cb7c4c38a00/0xf4f48ce5e1bbeb93 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf4f48ce5e1bbeb9a expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789049339.386237:0:6699:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8cb8d1c83000 from 1 10000000:01000000:0.0:1789049339.386240:0:6699:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1789049339.386278:0:6699:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.126@tcp lock: ffff8cb7c4c39600/0xf4f48ce5e1bbebaf lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049339.386287:0:6699:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.126@tcp lock: ffff8cb7c4c39600/0xf4f48ce5e1bbebaf lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049339.386298:0:6699:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.126@tcp lock: ffff8cb7c4c39600/0xf4f48ce5e1bbebaf lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789049339.386322:0:6699:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb8fc998e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7ef694ec-1ea0-4f02-800c-d1279b4fdf12:6699:1875954110569344:0@lo:101: 00000100:00100000:0.0:1789049339.386404:0:6699:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789049339.386455:0:6699:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cb8d742c9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789049339.386610:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954110569344 00000100:00100000:1.0:1789049339.386619:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954110569344 00000100:00100000:1.0:1789049339.386665:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1789049339.386675:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8c6bed050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7ef694ec-1ea0-4f02-800c-d1279b4fdf12+11:6699:x1875954110569344:12345-0@lo:101: 00010000:00010000:1.0:1789049339.386687:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789049339.386698:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cb8c146d800/0xf4f48ce5e1bbebb6 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xf4f48ce5e1bbebaf expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049339.386718:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cb8c146d800/0xf4f48ce5e1bbebb6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf4f48ce5e1bbebaf expref: 12 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049339.386729:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cb8c146d800/0xf4f48ce5e1bbebb6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf4f48ce5e1bbebaf expref: 12 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049339.386737:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cb8c146d800, rc 0) 00000100:00100000:1.0:1789049339.386775:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8c6bed050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7ef694ec-1ea0-4f02-800c-d1279b4fdf12+12:6699:x1875954110569344:12345-0@lo:101: Request processed in 102us (371us total) trans 0 rc 0/0 00000100:00100000:1.0:1789049339.386793:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1789049339.387035:0:6699:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb8fc998e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7ef694ec-1ea0-4f02-800c-d1279b4fdf12:6699:1875954110569344:0@lo:101: 00010000:00010000:0.0:1789049339.387049:0:6699:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.126@tcp lock: ffff8cb7c4c39600/0xf4f48ce5e1bbebaf lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf4f48ce5e1bbebb6 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049339.387058:0:6699:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.126@tcp lock: ffff8cb7c4c39600/0xf4f48ce5e1bbebaf lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xf4f48ce5e1bbebb6 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789049339.387157:0:6699:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb8fc998e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7ef694ec-1ea0-4f02-800c-d1279b4fdf12:6699:1875954110569472:0@lo:501: 00000100:00100000:0.0:1789049339.387185:0:6699:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789049339.387349:0:6699:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cb8d742c9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789049339.396074:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954110569472 00000100:00100000:0.0:1789049339.396086:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954110569472 00000100:00100000:0.0:1789049339.397543:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1789049339.397560:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8c6bef850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7ef694ec-1ea0-4f02-800c-d1279b4fdf12+12:6699:x1875954110569472:12345-0@lo:501: 00000100:00100000:0.0:1789049339.397880:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8c6bef850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7ef694ec-1ea0-4f02-800c-d1279b4fdf12+12:6699:x1875954110569472:12345-0@lo:501: Request processed in 326us (10693us total) trans 0 rc 0/0 00000100:00100000:0.0:1789049339.397888:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1789049339.398023:0:6699:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb8fc998e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7ef694ec-1ea0-4f02-800c-d1279b4fdf12:6699:1875954110569472:0@lo:501: 00000100:00100000:2.0:1789049339.398074:0:6699:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb8c59c8000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7ef694ec-1ea0-4f02-800c-d1279b4fdf12:6699:1875954110569600:0@lo:503: 00000100:00100000:2.0:1789049339.398119:0:6699:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789049339.403071:0:6699:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cb7c4e73480 going to sleep for 11 seconds 00000100:00100000:1.0:1789049339.405147:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954110569600 00000100:00100000:1.0:1789049339.405158:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954110569600 00000100:00100000:1.0:1789049339.405508:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1789049339.405520:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8c6bec850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7ef694ec-1ea0-4f02-800c-d1279b4fdf12+12:6699:x1875954110569600:12345-0@lo:503: 00000100:00100000:1.0:1789049339.405897:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8c6bec850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7ef694ec-1ea0-4f02-800c-d1279b4fdf12+12:6699:x1875954110569600:12345-0@lo:503: Request processed in 379us (7777us total) trans 0 rc 0/0 00000100:00100000:1.0:1789049339.405906:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1789049339.406062:0:6699:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb8c59c8000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7ef694ec-1ea0-4f02-800c-d1279b4fdf12:6699:1875954110569600:0@lo:503: 00000040:00080000:2.0:1789049339.406594:0:6699:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1789049339.406665:0:6699:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb8c59c8000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7ef694ec-1ea0-4f02-800c-d1279b4fdf12:6699:1875954110569728:0@lo:502: 00000100:00100000:2.0:1789049339.406713:0:6699:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789049339.406740:0:6699:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cb7c4e73480 going to sleep for 11 seconds 00000100:00100000:1.0:1789049339.406816:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954110569728 00000100:00100000:1.0:1789049339.406821:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954110569728 00000100:00100000:1.0:1789049339.406890:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1789049339.406898:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8c6bedc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7ef694ec-1ea0-4f02-800c-d1279b4fdf12+12:6699:x1875954110569728:12345-0@lo:502: 00000100:00100000:1.0:1789049339.407069:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8c6bedc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7ef694ec-1ea0-4f02-800c-d1279b4fdf12+12:6699:x1875954110569728:12345-0@lo:502: Request processed in 171us (355us total) trans 0 rc 0/0 00000100:00100000:1.0:1789049339.407076:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1789049339.407497:0:6699:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb8c59c8000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7ef694ec-1ea0-4f02-800c-d1279b4fdf12:6699:1875954110569728:0@lo:502: 00000040:00080000:3.0:1789049339.407744:0:6699:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 00000040:00080000:3.0:1789049339.407810:0:6699:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 112 off8528 00000100:00100000:3.0:1789049339.407837:0:6699:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb8f73c7800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7ef694ec-1ea0-4f02-800c-d1279b4fdf12:6699:1875954110569856:0@lo:502: 00000100:00100000:3.0:1789049339.407900:0:6699:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789049339.407927:0:6699:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cb8d0ccdd80 going to sleep for 11 seconds 00000100:00100000:2.0:1789049339.408019:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954110569856 00000100:00100000:2.0:1789049339.408026:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954110569856 00000100:00100000:2.0:1789049339.408051:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1789049339.408059:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8c6beec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7ef694ec-1ea0-4f02-800c-d1279b4fdf12+12:6699:x1875954110569856:12345-0@lo:502: 00000100:00100000:2.0:1789049339.408467:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8c6beec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7ef694ec-1ea0-4f02-800c-d1279b4fdf12+12:6699:x1875954110569856:12345-0@lo:502: Request processed in 284us (441us total) trans 0 rc 0/0 00000100:00100000:2.0:1789049339.408476:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1789049339.408616:0:6699:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb8f73c7800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7ef694ec-1ea0-4f02-800c-d1279b4fdf12:6699:1875954110569856:0@lo:502: 00000040:00080000:3.0:1789049339.408710:0:6699:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 224 off8752 00000040:00080000:3.0:1789049339.408719:0:6699:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 3 count 4 00000020:01000000:3.0:1789049339.409590:0:6726:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789049339.409600:0:6726:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789049339.409603:0:6726:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:3.0:1789049339.409609:0:6726:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8cb8d1c83000 00000020:00000080:3.0:1789049339.409611:0:6726:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1789049339.409629:0:6726:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789049339.409632:0:6726:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789049339.409634:0:6726:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:3.0:1789049339.409636:0:6726:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000020:01000000:2.0:1789049339.410054:0:6699:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:2.0:1789049339.410078:0:6699:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.126@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1789049339.410140:0:6699:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.126@tcp lock: ffff8cb7c4c39600/0xf4f48ce5e1bbebaf lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf4f48ce5e1bbebb6 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049339.410152:0:6699:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.126@tcp lock: ffff8cb7c4c39600/0xf4f48ce5e1bbebaf lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf4f48ce5e1bbebb6 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789049339.410281:0:6699:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:2.0:1789049339.410284:0:6699:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff8cb8d1c83000 10000000:01000000:2.0:1789049339.410286:0:6699:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff8cb8d1c83000 10000000:01000000:2.0:1789049339.410290:0:6699:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1789049339.410295:0:6699:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8cb8d1c83000 from 1 10000000:01000000:2.0:1789049339.410297:0:6699:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1789049339.410328:0:6699:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.126@tcp lock: ffff8cb8d6714600/0xf4f48ce5e1bbebbd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049339.410337:0:6699:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.126@tcp lock: ffff8cb8d6714600/0xf4f48ce5e1bbebbd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049339.410441:0:6699:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.126@tcp lock: ffff8cb8d6714600/0xf4f48ce5e1bbebbd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789049339.410462:0:6699:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb8c59cad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7ef694ec-1ea0-4f02-800c-d1279b4fdf12:6699:1875954110569984:0@lo:101: 00000100:00100000:2.0:1789049339.410515:0:6699:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789049339.410555:0:6699:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cb7c4e73e40 going to sleep for 11 seconds 00000100:00100000:1.0:1789049339.410685:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954110569984 00000100:00100000:1.0:1789049339.410692:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954110569984 00000100:00100000:1.0:1789049339.410736:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1789049339.410745:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8c6bec450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7ef694ec-1ea0-4f02-800c-d1279b4fdf12+12:6699:x1875954110569984:12345-0@lo:101: 00010000:00010000:1.0:1789049339.410756:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789049339.410768:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cb8c146d200/0xf4f48ce5e1bbebc4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xf4f48ce5e1bbebbd expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049339.410800:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cb8c146d200/0xf4f48ce5e1bbebc4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf4f48ce5e1bbebbd expref: 13 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049339.410810:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cb8c146d200/0xf4f48ce5e1bbebc4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf4f48ce5e1bbebbd expref: 13 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049339.410818:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cb8c146d200, rc 0) 00000100:00100000:1.0:1789049339.410985:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8c6bec450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7ef694ec-1ea0-4f02-800c-d1279b4fdf12+13:6699:x1875954110569984:12345-0@lo:101: Request processed in 241us (469us total) trans 0 rc 0/0 00000100:00100000:1.0:1789049339.410991:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1789049339.411526:0:6699:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb8c59cad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7ef694ec-1ea0-4f02-800c-d1279b4fdf12:6699:1875954110569984:0@lo:101: 00010000:00010000:0.0:1789049339.411543:0:6699:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.126@tcp lock: ffff8cb8d6714600/0xf4f48ce5e1bbebbd lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf4f48ce5e1bbebc4 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049339.411552:0:6699:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.126@tcp lock: ffff8cb8d6714600/0xf4f48ce5e1bbebbd lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xf4f48ce5e1bbebc4 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789049339.411644:0:6699:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb8fc999500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7ef694ec-1ea0-4f02-800c-d1279b4fdf12:6699:1875954110570112:0@lo:501: 00000100:00100000:0.0:1789049339.411677:0:6699:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789049339.411743:0:6699:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cb8d742ccc0 going to sleep for 11 seconds 00000100:00100000:2.0:1789049339.417537:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954110570112 00000100:00100000:2.0:1789049339.417552:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954110570112 00000100:00100000:2.0:1789049339.417638:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1789049339.417648:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8c6bed450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7ef694ec-1ea0-4f02-800c-d1279b4fdf12+13:6699:x1875954110570112:12345-0@lo:501: 00000100:00100000:2.0:1789049339.417980:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8c6bed450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7ef694ec-1ea0-4f02-800c-d1279b4fdf12+13:6699:x1875954110570112:12345-0@lo:501: Request processed in 333us (6301us total) trans 0 rc 0/0 00000100:00100000:2.0:1789049339.417987:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1789049339.418316:0:6699:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb8fc999500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7ef694ec-1ea0-4f02-800c-d1279b4fdf12:6699:1875954110570112:0@lo:501: 00000100:00100000:0.0:1789049339.418362:0:6699:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb8fc999500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7ef694ec-1ea0-4f02-800c-d1279b4fdf12:6699:1875954110570240:0@lo:503: 00000100:00100000:0.0:1789049339.418419:0:6699:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789049339.418456:0:6699:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cb8d742ccc0 going to sleep for 11 seconds 00000100:00100000:1.0:1789049339.419560:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954110570240 00000100:00100000:1.0:1789049339.419569:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954110570240 00000100:00100000:1.0:1789049339.419623:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1789049339.419633:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8c6bee850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7ef694ec-1ea0-4f02-800c-d1279b4fdf12+13:6699:x1875954110570240:12345-0@lo:503: 00000100:00100000:1.0:1789049339.419834:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8c6bee850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7ef694ec-1ea0-4f02-800c-d1279b4fdf12+13:6699:x1875954110570240:12345-0@lo:503: Request processed in 203us (1414us total) trans 0 rc 0/0 00000100:00100000:1.0:1789049339.419862:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1789049339.420432:0:6699:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb8fc999500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7ef694ec-1ea0-4f02-800c-d1279b4fdf12:6699:1875954110570240:0@lo:503: 00000040:00080000:0.0:1789049339.420724:0:6699:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1789049339.420817:0:6699:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb8fc999500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7ef694ec-1ea0-4f02-800c-d1279b4fdf12:6699:1875954110570368:0@lo:502: 00000100:00100000:0.0:1789049339.420922:0:6699:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789049339.420948:0:6699:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cb8d742ccc0 going to sleep for 11 seconds 00000100:00100000:1.0:1789049339.421506:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954110570368 00000100:00100000:1.0:1789049339.421514:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954110570368 00000100:00100000:1.0:1789049339.421565:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1789049339.421574:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8c6bee050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7ef694ec-1ea0-4f02-800c-d1279b4fdf12+13:6699:x1875954110570368:12345-0@lo:502: 00000100:00100000:1.0:1789049339.421759:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8c6bee050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7ef694ec-1ea0-4f02-800c-d1279b4fdf12+13:6699:x1875954110570368:12345-0@lo:502: Request processed in 186us (836us total) trans 0 rc 0/0 00000100:00100000:1.0:1789049339.421767:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1789049339.421879:0:6699:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb8fc999500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7ef694ec-1ea0-4f02-800c-d1279b4fdf12:6699:1875954110570368:0@lo:502: 00000040:00080000:0.0:1789049339.422343:0:6699:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:0.0:1789049339.422479:0:6699:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:0.0:1789049339.422514:0:6699:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:0.0:1789049339.422560:0:6699:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:0.0:1789049339.422612:0:6699:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:0.0:1789049339.422661:0:6699:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:0.0:1789049339.422697:0:6699:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:0.0:1789049339.422741:0:6699:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:0.0:1789049339.422798:0:6699:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:0.0:1789049339.422837:0:6699:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:0.0:1789049339.422923:0:6699:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:0.0:1789049339.422971:0:6699:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:0.0:1789049339.423008:0:6699:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:0.0:1789049339.423042:0:6699:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:0.0:1789049339.423101:0:6699:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:0.0:1789049339.426338:0:6699:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:0.0:1789049339.426481:0:6699:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:0.0:1789049339.426581:0:6699:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:0.0:1789049339.426622:0:6699:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:0.0:1789049339.426657:0:6699:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:0.0:1789049339.426720:0:6699:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:0.0:1789049339.426757:0:6699:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:0.0:1789049339.426807:0:6699:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:0.0:1789049339.427131:0:6699:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:0.0:1789049339.427177:0:6699:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 128 off12440 00000040:00080000:0.0:1789049339.427289:0:6699:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12664 00000040:00080000:0.0:1789049339.427335:0:6699:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12888 00000040:00080000:0.0:1789049339.427451:0:6699:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off12968 00000100:00100000:0.0:1789049339.427500:0:6699:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb8fc999500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7ef694ec-1ea0-4f02-800c-d1279b4fdf12:6699:1875954110570496:0@lo:502: 00000100:00100000:0.0:1789049339.427575:0:6699:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789049339.427623:0:6699:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cb8d742ccc0 going to sleep for 11 seconds 00000100:00100000:2.0:1789049339.427974:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954110570496 00000100:00100000:2.0:1789049339.427982:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954110570496 00000100:00100000:2.0:1789049339.428030:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1789049339.428039:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8c6bef050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7ef694ec-1ea0-4f02-800c-d1279b4fdf12+13:6699:x1875954110570496:12345-0@lo:502: 00000100:00100000:2.0:1789049339.428264:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8c6bef050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7ef694ec-1ea0-4f02-800c-d1279b4fdf12+13:6699:x1875954110570496:12345-0@lo:502: Request processed in 224us (688us total) trans 0 rc 0/0 00000100:00100000:2.0:1789049339.428271:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1789049339.428704:0:6699:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb8fc999500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7ef694ec-1ea0-4f02-800c-d1279b4fdf12:6699:1875954110570496:0@lo:502: 00000040:00080000:0.0:1789049339.428809:0:6699:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13192 00000040:00080000:0.0:1789049339.428820:0:6699:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 29 count 30 00000020:01000004:0.0:1789049339.429830:0:6727:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:0.0:1789049339.430016:0:6727:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff8cb8c595cd40) 00000020:00000080:0.0:1789049339.430039:0:6727:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type lwp with refcount 2 00000020:01000004:0.0:1789049339.430108:0:6727:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8cb8d1c83000 from lustre-OST0000, refs=3 00000020:01000004:0.0:1789049339.430296:0:6727:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8cb8d1c83000 from lustre-OST0000, refs=3 00000020:01000004:0.0:1789049339.430299:0:6727:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8cb8d1c83000 3 00010000:00080000:0.0:1789049339.430333:0:6727:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8cb7c4c41800@lustre-MDT0000-lwp-OST0000: add connection 192.168.206.126@tcp at head 00010000:00010000:1.0:1789049339.436687:0:6727:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-2 is initialized 00000020:00000080:1.0:1789049339.436979:0:6727:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:1.0:1789049339.437016:0:6727:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1789049339.437027:0:6727:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0xf4f48ce5e1bbebd2 00000100:00080000:1.0:1789049339.437036:0:6727:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1789049339.437046:0:6727:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8cb7c4c41800 using connection 192.168.206.126@tcp/0@lo 00000100:00100000:1.0:1789049339.437076:0:6727:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8cb8d0ab5f80 x1875954110570624/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1789049339.437102:0:6727:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00100000:3.0:1789049339.437405:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb8d0ab5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3307:1875954110570624:0@lo:38: 00000100:00100000:3.0:1789049339.437469:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789049339.437812:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954110570624 00000100:00100000:0.0:1789049339.437820:0:5852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954110570624 00000100:00100000:0.0:1789049339.437879:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1789049339.437887:0:5852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8f73c7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3307:x1875954110570624:12345-0@lo:38: 00010000:00080000:0.0:1789049339.437912:0:5852:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 165 last 0 00000020:00000080:0.0:1789049339.437958:0:5852:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0xf4f48ce5e1bbebd9 00000004:00100000:0.0:1789049339.437973:0:5852:0:(mdt_handler.c:7315:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1789049339.438004:0:5852:0:(import.c:65:import_set_state_nolock()) ffff8cb7c4c45800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1789049339.438058:0:5852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8f73c7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1875954110570624:12345-0@lo:38: Request processed in 171us (589us total) trans 0 rc 0/0 00000100:00100000:0.0:1789049339.438066:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:3.0:1789049339.438322:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff8cb8d0ab5f80 x1875954110570624/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1789049349 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789049339.438333:0:3307:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1789049339.438361:0:3307:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 1 00000100:00080000:3.0:1789049339.438377:0:3307:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:3.0:1789049339.438381:0:3307:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:3.0:1789049339.438383:0:3307:0:(import.c:65:import_set_state_nolock()) ffff8cb7c4c41800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1789049339.438389:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb8d0ab5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3307:1875954110570624:0@lo:38: 00000100:00100000:1.0:1789049339.438517:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb8fc999500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3311:1875954110570752:0@lo:400: 00000100:00100000:1.0:1789049339.438556:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789049339.438683:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954110570752 00000100:00100000:3.0:1789049339.438687:0:5851:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954110570752 00000100:00100000:3.0:1789049339.438720:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1789049339.438727:0:5851:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8d0ab5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1875954110570752:12345-0@lo:400: 00000100:00100000:3.0:1789049339.438768:0:5851:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8d0ab5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1875954110570752:12345-0@lo:400: Request processed in 41us (212us total) trans 0 rc 0/0 00000100:00100000:3.0:1789049339.438774:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:1.0:1789049339.438869:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff8cb8fc999500 x1875954110570752/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789049355 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789049339.438893:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb8fc999500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3311:1875954110570752:0@lo:400: 00000040:00080000:1.0:1789049339.439522:0:6727:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 30 count 30 00000020:01000000:2.0:1789049339.443000:0:6699:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-29 (rc=0) 10000000:01000000:2.0:1789049339.443037:0:6699:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.126@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1789049339.443057:0:6699:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.126@tcp lock: ffff8cb8d6714600/0xf4f48ce5e1bbebbd lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf4f48ce5e1bbebc4 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049339.443070:0:6699:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.126@tcp lock: ffff8cb8d6714600/0xf4f48ce5e1bbebbd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf4f48ce5e1bbebc4 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1789049339.443143:0:6699:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:2.0:1789049339.443146:0:6699:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1789049339.443147:0:6699:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789049339.443148:0:6699:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789049339.443150:0:6699:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789049339.443151:0:6699:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789049339.443152:0:6699:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1789049339.443154:0:6699:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1789049339.443155:0:6699:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1789049339.443156:0:6699:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789049339.443158:0:6699:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1789049339.443161:0:6699:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020062 00000020:01000004:2.0:1789049339.443164:0:6699:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1789049339.443165:0:6699:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1789049339.443166:0:6699:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789049339.443167:0:6699:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789049339.443168:0:6699:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789049339.443170:0:6699:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789049339.443171:0:6699:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1789049339.443172:0:6699:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1789049339.443173:0:6699:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1789049339.443174:0:6699:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789049339.443175:0:6699:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1789049339.443211:0:6699:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:2.0:1789049339.443228:0:6699:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb8c59c9f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7ef694ec-1ea0-4f02-800c-d1279b4fdf12:6699:1875954110570880:0@lo:253: 00000100:00100000:2.0:1789049339.443293:0:6699:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789049339.443358:0:6699:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cb7c4e73180 going to sleep for 11 seconds 00000100:00100000:0.0:1789049339.443553:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954110570880 00000100:00100000:0.0:1789049339.443562:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954110570880 00000100:00100000:0.0:1789049339.443612:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1789049339.443621:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8c6bec050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7ef694ec-1ea0-4f02-800c-d1279b4fdf12+13:6699:x1875954110570880:12345-0@lo:253: 20000000:01000000:0.0:1789049339.443645:0:5844:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:0.0:1789049339.443658:0:5844:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:0.0:1789049339.479752:0:5844:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1789049339.479765:0:5844:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 20000000:01000000:0.0:1789049339.479793:0:5866:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1789049339.479798:0:5866:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1789049339.479816:0:5866:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8cb7c4c39400/0xf4f48ce5e1bbebe0 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5866 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049339.479832:0:5866:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8cb8c146c200/0xf4f48ce5e1bbeb3f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf4f48ce5e1bbeb38 expref: 13 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049339.479878:0:5866:0:(ldlm_resource.c:1751:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8cb7c4c39400/0xf4f48ce5e1bbebe0 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5866 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049339.479911:0:5866:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8cb8c146c200/0xf4f48ce5e1bbeb3f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf4f48ce5e1bbeb38 expref: 13 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049339.479923:0:5866:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8cb8c146c200/0xf4f48ce5e1bbeb3f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf4f48ce5e1bbeb38 expref: 13 pid: 5843 timeout: 315 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789049339.479936:0:5866:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb8fc999180 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5866:1875954110571008:0@lo:104: 00000100:00100000:0.0:1789049339.479990:0:5866:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789049339.480030:0:5866:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cb8d742c600 going to sleep for 11 seconds 00000100:00100000:0.0:1789049339.480051:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954110571008 00000100:00100000:0.0:1789049339.480058:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954110571008 00000100:00100000:0.0:1789049339.480092:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1789049339.480100:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8fc99b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:7ef694ec-1ea0-4f02-800c-d1279b4fdf12+3:5866:x1875954110571008:12345-0@lo:104: 00010000:00010000:0.0:1789049339.480111:0:5833:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.126@tcp lock: ffff8cb8d776f600/0xf4f48ce5e1bbeb38 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xf4f48ce5e1bbeb3f expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049339.480669:0:5833:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1789049339.480676:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8fc99b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:7ef694ec-1ea0-4f02-800c-d1279b4fdf12+3:5866:x1875954110571008:12345-0@lo:104: Request processed in 576us (685us total) trans 0 rc 0/0 00000100:00100000:0.0:1789049339.480683:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00010000:3.0:1789049339.481065:0:6719:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789049339.481073:0:6719:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.126@tcp lock: ffff8cb8d776f600/0xf4f48ce5e1bbeb38 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xf4f48ce5e1bbeb3f expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049339.481081:0:6719:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cb8d776f600 already unused, calling callback (ffffffffc1ca3c20) 10000000:00010000:3.0:1789049339.481085:0:6719:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.126@tcp lock: ffff8cb8d776f600/0xf4f48ce5e1bbeb38 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xf4f48ce5e1bbeb3f expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049339.481094:0:6719:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.126@tcp lock: ffff8cb8d776f600/0xf4f48ce5e1bbeb38 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xf4f48ce5e1bbeb3f expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789049339.481100:0:6719:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.126@tcp lock: ffff8cb8d776f600/0xf4f48ce5e1bbeb38 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xf4f48ce5e1bbeb3f expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789049339.481105:0:6719:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1789049339.481151:0:6719:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.126@tcp lock: ffff8cb8d776f600/0xf4f48ce5e1bbeb38 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf4f48ce5e1bbeb3f expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049339.481170:0:6719:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789049339.481191:0:6719:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.126@tcp lock: ffff8cb8d776f600/0xf4f48ce5e1bbeb38 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf4f48ce5e1bbeb3f expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049339.481310:0:6719:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.126@tcp lock: ffff8cb8d776f600/0xf4f48ce5e1bbeb38 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf4f48ce5e1bbeb3f expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049339.481326:0:6719:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789049339.481328:0:6719:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789049339.481330:0:6719:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789049339.481346:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb8f73c4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7ef694ec-1ea0-4f02-800c-d1279b4fdf12:3308:1875954110571136:0@lo:103: 00000100:00100000:3.0:1789049339.481457:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789049339.482052:0:5866:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb8fc999180 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5866:1875954110571008:0@lo:104: 00010000:00010000:2.0:1789049339.482072:0:5866:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8cb7c4c39400/0xf4f48ce5e1bbebe0 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5866 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789049339.482439:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954110571136 00000100:00100000:0.0:1789049339.482446:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954110571136 00010000:00010000:0.0:1789049339.482478:0:5835:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8cb8c146c200/0xf4f48ce5e1bbeb3f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf4f48ce5e1bbeb38 expref: 14 pid: 5843 timeout: 315 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789049339.482510:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1789049339.482531:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8c7deec50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7ef694ec-1ea0-4f02-800c-d1279b4fdf12+14:3308:x1875954110571136:12345-0@lo:103: 00010000:00010000:0.0:1789049339.482544:0:5835:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789049339.482549:0:5835:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8cb8c146c200/0xf4f48ce5e1bbeb3f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf4f48ce5e1bbeb38 expref: 14 pid: 5843 timeout: 315 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049339.482559:0:5835:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8cb8c146c200/0xf4f48ce5e1bbeb3f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf4f48ce5e1bbeb38 expref: 14 pid: 5843 timeout: 315 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049339.482574:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cb8c146c200/0xf4f48ce5e1bbeb3f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf4f48ce5e1bbeb38 expref: 14 pid: 5843 timeout: 315 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049339.482587:0:5835:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8cb7c4c39400/0xf4f48ce5e1bbebe0 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5866 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049339.482595:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cb7c4c39400/0xf4f48ce5e1bbebe0 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5866 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1789049339.482610:0:5835:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.002812352s 00010000:00010000:0.0:1789049339.482615:0:5835:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8cb7c4c39400/0xf4f48ce5e1bbebe0 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5866 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049339.482621:0:5835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8cb7c4c39400/0xf4f48ce5e1bbebe0 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5866 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049339.482627:0:5835:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8cb7c4c39400/0xf4f48ce5e1bbebe0 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5866 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049339.482633:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8cb7c4c39400/0xf4f48ce5e1bbebe0 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5866 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049339.482639:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cb7c4c39400 already unused, calling callback (ffffffffc166a8f0) 00010000:00010000:0.0:1789049339.482648:0:5835:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8cb7c4c39400/0xf4f48ce5e1bbebe0 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5866 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049339.482657:0:5835:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8cb7c4c39400/0xf4f48ce5e1bbebe0 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5866 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049339.482677:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8cb7c4c39400/0xf4f48ce5e1bbebe0 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5866 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049339.482686:0:5835:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789049339.482737:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8c7deec50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7ef694ec-1ea0-4f02-800c-d1279b4fdf12+13:3308:x1875954110571136:12345-0@lo:103: Request processed in 207us (1280us total) trans 0 rc 0/0 00000100:00100000:0.0:1789049339.482745:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1789049339.482877:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb8f73c4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7ef694ec-1ea0-4f02-800c-d1279b4fdf12:3308:1875954110571136:0@lo:103: 00010000:00010000:2.0:1789049339.482984:0:5866:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8cb7c4c39400/0xf4f48ce5e1bbebe0 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5866 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049339.483002:0:5866:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8cb7c4c39400/0xf4f48ce5e1bbebe0 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5866 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049339.483008:0:5866:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cb7c4c39400/0xf4f48ce5e1bbebe0 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5866 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789049339.492599:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8c6bec050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7ef694ec-1ea0-4f02-800c-d1279b4fdf12+12:6699:x1875954110570880:12345-0@lo:253: Request processed in 48970us (49296us total) trans 0 rc 0/0 00000100:00100000:1.0:1789049339.492612:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1789049339.492719:0:6699:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb8c59c9f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7ef694ec-1ea0-4f02-800c-d1279b4fdf12:6699:1875954110570880:0@lo:253: 10000000:01000000:2.0:1789049339.492733:0:6699:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:2.0:1789049339.492737:0:6699:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1789049339.492739:0:6699:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1789049339.492740:0:6699:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789049339.492741:0:6699:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789049339.492742:0:6699:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789049339.492743:0:6699:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789049339.492744:0:6699:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1789049339.492746:0:6699:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1789049339.492747:0:6699:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1789049339.492749:0:6699:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789049339.492750:0:6699:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:2.0:1789049339.492764:0:6699:0:(tgt_mount.c:2694:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:3.0:1789049339.500997:0:6699:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:3.0:1789049339.501487:0:6699:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:3.0:1789049339.501900:0:6699:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:3.0:1789049339.502097:0:6699:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:3.0:1789049339.502755:0:6699:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:2.0:1789049339.503579:0:6699:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:3.0:1789049339.506088:0:6699:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967296 00010000:00010000:1.0:1789049339.614031:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00080000:0.0:1789049339.855477:0:6699:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:0.0:1789049339.855485:0:6699:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0000-osd: start master thread 00000020:01000004:0.0:1789049339.855583:0:6699:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:0.0:1789049339.855639:0:6699:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.206.126@tcp: cl_mgc_mutex unlock 00000020:01000004:0.0:1789049339.855655:0:6699:0:(tgt_mount.c:2460:server_fill_super_common()) Server sb, dev=48 00000080:00000004:0.0:1789049339.855681:0:6699:0:(super25.c:182:lustre_fill_super()) lustre-ost1/ost1: Mount complete 00010000:00010000:0.0:1789049340.635243:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789049341.659315:0:6719:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1789049341.798945:0:5848:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1789049341.798953:0:5848:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8cb8e01c3000 from 21 10000000:01000000:3.0:1789049341.798957:0:5848:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1789049341.799001:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.126@tcp lock: ffff8cb8d776f600/0xf4f48ce5e1bbebe7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049341.799012:0:5848:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.126@tcp lock: ffff8cb8d776f600/0xf4f48ce5e1bbebe7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049341.799035:0:5848:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.126@tcp lock: ffff8cb8d776f600/0xf4f48ce5e1bbebe7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789049341.799057:0:5848:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb8f73c4000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7ef694ec-1ea0-4f02-800c-d1279b4fdf12:5848:1875954110571264:0@lo:101: 00000100:00100000:3.0:1789049341.800983:0:5848:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789049341.801050:0:5848:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cb8ff336480 going to sleep for 11 seconds 00000100:00100000:1.0:1789049341.801141:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954110571264 00000100:00100000:1.0:1789049341.801151:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954110571264 00000100:00100000:1.0:1789049341.801195:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1789049341.801202:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8c6becc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7ef694ec-1ea0-4f02-800c-d1279b4fdf12+12:5848:x1875954110571264:12345-0@lo:101: 00010000:00010000:1.0:1789049341.801216:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789049341.801230:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cb8c146c000/0xf4f48ce5e1bbebee lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xf4f48ce5e1bbebe7 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049341.801254:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cb8c146c000/0xf4f48ce5e1bbebee lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf4f48ce5e1bbebe7 expref: 13 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049341.801264:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cb8c146c000/0xf4f48ce5e1bbebee lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf4f48ce5e1bbebe7 expref: 13 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049341.801272:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cb8c146c000, rc 0) 00000100:00100000:1.0:1789049341.801349:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8c6becc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7ef694ec-1ea0-4f02-800c-d1279b4fdf12+13:5848:x1875954110571264:12345-0@lo:101: Request processed in 138us (2223us total) trans 0 rc 0/0 00000100:00100000:1.0:1789049341.801356:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1789049341.801729:0:5848:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb8f73c4000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7ef694ec-1ea0-4f02-800c-d1279b4fdf12:5848:1875954110571264:0@lo:101: 00010000:00010000:3.0:1789049341.801747:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.126@tcp lock: ffff8cb8d776f600/0xf4f48ce5e1bbebe7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf4f48ce5e1bbebee expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049341.801756:0:5848:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.126@tcp lock: ffff8cb8d776f600/0xf4f48ce5e1bbebe7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xf4f48ce5e1bbebee expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789049341.801834:0:5848:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb8f73c4000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7ef694ec-1ea0-4f02-800c-d1279b4fdf12:5848:1875954110571392:0@lo:501: 00000100:00100000:3.0:1789049341.801895:0:5848:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789049341.801912:0:5848:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cb8ff336480 going to sleep for 11 seconds 00000100:00100000:2.0:1789049341.801977:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954110571392 00000100:00100000:2.0:1789049341.801982:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954110571392 00000100:00100000:2.0:1789049341.802006:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1789049341.802012:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8c6bee450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7ef694ec-1ea0-4f02-800c-d1279b4fdf12+13:5848:x1875954110571392:12345-0@lo:501: 00000100:00100000:2.0:1789049341.802587:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8c6bee450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7ef694ec-1ea0-4f02-800c-d1279b4fdf12+13:5848:x1875954110571392:12345-0@lo:501: Request processed in 572us (689us total) trans 0 rc 0/0 00000100:00100000:2.0:1789049341.802596:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1789049341.802685:0:5848:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb8f73c4000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7ef694ec-1ea0-4f02-800c-d1279b4fdf12:5848:1875954110571392:0@lo:501: 00000100:00100000:3.0:1789049341.802718:0:5848:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb8f73c4000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7ef694ec-1ea0-4f02-800c-d1279b4fdf12:5848:1875954110571520:0@lo:503: 00000100:00100000:3.0:1789049341.802758:0:5848:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789049341.802797:0:5848:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cb8ff336480 going to sleep for 11 seconds 00000100:00100000:3.0:1789049341.802811:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954110571520 00000100:00100000:3.0:1789049341.802815:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954110571520 00000100:00100000:3.0:1789049341.802871:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1789049341.802879:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8c6bef450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7ef694ec-1ea0-4f02-800c-d1279b4fdf12+13:5848:x1875954110571520:12345-0@lo:503: 00000100:00100000:3.0:1789049341.803163:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8c6bef450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7ef694ec-1ea0-4f02-800c-d1279b4fdf12+13:5848:x1875954110571520:12345-0@lo:503: Request processed in 284us (403us total) trans 0 rc 0/0 00000100:00100000:3.0:1789049341.803176:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1789049341.803215:0:5848:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb8f73c4000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7ef694ec-1ea0-4f02-800c-d1279b4fdf12:5848:1875954110571520:0@lo:503: 00000100:00100000:3.0:1789049341.805558:0:6832:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb8f73c4000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7ef694ec-1ea0-4f02-800c-d1279b4fdf12:6832:1875954110571648:0@lo:502: 00000100:00100000:3.0:1789049341.805632:0:6832:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789049341.805670:0:6832:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cb8ff336d80 going to sleep for 11 seconds 00000100:00100000:1.0:1789049341.805735:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954110571648 00000100:00100000:1.0:1789049341.805743:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954110571648 00000100:00100000:1.0:1789049341.805802:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1789049341.805812:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8d6af9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7ef694ec-1ea0-4f02-800c-d1279b4fdf12+13:6832:x1875954110571648:12345-0@lo:502: 00000100:00100000:1.0:1789049341.806199:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8d6af9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7ef694ec-1ea0-4f02-800c-d1279b4fdf12+13:6832:x1875954110571648:12345-0@lo:502: Request processed in 388us (566us total) trans 0 rc 0/0 00000100:00100000:1.0:1789049341.806207:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1789049341.806316:0:6832:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb8f73c4000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7ef694ec-1ea0-4f02-800c-d1279b4fdf12:6832:1875954110571648:0@lo:502: 00000100:00100000:2.0:1789049341.806379:0:6832:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb8c59c9f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7ef694ec-1ea0-4f02-800c-d1279b4fdf12:6832:1875954110571776:0@lo:502: 00000100:00100000:2.0:1789049341.806424:0:6832:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789049341.806457:0:6832:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cb8c39873c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789049341.806727:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954110571776 00000100:00100000:1.0:1789049341.806732:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954110571776 00000100:00100000:1.0:1789049341.806779:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1789049341.806787:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8d6afb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7ef694ec-1ea0-4f02-800c-d1279b4fdf12+13:6832:x1875954110571776:12345-0@lo:502: 00000100:00100000:1.0:1789049341.806960:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8d6afb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7ef694ec-1ea0-4f02-800c-d1279b4fdf12+13:6832:x1875954110571776:12345-0@lo:502: Request processed in 174us (534us total) trans 0 rc 0/0 00000100:00100000:1.0:1789049341.806966:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1789049341.807527:0:6832:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb8c59c9f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7ef694ec-1ea0-4f02-800c-d1279b4fdf12:6832:1875954110571776:0@lo:502: 00000040:00080000:2.0:1789049341.807560:0:6832:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 30 count 30 00000020:01000000:3.0:1789049341.807709:0:5848:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 21-29 (rc=0) 10000000:01000000:3.0:1789049341.807731:0:5848:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.126@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1789049341.807740:0:5848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.126@tcp lock: ffff8cb8d776f600/0xf4f48ce5e1bbebe7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf4f48ce5e1bbebee expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049341.807751:0:5848:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.126@tcp lock: ffff8cb8d776f600/0xf4f48ce5e1bbebe7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf4f48ce5e1bbebee expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789049341.807761:0:5848:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1789049341.807763:0:5848:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8cb8e01c3000 from 4 10000000:01000000:3.0:1789049341.807777:0:5848:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1789049341.807809:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.126@tcp lock: ffff8cb8d776ea00/0xf4f48ce5e1bbebf5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049341.807817:0:5848:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.126@tcp lock: ffff8cb8d776ea00/0xf4f48ce5e1bbebf5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049341.807827:0:5848:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.126@tcp lock: ffff8cb8d776ea00/0xf4f48ce5e1bbebf5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789049341.807873:0:5848:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb8f73c6d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7ef694ec-1ea0-4f02-800c-d1279b4fdf12:5848:1875954110571904:0@lo:101: 00000100:00100000:3.0:1789049341.807913:0:5848:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789049341.807939:0:5848:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cb8ff336000 going to sleep for 11 seconds 00000100:00100000:1.0:1789049341.808229:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954110571904 00000100:00100000:1.0:1789049341.808235:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954110571904 00000100:00100000:1.0:1789049341.808272:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1789049341.808280:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8d11e1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7ef694ec-1ea0-4f02-800c-d1279b4fdf12+13:5848:x1875954110571904:12345-0@lo:101: 00010000:00010000:1.0:1789049341.808290:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789049341.808303:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cb8c146c600/0xf4f48ce5e1bbebfc lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xf4f48ce5e1bbebf5 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049341.808325:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cb8c146c600/0xf4f48ce5e1bbebfc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf4f48ce5e1bbebf5 expref: 14 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049341.808621:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cb8c146c600/0xf4f48ce5e1bbebfc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf4f48ce5e1bbebf5 expref: 14 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049341.808630:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cb8c146c600, rc 0) 00000100:00100000:1.0:1789049341.808676:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8d11e1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7ef694ec-1ea0-4f02-800c-d1279b4fdf12+14:5848:x1875954110571904:12345-0@lo:101: Request processed in 396us (763us total) trans 0 rc 0/0 00000100:00100000:1.0:1789049341.808684:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1789049341.808825:0:5848:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb8f73c6d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7ef694ec-1ea0-4f02-800c-d1279b4fdf12:5848:1875954110571904:0@lo:101: 00010000:00010000:3.0:1789049341.808838:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.126@tcp lock: ffff8cb8d776ea00/0xf4f48ce5e1bbebf5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf4f48ce5e1bbebfc expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049341.808868:0:5848:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.126@tcp lock: ffff8cb8d776ea00/0xf4f48ce5e1bbebf5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xf4f48ce5e1bbebfc expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789049341.808917:0:5848:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb8f73c6d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7ef694ec-1ea0-4f02-800c-d1279b4fdf12:5848:1875954110572032:0@lo:256: 00000100:00100000:3.0:1789049341.808947:0:5848:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789049341.808971:0:5848:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cb8ff336000 going to sleep for 11 seconds 00000100:00100000:1.0:1789049341.809266:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954110572032 00000100:00100000:1.0:1789049341.809271:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954110572032 00000100:00100000:1.0:1789049341.809295:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1789049341.809300:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8d11e2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7ef694ec-1ea0-4f02-800c-d1279b4fdf12+14:5848:x1875954110572032:12345-0@lo:256: 20000000:01000000:1.0:1789049341.809313:0:5845:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1789049341.810183:0:5845:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1789049341.810190:0:5845:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 4 00000100:00100000:1.0:1789049341.810292:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8d11e2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7ef694ec-1ea0-4f02-800c-d1279b4fdf12+14:5848:x1875954110572032:12345-0@lo:256: Request processed in 990us (1343us total) trans 0 rc 0/0 00000100:00100000:1.0:1789049341.810301:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1789049341.810576:0:5848:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb8f73c6d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7ef694ec-1ea0-4f02-800c-d1279b4fdf12:5848:1875954110572032:0@lo:256: 10000000:01000000:3.0:1789049341.810628:0:5848:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.126@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1789049341.810637:0:5848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.126@tcp lock: ffff8cb8d776ea00/0xf4f48ce5e1bbebf5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf4f48ce5e1bbebfc expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049341.810648:0:5848:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.126@tcp lock: ffff8cb8d776ea00/0xf4f48ce5e1bbebf5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf4f48ce5e1bbebfc expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789049341.810659:0:5848:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:3.0:1789049341.810661:0:5848:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 16 10000000:01000000:3.0:1789049341.810664:0:5848:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:3.0:1789049341.810692:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.126@tcp lock: ffff8cb8d776f200/0xf4f48ce5e1bbec03 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049341.810699:0:5848:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.126@tcp lock: ffff8cb8d776f200/0xf4f48ce5e1bbec03 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049341.810707:0:5848:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.126@tcp lock: ffff8cb8d776f200/0xf4f48ce5e1bbec03 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789049341.810734:0:5848:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb8f73c6d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7ef694ec-1ea0-4f02-800c-d1279b4fdf12:5848:1875954110572160:0@lo:101: 00000100:00100000:3.0:1789049341.810777:0:5848:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789049341.810812:0:5848:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cb8ff336000 going to sleep for 11 seconds 00000100:00100000:2.0:1789049341.811271:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954110572160 00000100:00100000:2.0:1789049341.811279:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954110572160 00000100:00100000:2.0:1789049341.811317:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1789049341.811323:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8d11e0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7ef694ec-1ea0-4f02-800c-d1279b4fdf12+14:5848:x1875954110572160:12345-0@lo:101: 00010000:00010000:2.0:1789049341.811441:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789049341.811456:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cb8d6715200/0xf4f48ce5e1bbec0a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xf4f48ce5e1bbec03 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049341.811479:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cb8d6715200/0xf4f48ce5e1bbec0a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf4f48ce5e1bbec03 expref: 15 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049341.811488:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cb8d6715200/0xf4f48ce5e1bbec0a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf4f48ce5e1bbec03 expref: 15 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049341.811496:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cb8d6715200, rc 0) 00000100:00100000:2.0:1789049341.811544:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8d11e0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7ef694ec-1ea0-4f02-800c-d1279b4fdf12+15:5848:x1875954110572160:12345-0@lo:101: Request processed in 220us (777us total) trans 0 rc 0/0 00000100:00100000:2.0:1789049341.811550:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1789049341.811718:0:5848:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb8f73c6d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7ef694ec-1ea0-4f02-800c-d1279b4fdf12:5848:1875954110572160:0@lo:101: 00010000:00010000:0.0:1789049341.811733:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.126@tcp lock: ffff8cb8d776f200/0xf4f48ce5e1bbec03 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xf4f48ce5e1bbec0a expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049341.811743:0:5848:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.126@tcp lock: ffff8cb8d776f200/0xf4f48ce5e1bbec03 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xf4f48ce5e1bbec0a expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789049341.811811:0:5848:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb8fc99b480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7ef694ec-1ea0-4f02-800c-d1279b4fdf12:5848:1875954110572288:0@lo:501: 00000100:00100000:0.0:1789049341.811869:0:5848:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789049341.811894:0:5848:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cb8c5975e40 going to sleep for 11 seconds 00000100:00100000:1.0:1789049341.811951:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954110572288 00000100:00100000:1.0:1789049341.811956:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954110572288 00000100:00100000:1.0:1789049341.811991:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1789049341.811999:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8d11e1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7ef694ec-1ea0-4f02-800c-d1279b4fdf12+15:5848:x1875954110572288:12345-0@lo:501: 00000100:00100000:1.0:1789049341.813878:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8d11e1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7ef694ec-1ea0-4f02-800c-d1279b4fdf12+15:5848:x1875954110572288:12345-0@lo:501: Request processed in 1873us (2029us total) trans 0 rc 0/0 00000100:00100000:1.0:1789049341.813890:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1789049341.814469:0:5848:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb8fc99b480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7ef694ec-1ea0-4f02-800c-d1279b4fdf12:5848:1875954110572288:0@lo:501: 00000100:00100000:0.0:1789049341.814533:0:5848:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb8fc99b480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7ef694ec-1ea0-4f02-800c-d1279b4fdf12:5848:1875954110572416:0@lo:503: 00000100:00100000:0.0:1789049341.814584:0:5848:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789049341.814620:0:5848:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cb8c5975e40 going to sleep for 11 seconds 00000100:00100000:3.0:1789049341.814675:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954110572416 00000100:00100000:3.0:1789049341.814683:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954110572416 00000100:00100000:3.0:1789049341.814731:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1789049341.814742:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8d11e2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7ef694ec-1ea0-4f02-800c-d1279b4fdf12+15:5848:x1875954110572416:12345-0@lo:503: 00000100:00100000:3.0:1789049341.815089:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8d11e2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7ef694ec-1ea0-4f02-800c-d1279b4fdf12+15:5848:x1875954110572416:12345-0@lo:503: Request processed in 349us (505us total) trans 0 rc 0/0 00000100:00100000:3.0:1789049341.815097:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1789049341.818898:0:5848:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb8fc99b480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7ef694ec-1ea0-4f02-800c-d1279b4fdf12:5848:1875954110572416:0@lo:503: 00000100:00100000:3.0:1789049341.828964:0:6834:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb8f73c5f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7ef694ec-1ea0-4f02-800c-d1279b4fdf12:6834:1875954110572544:0@lo:502: 00000100:00100000:3.0:1789049341.829045:0:6834:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789049341.829085:0:6834:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cb8ff336d80 going to sleep for 11 seconds 00000100:00100000:0.0:1789049341.829153:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954110572544 00000100:00100000:0.0:1789049341.829160:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954110572544 00000100:00100000:0.0:1789049341.829212:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1789049341.829222:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8d11e2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7ef694ec-1ea0-4f02-800c-d1279b4fdf12+15:6834:x1875954110572544:12345-0@lo:502: 00000100:00100000:0.0:1789049341.829745:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8d11e2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7ef694ec-1ea0-4f02-800c-d1279b4fdf12+15:6834:x1875954110572544:12345-0@lo:502: Request processed in 524us (699us total) trans 0 rc 0/0 00000100:00100000:0.0:1789049341.829753:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1789049341.829933:0:6834:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb8f73c5f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7ef694ec-1ea0-4f02-800c-d1279b4fdf12:6834:1875954110572544:0@lo:502: 00000020:01000000:3.0:1789049341.829964:0:6834:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1789049341.829973:0:6834:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-mdt1/mdt1 00000020:00000080:3.0:1789049341.829979:0:6834:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789049341.829981:0:6834:0:(obd_config.c:1563:class_process_config()) marker 12 (0x1) lustre-OST0000 add osc 00000020:00000080:3.0:1789049341.829989:0:6834:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1789049341.829993:0:6834:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.206.126@tcp to nid 0x20000c0a8ce7e (192.168.206.126@tcp) 00000020:01000000:3.0:1789049341.830013:0:6834:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:3.0:1789049341.830015:0:6834:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1789049341.830037:0:6834:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff8cb8c7c6cd40) 00000020:00000080:3.0:1789049341.830058:0:6834:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type osp with refcount 2 00000020:00000080:3.0:1789049341.830063:0:6834:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1789049341.830194:0:6834:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:3.0:1789049341.830204:0:6834:0:(osd_handler.c:1574:osd_obd_connect()) connect #5 00000020:00000080:3.0:1789049341.830211:0:6834:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xf4f48ce5e1bbec18 00010000:00080000:3.0:1789049341.830238:0:6834:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8cb8c6bc4000@lustre-OST0000-osc-MDT0000: add connection 192.168.206.126@tcp at head 00010000:00010000:3.0:1789049341.830718:0:6834:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-3 is initialized 00000040:01000000:2.0:1789049341.915501:0:6834:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000040:01000000:2.0:1789049341.915529:0:6834:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:2.0:1789049341.918489:0:6834:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1789049341.918729:0:6834:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1789049341.918804:0:6834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].1, 64 off8256 00000040:00080000:2.0:1789049341.918902:0:6834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1, 64 off8256 00000040:00080000:3.0:1789049341.922998:0:6838:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1789049341.923005:0:6838:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x3:0x0] at index 1 of catalog [0x1:0x2:0x0] 00000020:00000080:0.0:1789049341.924779:0:6834:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1789049341.924793:0:6834:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:0.0:1789049341.924829:0:6834:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:0.0:1789049341.924880:0:6834:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xf4f48ce5e1bbec1f 00000100:00080000:0.0:1789049341.924891:0:6834:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1789049341.924902:0:6834:0:(import.c:666:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff8cb8c6bc4000 using connection 192.168.206.126@tcp/0@lo 00000100:00100000:0.0:1789049341.924938:0:6834:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8cb8fc998700 x1875954110572672/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1789049341.924961:0:6834:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:0.0:1789049341.925019:0:6834:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789049341.925023:0:6834:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789049341.925026:0:6834:0:(obd_config.c:1563:class_process_config()) marker 12 (0x2) lustre-OST0000 add osc 00000020:01000000:0.0:1789049341.925029:0:6834:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789049341.925032:0:6834:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789049341.925034:0:6834:0:(obd_config.c:1563:class_process_config()) marker 16 (0x1) lustre sys.timeout 00000020:00000080:0.0:1789049341.925038:0:6834:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1789049341.925039:0:6834:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:2.0:1789049341.925329:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb8fc998700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3307:1875954110572672:0@lo:8: 00000100:00100000:2.0:1789049341.925416:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789049341.925461:0:6703:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954110572672 00000100:00100000:3.0:1789049341.925471:0:6703:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954110572672 00000100:00100000:3.0:1789049341.925505:0:6703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1789049341.925513:0:6703:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8c59c9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3307:x1875954110572672:12345-0@lo:8: 00010000:00080000:3.0:1789049341.925538:0:6703:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 167 last 0 00000020:00000080:3.0:1789049341.925563:0:6703:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xf4f48ce5e1bbec26 00002000:00100000:3.0:1789049341.925595:0:6703:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff8cb8df169000 ocd_connect_flags: 0xa044c01443000026 ocd_version: 2113a28 ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:3.0:1789049341.925599:0:6703:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00000001:00000004:3.0:1789049341.925648:0:6703:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967296 00000100:00100000:0.0:1789049341.925950:0:6834:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb8fc998000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7ef694ec-1ea0-4f02-800c-d1279b4fdf12:6834:1875954110572800:0@lo:502: 00000100:00100000:1.0:1789049341.926039:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb8c59c9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3309:1875954110572928:0@lo:400: 00000100:00100000:1.0:1789049341.926080:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789049341.926124:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789049341.926132:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb8c59cb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3311:1875954110573056:0@lo:400: 00000100:00100000:1.0:1789049341.926162:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789049341.926219:0:6834:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789049341.926242:0:6834:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cb8fe2c56c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789049341.926257:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954110572928 00000100:00100000:1.0:1789049341.926264:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954110572800 00000100:00100000:0.0:1789049341.926264:0:5851:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954110572928 00000100:00100000:1.0:1789049341.926271:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954110572800 00000100:00100000:1.0:1789049341.926309:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1789049341.926312:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954110573056 00000100:00100000:0.0:1789049341.926316:0:5851:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954110573056 00000100:00100000:1.0:1789049341.926331:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8d11e3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7ef694ec-1ea0-4f02-800c-d1279b4fdf12+15:6834:x1875954110572800:12345-0@lo:502: 00000100:00100000:0.0:1789049341.926350:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1789049341.926359:0:5851:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8d0ab7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1875954110572928:12345-0@lo:400: 00000100:00100000:0.0:1789049341.926417:0:5851:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8d0ab7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1875954110572928:12345-0@lo:400: Request processed in 58us (335us total) trans 0 rc 0/0 00000100:00100000:2.0:1789049341.926422:0:5850:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:0.0:1789049341.926427:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1789049341.926434:0:5850:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt00_003' 00000100:00100000:0.0:1789049341.926448:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1789049341.926458:0:5851:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8d0ab6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1875954110573056:12345-0@lo:400: 00000100:00100000:0.0:1789049341.926494:0:5851:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8d0ab6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1875954110573056:12345-0@lo:400: Request processed in 38us (332us total) trans 0 rc 0/0 00000100:00100000:0.0:1789049341.926500:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1789049341.929632:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8d11e3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7ef694ec-1ea0-4f02-800c-d1279b4fdf12+15:6834:x1875954110572800:12345-0@lo:502: Request processed in 3295us (3403us total) trans 0 rc 0/0 00000100:00100000:1.0:1789049341.929645:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00080000:1.0:1789049341.929696:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:1.0:1789049341.929735:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8cb8c59c9880 x1875954110572928/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789049357 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789049341.929749:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb8c59c9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3309:1875954110572928:0@lo:400: 00010000:00080000:1.0:1789049341.929795:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8cb8c59cb100 x1875954110573056/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789049357 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789049341.929803:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb8c59cb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3311:1875954110573056:0@lo:400: 00000100:00100000:2.0:1789049341.929959:0:6834:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb8fc998000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7ef694ec-1ea0-4f02-800c-d1279b4fdf12:6834:1875954110572800:0@lo:502: 00000020:01000000:2.0:1789049341.929990:0:6834:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789049341.929997:0:6834:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789049341.930000:0:6834:0:(obd_config.c:1563:class_process_config()) marker 16 (0x2) lustre sys.timeout 00000040:00080000:2.0:1789049341.930004:0:6834:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 25 count 25 00000020:01000000:1.0:1789049341.930168:0:5848:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 16-24 (rc=0) 10000000:01000000:1.0:1789049341.930189:0:5848:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.126@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:1.0:1789049341.930199:0:5848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.126@tcp lock: ffff8cb8d776f200/0xf4f48ce5e1bbec03 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xf4f48ce5e1bbec0a expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049341.930210:0:5848:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.126@tcp lock: ffff8cb8d776f200/0xf4f48ce5e1bbec03 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xf4f48ce5e1bbec0a expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789049341.930219:0:5848:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:1.0:1789049341.930222:0:5848:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff8cb8c59599c0 from 1 10000000:01000000:1.0:1789049341.930224:0:5848:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:1.0:1789049341.930253:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.126@tcp lock: ffff8cb8c146c200/0xf4f48ce5e1bbec2d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049341.930260:0:5848:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.126@tcp lock: ffff8cb8c146c200/0xf4f48ce5e1bbec2d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049341.930281:0:5848:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.126@tcp lock: ffff8cb8c146c200/0xf4f48ce5e1bbec2d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789049341.930300:0:5848:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb8d0ab7b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7ef694ec-1ea0-4f02-800c-d1279b4fdf12:5848:1875954110573184:0@lo:101: 00000100:00100000:1.0:1789049341.930336:0:5848:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789049341.930411:0:5848:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cb7c4e736c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789049341.930486:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954110573184 00000100:00100000:2.0:1789049341.930492:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954110573184 00000100:00100000:2.0:1789049341.930528:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1789049341.930535:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8d11e0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7ef694ec-1ea0-4f02-800c-d1279b4fdf12+15:5848:x1875954110573184:12345-0@lo:101: 00010000:00010000:2.0:1789049341.930547:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789049341.930559:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cb8d6715400/0xf4f48ce5e1bbec34 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xf4f48ce5e1bbec2d expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049341.930581:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cb8d6715400/0xf4f48ce5e1bbec34 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf4f48ce5e1bbec2d expref: 16 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049341.930591:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cb8d6715400/0xf4f48ce5e1bbec34 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf4f48ce5e1bbec2d expref: 16 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049341.930599:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cb8d6715400, rc 0) 00000100:00100000:2.0:1789049341.930628:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8d11e0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7ef694ec-1ea0-4f02-800c-d1279b4fdf12+16:5848:x1875954110573184:12345-0@lo:101: Request processed in 94us (291us total) trans 0 rc 0/0 00000100:00100000:2.0:1789049341.930634:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1789049341.930732:0:5848:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb8d0ab7b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7ef694ec-1ea0-4f02-800c-d1279b4fdf12:5848:1875954110573184:0@lo:101: 00010000:00010000:1.0:1789049341.930744:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.126@tcp lock: ffff8cb8c146c200/0xf4f48ce5e1bbec2d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xf4f48ce5e1bbec34 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049341.930753:0:5848:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.126@tcp lock: ffff8cb8c146c200/0xf4f48ce5e1bbec2d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xf4f48ce5e1bbec34 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789049341.930802:0:5848:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb8d0ab7b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7ef694ec-1ea0-4f02-800c-d1279b4fdf12:5848:1875954110573312:0@lo:501: 00000100:00100000:1.0:1789049341.930823:0:5848:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789049341.930876:0:5848:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cb7c4e736c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789049341.930891:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954110573312 00000100:00100000:1.0:1789049341.930895:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954110573312 00000100:00100000:1.0:1789049341.930937:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1789049341.930943:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8d11e0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7ef694ec-1ea0-4f02-800c-d1279b4fdf12+16:5848:x1875954110573312:12345-0@lo:501: 00000100:00100000:1.0:1789049341.931125:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8d11e0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7ef694ec-1ea0-4f02-800c-d1279b4fdf12+16:5848:x1875954110573312:12345-0@lo:501: Request processed in 181us (300us total) trans 0 rc -2/-2 00000100:00100000:1.0:1789049341.931131:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1789049341.931159:0:5848:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb8d0ab7b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7ef694ec-1ea0-4f02-800c-d1279b4fdf12:5848:1875954110573312:0@lo:501: 10000000:01000000:1.0:1789049341.931179:0:5848:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.126@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:1.0:1789049341.931185:0:5848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.126@tcp lock: ffff8cb8c146c200/0xf4f48ce5e1bbec2d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xf4f48ce5e1bbec34 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049341.931199:0:5848:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.126@tcp lock: ffff8cb8c146c200/0xf4f48ce5e1bbec2d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xf4f48ce5e1bbec34 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00100000:3.0:1789049341.931551:0:6703:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:3.0:1789049341.931692:0:6703:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:3.0:1789049341.931716:0:6703:0:(import.c:65:import_set_state_nolock()) ffff8cb8df168000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1789049341.931815:0:6703:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8c59c9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3307:x1875954110572672:12345-0@lo:8: Request processed in 6301us (6400us total) trans 0 rc 0/0 00000100:00100000:3.0:1789049341.931823:0:6703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:2.0:1789049341.937974:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8cb8fc998700 x1875954110572672/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1789049351 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789049341.937989:0:3307:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1789049341.938010:0:3307:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 1 00000100:00080000:2.0:1789049341.938019:0:3307:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040c01443000026 00000100:00080000:2.0:1789049341.938024:0:3307:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:2.0:1789049341.938028:0:3307:0:(import.c:65:import_set_state_nolock()) ffff8cb8c6bc4000 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:2.0:1789049341.938048:0:3307:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:2.0:1789049341.938054:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb8fc998700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3307:1875954110572672:0@lo:8: 00000004:00080000:2.0:1789049341.941039:0:6838:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:2.0:1789049341.941196:0:6838:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 167993352145ns, next at 0ns, rc = 0 00000004:00080000:0.0:1789049342.051052:0:6840:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x100000000:0x1:0x0] 00000100:00100000:0.0:1789049342.051084:0:6840:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb8fc999f80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6840:1875954110573568:0@lo:7: 00000100:00100000:0.0:1789049342.051153:0:6840:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789049342.051197:0:6840:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cb8d742acc0 going to sleep for 11 seconds 00000100:00100000:0.0:1789049342.051234:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb8fc99ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3311:1875954110573440:0@lo:13: 00000100:00100000:0.0:1789049342.051259:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789049342.051299:0:6705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954110573568 00000100:00100000:0.0:1789049342.051307:0:6705:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954110573568 00000100:00100000:0.0:1789049342.051357:0:6705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1789049342.051368:0:6705:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8fc999880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:6840:x1875954110573568:12345-0@lo:7: 00000100:00080000:1.0:1789049342.054098:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789049342.055816:0:6706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954110573440 00000100:00100000:3.0:1789049342.055830:0:6706:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954110573440 00000100:00100000:3.0:1789049342.056006:0:6706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1789049342.056016:0:6706:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8fc99b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3311:x1875954110573440:12345-0@lo:13: 00002000:00000024:3.0:1789049342.056089:0:6706:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3860856832 avail 3858759680 00000100:00100000:3.0:1789049342.056166:0:6706:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8fc99b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3311:x1875954110573440:12345-0@lo:13: Request processed in 150us (4905us total) trans 0 rc 0/0 00000100:00100000:3.0:1789049342.056181:0:6706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:3.0:1789049342.056244:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8cb8fc99ad80 x1875954110573440/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789049358 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789049342.056264:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb8fc99ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3311:1875954110573440:0@lo:13: 00002000:00080000:0.0:1789049342.062399:0:6705:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x0 00002000:00080000:0.0:1789049342.062407:0:6705:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0000: LAST FID is [0x100000000:0x0:0x0] 00000100:00100000:0.0:1789049342.065702:0:6705:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8fc999880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:6840:x1875954110573568:12345-0@lo:7: Request processed in 14326us (14537us total) trans 0 rc 0/0 00000100:00100000:0.0:1789049342.065725:0:6705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:0.0:1789049342.065809:0:6840:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8cb8fc999f80 x1875954110573568/t0(0) o7->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 264/240 e 0 to 0 dl 1789049358 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789049342.065824:0:6840:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb8fc999f80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6840:1875954110573568:0@lo:7: 00000004:00080000:0.0:1789049342.065838:0:6840:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0000-osc-MDT0000: Got last_fid [0x100000000:0x0:0x0] 00000100:00100000:0.0:1789049342.065895:0:6840:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb8fc999f80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6840:1875954110573696:0@lo:5: 00000100:00100000:0.0:1789049342.065940:0:6840:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789049342.065976:0:6840:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cb8d742acc0 going to sleep for 11 seconds 00000100:00100000:0.0:1789049342.065992:0:6703:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954110573696 00000100:00100000:0.0:1789049342.065998:0:6703:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954110573696 00000100:00100000:0.0:1789049342.066037:0:6703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1789049342.066045:0:6703:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8fc99a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:6840:x1875954110573696:12345-0@lo:5: 00002000:00080000:0.0:1789049342.066069:0:6703:0:(ofd_dev.c:1646:ofd_create_hdl()) ofd_last_id() = 0 -> diff = 1 00002000:00080000:0.0:1789049342.066072:0:6703:0:(ofd_dev.c:1753:ofd_create_hdl()) lustre-OST0000: reserve 1 objects in group 0x0 at 1 00000100:00100000:0.0:1789049342.069027:0:6703:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8fc99a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:6840:x1875954110573696:12345-0@lo:5: Request processed in 2974us (3077us total) trans 4294967297 rc 0/0 00000100:00100000:0.0:1789049342.069038:0:6703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:0.0:1789049342.069101:0:6840:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8cb8fc999f80 x1875954110573696/t0(0) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1789049358 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789049342.069117:0:6840:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb8fc999f80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6840:1875954110573696:0@lo:5: 00000004:00080000:0.0:1789049342.069130:0:6840:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x100000000:0x1:0x0] from OST, last_created [0x100000000:0x1:0x0]last_used is [0x100000000:0x1:0x0] 00000100:00100000:0.0:1789049342.069163:0:6840:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb8fc99bb80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6840:1875954110573824:0@lo:700: 00000100:00100000:0.0:1789049342.069194:0:6840:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789049342.069224:0:6840:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cb8d742acc0 going to sleep for 11 seconds 00000100:00100000:0.0:1789049342.069245:0:6711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954110573824 00000100:00100000:0.0:1789049342.069257:0:6711:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954110573824 00000100:00100000:0.0:1789049342.069296:0:6711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1789049342.069305:0:6711:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8fc998380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+7:6840:x1875954110573824:12345-0@lo:700: 00000100:00100000:0.0:1789049342.069462:0:6711:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb8fc99ad80 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0000_UUID:6711:1875954110573952:0@lo:700: 00000100:00100000:0.0:1789049342.069496:0:6711:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789049342.069515:0:6711:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cb8d742ad80 going to sleep for 11 seconds 00000100:00100000:0.0:1789049342.069538:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954110573952 00000100:00100000:0.0:1789049342.069542:0:5857:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954110573952 00000100:00100000:0.0:1789049342.069569:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1789049342.069575:0:5857:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8fc998700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0000_UUID+5:6711:x1875954110573952:12345-0@lo:700: 00000004:00080000:0.0:1789049342.154795:0:5872:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 40000000:02000000:0.0:1789049342.222444:0:5857:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000240000400-0x0000000280000400]:0:ost 00000100:00100000:1.0:1789049342.235836:0:5857:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8fc998700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0000_UUID+5:6711:x1875954110573952:12345-0@lo:700: Request processed in 166254us (166333us total) trans 0 rc 0/0 00000100:00100000:1.0:1789049342.235875:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:0.0:1789049342.236089:0:6711:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8cb8fc99ad80 x1875954110573952/t0(0) o700->lustre-MDT0000-lwp-OST0000@0@lo:32/10 lens 264/248 e 0 to 0 dl 1789049358 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789049342.236104:0:6711:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb8fc99ad80 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0000_UUID:6711:1875954110573952:0@lo:700: 40000000:02000000:0.0:1789049342.236187:0:6711:0:(fid_request.c:122:seq_client_rpc()) cli-lustre-OST0000-super: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:0:ost] 00000100:00100000:2.0:1789049342.304777:0:6711:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8fc998380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+7:6840:x1875954110573824:12345-0@lo:700: Request processed in 235454us (235563us total) trans 0 rc 0/0 00000100:00100000:2.0:1789049342.304796:0:6711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000001:00080000:3.0:1789049342.304888:0:6731:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967297 is committed 00000001:00100000:3.0:1789049342.304905:0:6731:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00010000:00080000:0.0:1789049342.305085:0:6840:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8cb8fc99bb80 x1875954110573824/t0(0) o700->lustre-OST0000-osc-MDT0000@0@lo:31/4 lens 264/248 e 0 to 0 dl 1789049358 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789049342.305405:0:6840:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb8fc99bb80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6840:1875954110573824:0@lo:700: 00000004:02000040:0.0:1789049342.365109:0:6840:0:(osp_precreate.c:485:osp_precreate_rollover_new_seq()) lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x240000400 00000100:00100000:1.0:1789049342.374416:0:6840:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb8d0ab7b80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6840:1875954110574080:0@lo:5: 00000100:00100000:1.0:1789049342.374487:0:6840:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789049342.374538:0:6840:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cb7c4e739c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789049342.374663:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954110574080 00000100:00100000:0.0:1789049342.374671:0:6704:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954110574080 00000100:00100000:0.0:1789049342.374728:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1789049342.374739:0:6704:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8d0ab6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:6840:x1875954110574080:12345-0@lo:5: 00002000:00080000:1.0:1789049342.386035:0:6704:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x240000400 00002000:00080000:1.0:1789049342.386060:0:6704:0:(ofd_dev.c:1753:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x240000400 at 2 00000100:00100000:1.0:1789049342.395122:0:6704:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8d0ab6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:6840:x1875954110574080:12345-0@lo:5: Request processed in 20378us (20627us total) trans 4294967298 rc 0/0 00000100:00100000:1.0:1789049342.395137:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:0.0:1789049342.395251:0:6840:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8cb8d0ab7b80 x1875954110574080/t0(0) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1789049358 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789049342.395271:0:6840:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967297 gen 2 00000100:00100000:0.0:1789049342.395284:0:6840:0:(client.c:3170:ptlrpc_free_committed()) @@@ stopping search req@ffff8cb8d0ab7b80 x1875954110574080/t4294967298(4294967298) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1789049358 ref 3 fl Rpc:RQU/204/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789049342.395295:0:6840:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb8d0ab7b80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6840:1875954110574080:0@lo:5: 00000004:00080000:0.0:1789049342.395308:0:6840:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x240000400:0x1:0x0]-[0x240000400:0x21:0x0] 00010000:00010000:0.0:1789049342.683104:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789049343.712601:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789049344.731115:0:6719:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789049345.755013:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789049346.782156:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1789049346.793292:0:7078:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg626-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000100:00100000:2.0:1789049346.971113:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb8c59c8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3310:1875954110574464:0@lo:400: 00000100:00100000:2.0:1789049346.971188:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789049346.971244:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789049346.971250:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb8c59ca300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1875954110574592:0@lo:400: 00000100:00100000:2.0:1789049346.971273:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789049346.971305:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954110574464 00000100:00100000:2.0:1789049346.971312:0:5851:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954110574464 00000100:00100000:2.0:1789049346.971366:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1789049346.971375:0:5851:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8c59caa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1875954110574464:12345-0@lo:400: 00000100:00100000:2.0:1789049346.971422:0:5851:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8c59caa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1875954110574464:12345-0@lo:400: Request processed in 48us (234us total) trans 0 rc 0/0 00000100:00100000:2.0:1789049346.971430:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1789049346.971454:0:6705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954110574592 00000100:00100000:2.0:1789049346.971458:0:6705:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954110574592 00000100:00100000:2.0:1789049346.971486:0:6705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1789049346.971492:0:6705:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8c59cb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3310:x1875954110574592:12345-0@lo:400: 00000100:00100000:2.0:1789049346.971533:0:6705:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8c59cb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3310:x1875954110574592:12345-0@lo:400: Request processed in 42us (259us total) trans 0 rc 0/0 00000100:00100000:2.0:1789049346.971540:0:6705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00080000:2.0:1789049346.971557:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1789049346.971561:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:2.0:1789049346.971590:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8cb8c59ca300 x1875954110574592/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789049362 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789049346.971604:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb8c59ca300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1875954110574592:0@lo:400: 00010000:00080000:2.0:1789049346.971614:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8cb8c59c8380 x1875954110574464/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789049362 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789049346.971622:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb8c59c8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3310:1875954110574464:0@lo:400: 00000100:00100000:1.0:1789049346.971768:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb8c59cbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3309:1875954110574336:0@lo:400: 00000100:00100000:1.0:1789049346.971799:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789049346.971825:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1789049346.971831:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb8c59ca680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:7ef694ec-1ea0-4f02-800c-d1279b4fdf12:3309:1875954110574208:0@lo:400: 00000100:00100000:1.0:1789049346.971881:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789049346.971907:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954110574208 00000100:00100000:1.0:1789049346.971910:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954110574208 00000100:00100000:1.0:1789049346.971935:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1789049346.971941:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8c6b82050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7ef694ec-1ea0-4f02-800c-d1279b4fdf12+16:3309:x1875954110574208:12345-0@lo:400: 00000100:00100000:1.0:1789049346.971975:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8c6b82050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7ef694ec-1ea0-4f02-800c-d1279b4fdf12+16:3309:x1875954110574208:12345-0@lo:400: Request processed in 33us (93us total) trans 0 rc 0/0 00000100:00100000:1.0:1789049346.971988:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1789049346.972020:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb8c59ca680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:7ef694ec-1ea0-4f02-800c-d1279b4fdf12:3309:1875954110574208:0@lo:400: 00000100:00100000:2.0:1789049346.972081:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954110574336 00000100:00100000:2.0:1789049346.972141:0:5850:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954110574336 00000100:00100000:2.0:1789049346.972208:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1789049346.972215:0:5850:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8d0ab4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1875954110574336:12345-0@lo:400: 00000100:00100000:2.0:1789049346.972254:0:5850:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8d0ab4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1875954110574336:12345-0@lo:400: Request processed in 39us (454us total) trans 0 rc 0/0 00000100:00100000:2.0:1789049346.972259:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:2.0:1789049346.973026:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8cb8c59cbb80 x1875954110574336/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789049362 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789049346.973039:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb8c59cbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3309:1875954110574336:0@lo:400: 00000100:00100000:2.0:1789049347.485201:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1789049347.485225:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb8c59cbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3309:1875954110574720:0@lo:13: 00000100:00100000:2.0:1789049347.485286:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789049347.485369:0:6706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954110574720 00000100:00100000:3.0:1789049347.485378:0:6706:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954110574720 00000100:00100000:3.0:1789049347.485426:0:6706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1789049347.485435:0:6706:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8c59c8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3309:x1875954110574720:12345-0@lo:13: 00002000:00000024:3.0:1789049347.485463:0:6706:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789049347.485505:0:6706:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8c59c8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3309:x1875954110574720:12345-0@lo:13: Request processed in 71us (218us total) trans 0 rc 0/0 00000100:00100000:3.0:1789049347.485513:0:6706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:3.0:1789049347.485550:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8cb8c59cbb80 x1875954110574720/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789049363 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789049347.485566:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb8c59cbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3309:1875954110574720:0@lo:13: 00000001:00080000:2.0:1789049347.608341:0:6734:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967298 is committed 00010000:00010000:0.0:1789049347.803346:0:6719:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789049348.830006:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789049349.851107:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789049350.875652:0:6719:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789049351.900438:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789049352.091402:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb8fc99bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3310:1875954110574976:0@lo:400: 00000100:00100000:0.0:1789049352.091469:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789049352.091525:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789049352.091532:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb8fc99ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3310:1875954110575104:0@lo:400: 00000100:00100000:0.0:1789049352.091564:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789049352.091603:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954110574976 00000100:00100000:0.0:1789049352.091610:0:5851:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954110574976 00000100:00100000:0.0:1789049352.091653:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954110575104 00000100:00100000:0.0:1789049352.091657:0:5851:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954110575104 00000100:00100000:0.0:1789049352.091685:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1789049352.091694:0:5851:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8fc99b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1875954110574976:12345-0@lo:400: 00000100:00100000:0.0:1789049352.091766:0:5851:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8fc99b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1875954110574976:12345-0@lo:400: Request processed in 72us (295us total) trans 0 rc 0/0 00000100:00100000:0.0:1789049352.091773:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1789049352.091789:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1789049352.091796:0:5851:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8fc999180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1875954110575104:12345-0@lo:400: 00000100:00100000:0.0:1789049352.091872:0:5851:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8fc999180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1875954110575104:12345-0@lo:400: Request processed in 76us (306us total) trans 0 rc 0/0 00000100:00100000:0.0:1789049352.091879:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00080000:0.0:1789049352.091902:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:0.0:1789049352.091931:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8cb8fc99ad80 x1875954110575104/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789049368 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789049352.091955:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb8fc99ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3310:1875954110575104:0@lo:400: 00010000:00080000:0.0:1789049352.091967:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8cb8fc99bb80 x1875954110574976/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789049368 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789049352.091974:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb8fc99bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3310:1875954110574976:0@lo:400: 00000100:00100000:2.0:1789049352.093070:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb8fc998000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1875954110575232:0@lo:400: 00000100:00100000:2.0:1789049352.093246:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789049352.093293:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789049352.093300:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb8fc999f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7ef694ec-1ea0-4f02-800c-d1279b4fdf12:3308:1875954110574848:0@lo:400: 00000100:00100000:2.0:1789049352.093329:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789049352.094285:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954110575232 00000100:00100000:0.0:1789049352.094294:0:6704:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954110575232 00000100:00100000:0.0:1789049352.094353:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1789049352.094364:0:6704:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8c59ca300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3308:x1875954110575232:12345-0@lo:400: 00000100:00100000:0.0:1789049352.094429:0:6704:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8c59ca300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3308:x1875954110575232:12345-0@lo:400: Request processed in 69us (1182us total) trans 0 rc 0/0 00000100:00100000:0.0:1789049352.094435:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1789049352.094457:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954110574848 00000100:00100000:0.0:1789049352.094461:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954110574848 00000100:00100000:0.0:1789049352.094487:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1789049352.094494:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8c6b83050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7ef694ec-1ea0-4f02-800c-d1279b4fdf12+16:3308:x1875954110574848:12345-0@lo:400: 00000100:00100000:0.0:1789049352.094523:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8c6b83050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7ef694ec-1ea0-4f02-800c-d1279b4fdf12+16:3308:x1875954110574848:12345-0@lo:400: Request processed in 30us (1193us total) trans 0 rc 0/0 00000100:00100000:0.0:1789049352.094529:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1789049352.094573:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb8fc999f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7ef694ec-1ea0-4f02-800c-d1279b4fdf12:3308:1875954110574848:0@lo:400: 00010000:00080000:0.0:1789049352.094602:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8cb8fc998000 x1875954110575232/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789049368 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789049352.094613:0:3308:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967298 gen 2 00000100:00100000:0.0:1789049352.094626:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb8fc998000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1875954110575232:0@lo:400: 00000100:00080000:2.0:1789049352.094756:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789049352.604392:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789049352.604418:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb8fc998000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1875954110575360:0@lo:13: 00000100:00100000:0.0:1789049352.604480:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789049352.604549:0:6706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954110575360 00000100:00100000:0.0:1789049352.604557:0:6706:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954110575360 00000100:00100000:0.0:1789049352.604603:0:6706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1789049352.604611:0:6706:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8fc999f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1875954110575360:12345-0@lo:13: 00002000:00000024:0.0:1789049352.604646:0:6706:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789049352.604687:0:6706:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8fc999f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1875954110575360:12345-0@lo:13: Request processed in 77us (207us total) trans 0 rc 0/0 00000100:00100000:0.0:1789049352.604694:0:6706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:0.0:1789049352.604741:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8cb8fc998000 x1875954110575360/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789049368 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789049352.604758:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb8fc998000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1875954110575360:0@lo:13: 00010000:00010000:0.0:1789049352.932367:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789049353.950290:0:6719:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789049354.970974:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789049355.995283:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789049357.024301:0:6719:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789049357.212075:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb8c59cb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3311:1875954110575616:0@lo:400: 00000100:00100000:2.0:1789049357.212138:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789049357.212190:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1789049357.212197:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb8c59c9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:7ef694ec-1ea0-4f02-800c-d1279b4fdf12:3311:1875954110575488:0@lo:400: 00000100:00100000:2.0:1789049357.212224:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789049357.212254:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb8c59cad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3308:1875954110575744:0@lo:400: 00000100:00100000:2.0:1789049357.212290:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789049357.212306:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789049357.212311:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb8c59c8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1875954110575872:0@lo:400: 00000100:00100000:2.0:1789049357.212329:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789049357.212356:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954110575616 00000100:00100000:2.0:1789049357.212362:0:5851:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954110575616 00000100:00100000:2.0:1789049357.212398:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954110575744 00000100:00100000:2.0:1789049357.212400:0:5851:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954110575744 00000100:00100000:2.0:1789049357.212427:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1789049357.212434:0:5851:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8c59c9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1875954110575616:12345-0@lo:400: 00000100:00100000:2.0:1789049357.212475:0:5851:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8c59c9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1875954110575616:12345-0@lo:400: Request processed in 42us (337us total) trans 0 rc 0/0 00000100:00100000:2.0:1789049357.212482:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1789049357.212494:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1789049357.212500:0:5851:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8c59c8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1875954110575744:12345-0@lo:400: 00000100:00100000:2.0:1789049357.212537:0:5851:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8c59c8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1875954110575744:12345-0@lo:400: Request processed in 37us (247us total) trans 0 rc 0/0 00000100:00100000:2.0:1789049357.212543:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1789049357.212560:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954110575488 00000100:00100000:2.0:1789049357.212562:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954110575488 00000100:00100000:2.0:1789049357.212581:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1789049357.212586:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8c6b80050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7ef694ec-1ea0-4f02-800c-d1279b4fdf12+16:3311:x1875954110575488:12345-0@lo:400: 00000100:00100000:2.0:1789049357.212610:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8c6b80050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7ef694ec-1ea0-4f02-800c-d1279b4fdf12+16:3311:x1875954110575488:12345-0@lo:400: Request processed in 24us (386us total) trans 0 rc 0/0 00000100:00100000:2.0:1789049357.212615:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1789049357.212638:0:6703:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954110575872 00000100:00100000:2.0:1789049357.212641:0:6703:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954110575872 00000100:00100000:2.0:1789049357.212664:0:6703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1789049357.212669:0:6703:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8c59c9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3308:x1875954110575872:12345-0@lo:400: 00000100:00100000:2.0:1789049357.212709:0:6703:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8c59c9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3308:x1875954110575872:12345-0@lo:400: Request processed in 39us (378us total) trans 0 rc 0/0 00000100:00100000:2.0:1789049357.212714:0:6703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00080000:2.0:1789049357.212732:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1789049357.212736:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:2.0:1789049357.212774:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8cb8c59c8000 x1875954110575872/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789049373 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789049357.212786:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb8c59c8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1875954110575872:0@lo:400: 00010000:00080000:2.0:1789049357.212809:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8cb8c59cad80 x1875954110575744/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789049373 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789049357.212817:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb8c59cad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3308:1875954110575744:0@lo:400: 00000100:00100000:2.0:1789049357.212874:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb8c59c9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:7ef694ec-1ea0-4f02-800c-d1279b4fdf12:3311:1875954110575488:0@lo:400: 00010000:00080000:2.0:1789049357.212891:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8cb8c59cb800 x1875954110575616/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789049373 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789049357.212899:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb8c59cb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3311:1875954110575616:0@lo:400: 00000100:00100000:3.0:1789049357.740908:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789049357.740933:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb8f73c5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3311:1875954110576000:0@lo:13: 00000100:00100000:3.0:1789049357.740997:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789049357.741195:0:6706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954110576000 00000100:00100000:0.0:1789049357.741203:0:6706:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954110576000 00000100:00100000:0.0:1789049357.741247:0:6706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1789049357.741256:0:6706:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8f73c5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1875954110576000:12345-0@lo:13: 00002000:00000024:0.0:1789049357.741300:0:6706:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789049357.741354:0:6706:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8f73c5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1875954110576000:12345-0@lo:13: Request processed in 99us (357us total) trans 0 rc 0/0 00000100:00100000:0.0:1789049357.741361:0:6706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:0.0:1789049357.741420:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8cb8f73c5f80 x1875954110576000/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789049373 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789049357.741437:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb8f73c5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3311:1875954110576000:0@lo:13: 00010000:00010000:3.0:1789049358.042992:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:3.0:1789049358.971114:0:7645:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:3.0:1789049358.971118:0:7645:0:(obd_mount.c:926:lmd_print()) device: lustre-ost2/ost2 00000080:01200004:3.0:1789049358.971292:0:7645:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff8cb8c631b800 00000020:01000004:3.0:1789049358.971309:0:7645:0:(tgt_mount.c:2502:osd_start()) Attempting to start lustre-OST0001, type=osd-zfs, lsifl=200062, mountfl=0 00000020:01000004:3.0:1789049358.971324:0:7645:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0001-osd (typ=osd-zfs) 00000020:00000080:3.0:1789049358.971341:0:7645:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osd (ffff8cb8c7c68000) 00000020:00000080:3.0:1789049358.971357:0:7645:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type osd-zfs with refcount 2 00100000:10000000:3.0:1789049358.987651:0:7645:0:(scrub.c:230:scrub_file_store()) lustre-OST0001: store scrub file: rc = 0 00100000:10000000:3.0:1789049358.988080:0:7645:0:(scrub.c:230:scrub_file_store()) lustre-OST0001: store scrub file: rc = 0 00100000:10000000:3.0:1789049359.008423:0:7645:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000001:0x1017:0x0] => 0 (CONFIGS): rc = 1 00100000:10000000:3.0:1789049359.014144:0:7645:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:3.0:1789049359.014179:0:7645:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000001:0x3:0x0] => 0 (fld): rc = 1 00100000:10000000:3.0:1789049359.014295:0:7645:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:3.0:1789049359.014324:0:7645:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00000020:00000080:3.0:1789049359.014614:0:7645:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00080000:01000000:3.0:1789049359.014625:0:7645:0:(osd_handler.c:1574:osd_obd_connect()) connect #0 00000020:00000080:3.0:1789049359.014633:0:7645:0:(genops.c:1384:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0xf4f48ce5e1bbec42 00000020:01000004:3.0:1789049359.014639:0:7645:0:(tgt_mount.c:2587:server_fill_super()) Found service lustre-OST0001 on device lustre-ost2/ost2 00000020:01000004:3.0:1789049359.014657:0:7645:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.206.126@tcp:Set MGC reconnect 1 10000000:01000000:3.0:1789049359.014660:0:7645:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.206.126@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:3.0:1789049359.014664:0:7645:0:(tgt_mount.c:1808:server_start_targets()) starting target lustre-OST0001 00000020:01000004:3.0:1789049359.014693:0:7645:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost2/ost2 10000000:01000000:3.0:1789049359.014697:0:7645:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.206.126@tcp: cl_mgc_mutex lustre-OST0001-osd for locked: rc = 0 00000040:01000000:1.0:1789049359.032584:0:7645:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.206.126@tcp ctxt 0 is initialized 00000020:01000004:1.0:1789049359.032620:0:7645:0:(tgt_mount.c:1416:server_register_target()) Registration lustre-OST0001, fs=lustre, 192.168.206.126@tcp, index=0001, flags=0x20062 00000020:01000004:1.0:1789049359.032624:0:7645:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:1.0:1789049359.032626:0:7645:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1789049359.032628:0:7645:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1789049359.032629:0:7645:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1789049359.032630:0:7645:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1789049359.032631:0:7645:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1789049359.032633:0:7645:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1789049359.032634:0:7645:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1789049359.032636:0:7645:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1789049359.032637:0:7645:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1789049359.032638:0:7645:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1789049359.032641:0:7645:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x10020062 00000020:01000004:1.0:1789049359.032643:0:7645:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1789049359.032645:0:7645:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1789049359.032646:0:7645:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1789049359.032647:0:7645:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1789049359.032648:0:7645:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1789049359.032649:0:7645:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1789049359.032650:0:7645:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1789049359.032651:0:7645:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1789049359.032652:0:7645:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1789049359.032653:0:7645:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1789049359.032655:0:7645:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1789049359.032689:0:7645:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:1.0:1789049359.032706:0:7645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb8d0ab5f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7ef694ec-1ea0-4f02-800c-d1279b4fdf12:7645:1875954110576128:0@lo:253: 00000100:00100000:1.0:1789049359.032767:0:7645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789049359.032934:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954110576128 00000100:00100000:0.0:1789049359.032941:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954110576128 00000100:00100000:0.0:1789049359.033040:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1789049359.033049:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8c6b80c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7ef694ec-1ea0-4f02-800c-d1279b4fdf12+16:7645:x1875954110576128:12345-0@lo:253: 20000000:01000000:0.0:1789049359.033078:0:5843:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:0.0:1789049359.033082:0:5843:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-OST0001, index=1 20000000:01000000:0.0:1789049359.033086:0:5843:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-OST0001 to 1 20000000:01000000:0.0:1789049359.033089:0:5843:0:(mgs_llog.c:3862:mgs_write_log_ost()) writing new ost lustre-OST0001 00000100:00100000:1.0:1789049359.033833:0:7645:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cb8c5975a80 going to sleep for 11 seconds 00000040:00080000:1.0:1789049359.034447:0:5843:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1789049359.034661:0:5843:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 20000000:01000000:1.0:1789049359.034687:0:5843:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001 0xcf001 obdfilter lustre-OST0001_UUID (null) (null) 00000040:00080000:1.0:1789049359.034727:0:5843:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 128 off8544 20000000:01000000:1.0:1789049359.034735:0:5843:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001 0xcf003 dev type f (null) 00000040:00080000:1.0:1789049359.034768:0:5843:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 112 off8656 00000040:00080000:1.0:1789049359.034817:0:5843:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8880 00000040:00080000:1.0:1789049359.035359:0:5843:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 224 off12648 20000000:01000000:1.0:1789049359.035378:0:5843:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.206.126@tcp 20000000:01000000:1.0:1789049359.035380:0:5843:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.206.126@tcp (null) (null) (null) 00000040:00080000:1.0:1789049359.035416:0:5843:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 88 off12736 20000000:01000000:1.0:1789049359.035424:0:5843:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0000 0xcf001 osc lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:1.0:1789049359.035471:0:5843:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 144 off12880 20000000:01000000:1.0:1789049359.035480:0:5843:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0000 0xcf003 lustre-OST0001_UUID 192.168.206.126@tcp (null) (null) 00000040:00080000:1.0:1789049359.035513:0:5843:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 152 off13032 20000000:01000000:1.0:1789049359.035523:0:5843:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:1.0:1789049359.035556:0:5843:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 136 off13168 00000040:00080000:1.0:1789049359.035606:0:5843:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13392 00000040:00080000:1.0:1789049359.038783:0:5843:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].30, 224 off13416 20000000:01000000:1.0:1789049359.038813:0:5843:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.206.126@tcp 20000000:01000000:1.0:1789049359.038816:0:5843:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.206.126@tcp (null) (null) (null) 00000040:00080000:1.0:1789049359.038880:0:5843:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].31, 88 off13504 20000000:01000000:1.0:1789049359.038889:0:5843:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc 0xcf001 osc lustre-clilov_UUID (null) (null) 00000040:00080000:1.0:1789049359.038937:0:5843:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].32, 128 off13632 20000000:01000000:1.0:1789049359.038945:0:5843:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc 0xcf003 lustre-OST0001_UUID 192.168.206.126@tcp (null) (null) 00000040:00080000:1.0:1789049359.038977:0:5843:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].33, 144 off13776 20000000:01000000:1.0:1789049359.038986:0:5843:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:1.0:1789049359.039032:0:5843:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].34, 128 off13904 00000040:00080000:1.0:1789049359.039069:0:5843:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].35, 224 off14128 20000000:01000000:1.0:1789049359.039086:0:5843:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' autodegrade=on ', param: 'sys.timeout=20' 20000000:01000000:1.0:1789049359.039089:0:5843:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:1.0:1789049359.039100:0:5843:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:1.0:1789049359.039112:0:5843:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:1.0:1789049359.039115:0:5843:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:1.0:1789049359.039150:0:5843:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:1.0:1789049359.039153:0:5843:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:0.0:1789049359.040178:0:7647:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 27 marker 14 1->4: lustre sys.timeout 20000000:01000000:0.0:1789049359.040249:0:7647:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 29 marker 14 2->4: lustre sys.timeout 00000040:00080000:0.0:1789049359.040298:0:7647:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 36 count 36 00000040:00080000:1.0:1789049359.040754:0:5843:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].36, 224 off14352 00000040:00080000:1.0:1789049359.040796:0:5843:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].37, 80 off14432 00000040:00080000:1.0:1789049359.040830:0:5843:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].38, 224 off14656 20000000:01000000:1.0:1789049359.040976:0:5843:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:1.0:1789049359.040979:0:5843:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.timeout fl=4 20000000:01000000:2.0:1789049359.041870:0:7648:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 5 marker 15 1->4: lustre sys.timeout 20000000:01000000:2.0:1789049359.041955:0:7648:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 7 marker 15 2->4: lustre sys.timeout 00000040:00080000:2.0:1789049359.042050:0:7648:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 8 count 8 00000040:00080000:1.0:1789049359.042301:0:5843:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 224 off9632 00000040:00080000:1.0:1789049359.042337:0:5843:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 80 off9712 00000040:00080000:1.0:1789049359.042444:0:5843:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].10, 224 off9936 20000000:01000000:1.0:1789049359.042455:0:5843:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0001 20000000:01000000:1.0:1789049359.042457:0:5843:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0001/lustre/sys.timeout fl=4 00000040:00080000:1.0:1789049359.044749:0:7649:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 5 count 5 00000040:00080000:2.0:1789049359.045167:0:5843:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9104 00000040:00080000:2.0:1789049359.045217:0:5843:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 80 off9184 00000040:00080000:2.0:1789049359.045304:0:5843:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 224 off9408 20000000:01000000:2.0:1789049359.045319:0:5843:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:2.0:1789049359.045322:0:5843:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:0.0:1789049359.046807:0:7650:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 22 marker 16 1->4: lustre sys.timeout 20000000:01000000:0.0:1789049359.047341:0:7650:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 24 marker 16 2->4: lustre sys.timeout 00000040:00080000:0.0:1789049359.047406:0:7650:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 31 count 31 00000040:00080000:2.0:1789049359.047710:0:5843:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 224 off13616 00000040:00080000:2.0:1789049359.047751:0:5843:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 80 off13696 00000040:00080000:2.0:1789049359.047828:0:5843:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 224 off13920 20000000:01000000:2.0:1789049359.048148:0:5843:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'autodegrade=on' 20000000:01000000:2.0:1789049359.048152:0:5843:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'autodegrade=on' 10000000:01000000:2.0:1789049359.048160:0:5843:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:2.0:1789049359.048361:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8cb8d6715a00/0xf4f48ce5e1bbec49 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049359.048379:0:5843:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8cb8d6715800/0xf4f48ce5e1bbeb9a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf4f48ce5e1bbeb93 expref: 16 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049359.048387:0:5843:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8cb8c146d200/0xf4f48ce5e1bbebc4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf4f48ce5e1bbebbd expref: 16 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049359.048393:0:5843:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8cb8c146c000/0xf4f48ce5e1bbebee lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf4f48ce5e1bbebe7 expref: 16 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049359.048400:0:5843:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8cb8d6715200/0xf4f48ce5e1bbec0a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf4f48ce5e1bbec03 expref: 16 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049359.048414:0:5843:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8cb8d6715400/0xf4f48ce5e1bbec34 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf4f48ce5e1bbec2d expref: 16 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049359.048421:0:5843:0:(ldlm_resource.c:1751:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8cb8d6715a00/0xf4f48ce5e1bbec49 lrc: 8/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049359.048460:0:5843:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8cb8d6715400/0xf4f48ce5e1bbec34 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf4f48ce5e1bbec2d expref: 16 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049359.048474:0:5843:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8cb8d6715400/0xf4f48ce5e1bbec34 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf4f48ce5e1bbec2d expref: 16 pid: 5844 timeout: 335 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789049359.048487:0:5843:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb8c59cb800 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5843:1875954110576256:0@lo:104: 00000100:00100000:2.0:1789049359.048550:0:5843:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1789049359.048643:0:5843:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8cb8d6715200/0xf4f48ce5e1bbec0a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf4f48ce5e1bbec03 expref: 16 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049359.048652:0:5843:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8cb8d6715200/0xf4f48ce5e1bbec0a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf4f48ce5e1bbec03 expref: 16 pid: 5843 timeout: 335 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789049359.048659:0:5843:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb8c59c9880 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5843:1875954110576384:0@lo:104: 00010000:00010000:2.0:1789049359.048694:0:5843:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8cb8c146c000/0xf4f48ce5e1bbebee lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf4f48ce5e1bbebe7 expref: 16 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049359.048701:0:5843:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8cb8c146c000/0xf4f48ce5e1bbebee lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf4f48ce5e1bbebe7 expref: 16 pid: 5845 timeout: 335 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789049359.048709:0:5843:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb8c59cad80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5843:1875954110576512:0@lo:104: 00010000:00010000:2.0:1789049359.048729:0:5843:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8cb8c146d200/0xf4f48ce5e1bbebc4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf4f48ce5e1bbebbd expref: 16 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049359.048742:0:5843:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8cb8c146d200/0xf4f48ce5e1bbebc4 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf4f48ce5e1bbebbd expref: 16 pid: 5845 timeout: 335 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789049359.048749:0:5843:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb8c59c8000 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5843:1875954110576640:0@lo:104: 00010000:00010000:2.0:1789049359.048772:0:5843:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8cb8d6715800/0xf4f48ce5e1bbeb9a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf4f48ce5e1bbeb93 expref: 16 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049359.048779:0:5843:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8cb8d6715800/0xf4f48ce5e1bbeb9a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf4f48ce5e1bbeb93 expref: 16 pid: 5845 timeout: 335 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789049359.048785:0:5843:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb8c59cb480 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5843:1875954110576768:0@lo:104: 00000100:00100000:2.0:1789049359.048800:0:5843:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cb8c62d9d80 going to sleep for 11 seconds 00000100:00100000:3.0:1789049359.049139:0:5834:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:3.0:1789049359.049159:0:5834:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789049359.049183:0:5834:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789049359.049242:0:5834:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789049359.049425:0:5834:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789049359.049440:0:6718:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954110576256 00000100:00100000:2.0:1789049359.049446:0:6718:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954110576256 00000100:00100000:2.0:1789049359.049481:0:6718:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954110576384 00000100:00100000:2.0:1789049359.049484:0:6718:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954110576384 00000100:00100000:2.0:1789049359.049505:0:6718:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954110576512 00000100:00100000:2.0:1789049359.049508:0:6718:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954110576512 00000100:00100000:2.0:1789049359.049531:0:6718:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954110576640 00000100:00100000:2.0:1789049359.049534:0:6718:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954110576640 00000100:00100000:2.0:1789049359.049547:0:6718:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1789049359.049556:0:6718:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8f3031c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:7ef694ec-1ea0-4f02-800c-d1279b4fdf12+6:5843:x1875954110576256:12345-0@lo:104: 00010000:00010000:2.0:1789049359.049569:0:6718:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.126@tcp lock: ffff8cb8c146c200/0xf4f48ce5e1bbec2d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xf4f48ce5e1bbec34 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049359.049631:0:6718:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1789049359.049638:0:6718:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8f3031c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:7ef694ec-1ea0-4f02-800c-d1279b4fdf12+6:5843:x1875954110576256:12345-0@lo:104: Request processed in 83us (1088us total) trans 0 rc 0/0 00000100:00100000:2.0:1789049359.049653:0:6718:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1789049359.049699:0:6718:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1789049359.049705:0:6718:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8f73c7100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:7ef694ec-1ea0-4f02-800c-d1279b4fdf12+5:5843:x1875954110576384:12345-0@lo:104: 00010000:00010000:2.0:1789049359.049713:0:6718:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.126@tcp lock: ffff8cb8d776f200/0xf4f48ce5e1bbec03 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xf4f48ce5e1bbec0a expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049359.049747:0:6718:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1789049359.049752:0:6718:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8f73c7100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:7ef694ec-1ea0-4f02-800c-d1279b4fdf12+5:5843:x1875954110576384:12345-0@lo:104: Request processed in 49us (593us total) trans 0 rc 0/0 00000100:00100000:2.0:1789049359.049758:0:6718:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1789049359.049771:0:6718:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1789049359.049776:0:6718:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8f73c6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:7ef694ec-1ea0-4f02-800c-d1279b4fdf12+4:5843:x1875954110576512:12345-0@lo:104: 00010000:00010000:2.0:1789049359.049783:0:6718:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.126@tcp lock: ffff8cb8d776f600/0xf4f48ce5e1bbebe7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xf4f48ce5e1bbebee expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049359.049815:0:6718:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:2.0:1789049359.049821:0:6718:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8f73c6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:7ef694ec-1ea0-4f02-800c-d1279b4fdf12+4:5843:x1875954110576512:12345-0@lo:104: Request processed in 45us (638us total) trans 0 rc 0/0 00000100:00100000:2.0:1789049359.049826:0:6718:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1789049359.049838:0:6718:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1789049359.049871:0:6718:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8f73c7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:7ef694ec-1ea0-4f02-800c-d1279b4fdf12+3:5843:x1875954110576640:12345-0@lo:104: 00010000:00010000:2.0:1789049359.049879:0:6718:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.126@tcp lock: ffff8cb8d6714600/0xf4f48ce5e1bbebbd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xf4f48ce5e1bbebc4 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049359.049907:0:6718:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:2.0:1789049359.049912:0:6718:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8f73c7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:7ef694ec-1ea0-4f02-800c-d1279b4fdf12+3:5843:x1875954110576640:12345-0@lo:104: Request processed in 43us (679us total) trans 0 rc 0/0 00000100:00100000:2.0:1789049359.049924:0:6718:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00010000:00010000:2.0:1789049359.049941:0:5839:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:2.0:1789049359.049947:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.126@tcp lock: ffff8cb8c146c200/0xf4f48ce5e1bbec2d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xf4f48ce5e1bbec34 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049359.049954:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cb8c146c200 already unused, calling callback (ffffffffc1ca3c20) 10000000:00010000:2.0:1789049359.049959:0:5839:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.126@tcp lock: ffff8cb8c146c200/0xf4f48ce5e1bbec2d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0xf4f48ce5e1bbec34 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049359.049980:0:5839:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.126@tcp lock: ffff8cb8c146c200/0xf4f48ce5e1bbec2d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0xf4f48ce5e1bbec34 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789049359.049988:0:5839:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.126@tcp lock: ffff8cb8c146c200/0xf4f48ce5e1bbec2d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0xf4f48ce5e1bbec34 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789049359.049995:0:5839:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00000100:00100000:1.0:1789049359.050214:0:5843:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb8c59cb800 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5843:1875954110576256:0@lo:104: 00000100:00100000:1.0:1789049359.050224:0:5843:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb8c59c9880 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5843:1875954110576384:0@lo:104: 00000100:00100000:1.0:1789049359.050230:0:5843:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb8c59cad80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5843:1875954110576512:0@lo:104: 00000100:00100000:1.0:1789049359.050313:0:5843:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb8c59c8000 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5843:1875954110576640:0@lo:104: 00010000:00010000:2.0:1789049359.050705:0:5839:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.126@tcp lock: ffff8cb8c146c200/0xf4f48ce5e1bbec2d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf4f48ce5e1bbec34 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049359.050713:0:5839:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789049359.050744:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.126@tcp lock: ffff8cb8c146c200/0xf4f48ce5e1bbec2d lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf4f48ce5e1bbec34 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049359.050752:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.126@tcp lock: ffff8cb8c146c200/0xf4f48ce5e1bbec2d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf4f48ce5e1bbec34 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049359.050763:0:5839:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1789049359.050766:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.126@tcp lock: ffff8cb8d776f200/0xf4f48ce5e1bbec03 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xf4f48ce5e1bbec0a expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049359.050788:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cb8d776f200 already unused, calling callback (ffffffffc1ca3c20) 10000000:00010000:2.0:1789049359.050792:0:5839:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.126@tcp lock: ffff8cb8d776f200/0xf4f48ce5e1bbec03 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0xf4f48ce5e1bbec0a expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049359.050799:0:5839:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.126@tcp lock: ffff8cb8d776f200/0xf4f48ce5e1bbec03 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0xf4f48ce5e1bbec0a expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789049359.050805:0:5839:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.126@tcp lock: ffff8cb8d776f200/0xf4f48ce5e1bbec03 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0xf4f48ce5e1bbec0a expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789049359.050810:0:5839:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1789049359.050824:0:5839:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.126@tcp lock: ffff8cb8d776f200/0xf4f48ce5e1bbec03 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf4f48ce5e1bbec0a expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789049359.050826:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954110576768 00010000:00010000:2.0:1789049359.050830:0:5839:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:3.0:1789049359.050832:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954110576768 00010000:00010000:2.0:1789049359.050864:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.126@tcp lock: ffff8cb8d776f200/0xf4f48ce5e1bbec03 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf4f48ce5e1bbec0a expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049359.050871:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.126@tcp lock: ffff8cb8d776f200/0xf4f48ce5e1bbec03 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf4f48ce5e1bbec0a expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789049359.050875:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00010000:00010000:2.0:1789049359.050880:0:5839:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00000100:00100000:3.0:1789049359.050882:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8f73c4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:7ef694ec-1ea0-4f02-800c-d1279b4fdf12+3:5843:x1875954110576768:12345-0@lo:104: 00010000:00010000:2.0:1789049359.050883:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.126@tcp lock: ffff8cb8d776f600/0xf4f48ce5e1bbebe7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xf4f48ce5e1bbebee expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049359.050889:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cb8d776f600 already unused, calling callback (ffffffffc1ca3c20) 10000000:00010000:2.0:1789049359.050891:0:5839:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.126@tcp lock: ffff8cb8d776f600/0xf4f48ce5e1bbebe7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xf4f48ce5e1bbebee expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049359.050895:0:5834:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.126@tcp lock: ffff8cb7c4c38a00/0xf4f48ce5e1bbeb93 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xf4f48ce5e1bbeb9a expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049359.050905:0:5839:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.126@tcp lock: ffff8cb8d776f600/0xf4f48ce5e1bbebe7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xf4f48ce5e1bbebee expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789049359.050911:0:5839:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.126@tcp lock: ffff8cb8d776f600/0xf4f48ce5e1bbebe7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xf4f48ce5e1bbebee expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789049359.050916:0:5839:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1789049359.050928:0:5839:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.126@tcp lock: ffff8cb8d776f600/0xf4f48ce5e1bbebe7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf4f48ce5e1bbebee expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049359.050934:0:5839:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789049359.050937:0:5834:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00010000:00010000:2.0:1789049359.050939:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.126@tcp lock: ffff8cb8d776f600/0xf4f48ce5e1bbebe7 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf4f48ce5e1bbebee expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789049359.050942:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8f73c4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:7ef694ec-1ea0-4f02-800c-d1279b4fdf12+3:5843:x1875954110576768:12345-0@lo:104: Request processed in 61us (1536us total) trans 0 rc 0/0 00010000:00010000:2.0:1789049359.050946:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.126@tcp lock: ffff8cb8d776f600/0xf4f48ce5e1bbebe7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf4f48ce5e1bbebee expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789049359.050949:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00010000:2.0:1789049359.050954:0:5839:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1789049359.050956:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.126@tcp lock: ffff8cb8d6714600/0xf4f48ce5e1bbebbd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xf4f48ce5e1bbebc4 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049359.050962:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cb8d6714600 already unused, calling callback (ffffffffc1ca3c20) 00010000:00010000:3.0:1789049359.050964:0:5838:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 10000000:00010000:2.0:1789049359.050965:0:5839:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.126@tcp lock: ffff8cb8d6714600/0xf4f48ce5e1bbebbd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xf4f48ce5e1bbebc4 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049359.050968:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.126@tcp lock: ffff8cb7c4c38a00/0xf4f48ce5e1bbeb93 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xf4f48ce5e1bbeb9a expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049359.050972:0:5839:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.126@tcp lock: ffff8cb8d6714600/0xf4f48ce5e1bbebbd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xf4f48ce5e1bbebc4 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049359.050974:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cb7c4c38a00 already unused, calling callback (ffffffffc1ca3c20) 10000000:00010000:3.0:1789049359.050978:0:5838:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.126@tcp lock: ffff8cb7c4c38a00/0xf4f48ce5e1bbeb93 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xf4f48ce5e1bbeb9a expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789049359.050978:0:5839:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.126@tcp lock: ffff8cb8d6714600/0xf4f48ce5e1bbebbd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xf4f48ce5e1bbebc4 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789049359.050989:0:5839:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1789049359.051003:0:5839:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.126@tcp lock: ffff8cb8d6714600/0xf4f48ce5e1bbebbd lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf4f48ce5e1bbebc4 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049359.051008:0:5839:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789049359.051096:0:5838:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.126@tcp lock: ffff8cb7c4c38a00/0xf4f48ce5e1bbeb93 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xf4f48ce5e1bbeb9a expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789049359.051103:0:5838:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.126@tcp lock: ffff8cb7c4c38a00/0xf4f48ce5e1bbeb93 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xf4f48ce5e1bbeb9a expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789049359.051108:0:5838:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1789049359.051124:0:5838:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.126@tcp lock: ffff8cb7c4c38a00/0xf4f48ce5e1bbeb93 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf4f48ce5e1bbeb9a expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049359.051130:0:5838:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789049359.051136:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.126@tcp lock: ffff8cb7c4c38a00/0xf4f48ce5e1bbeb93 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf4f48ce5e1bbeb9a expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049359.051142:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.126@tcp lock: ffff8cb7c4c38a00/0xf4f48ce5e1bbeb93 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf4f48ce5e1bbeb9a expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049359.051157:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789049359.051159:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789049359.051161:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789049359.051182:0:5843:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb8c59cb480 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5843:1875954110576768:0@lo:104: 00010000:00010000:2.0:1789049359.051186:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.126@tcp lock: ffff8cb8d6714600/0xf4f48ce5e1bbebbd lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf4f48ce5e1bbebc4 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049359.051193:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.126@tcp lock: ffff8cb8d6714600/0xf4f48ce5e1bbebbd lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf4f48ce5e1bbebc4 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049359.051204:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789049359.051205:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789049359.051206:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789049359.051209:0:5843:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8cb8d6715a00/0xf4f48ce5e1bbec49 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049359.051213:0:6719:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789049359.051231:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb8f73c6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7ef694ec-1ea0-4f02-800c-d1279b4fdf12:3310:1875954110577408:0@lo:103: 00000100:00100000:2.0:1789049359.051323:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789049359.051401:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb8c59c8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:7ef694ec-1ea0-4f02-800c-d1279b4fdf12:3311:1875954110576896:0@lo:103: 00000100:00100000:2.0:1789049359.051490:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb8c59c9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7ef694ec-1ea0-4f02-800c-d1279b4fdf12:3308:1875954110577024:0@lo:103: 00000100:00100000:2.0:1789049359.051512:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789049359.051648:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789049359.051654:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb8c59cbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7ef694ec-1ea0-4f02-800c-d1279b4fdf12:3308:1875954110577152:0@lo:103: 00000100:00100000:2.0:1789049359.051685:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789049359.051759:0:6720:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954110577408 00000100:00100000:0.0:1789049359.051765:0:6720:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954110577408 00010000:00010000:0.0:1789049359.051787:0:6720:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8cb8d6715800/0xf4f48ce5e1bbeb9a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf4f48ce5e1bbeb93 expref: 17 pid: 5845 timeout: 335 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789049359.051858:0:6720:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954110577024 00000100:00100000:0.0:1789049359.051862:0:6720:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954110577024 00010000:00010000:0.0:1789049359.051875:0:6720:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8cb8d6715200/0xf4f48ce5e1bbec0a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf4f48ce5e1bbec03 expref: 18 pid: 5843 timeout: 335 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789049359.051933:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1789049359.051942:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8c59cb480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7ef694ec-1ea0-4f02-800c-d1279b4fdf12+18:3310:x1875954110577408:12345-0@lo:103: 00010000:00010000:1.0:1789049359.051953:0:5837:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789049359.051959:0:5837:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8cb8d6715800/0xf4f48ce5e1bbeb9a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf4f48ce5e1bbeb93 expref: 18 pid: 5845 timeout: 335 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049359.051968:0:5837:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8cb8d6715800/0xf4f48ce5e1bbeb9a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf4f48ce5e1bbeb93 expref: 18 pid: 5845 timeout: 335 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049359.051993:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cb8d6715800/0xf4f48ce5e1bbeb9a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf4f48ce5e1bbeb93 expref: 18 pid: 5845 timeout: 335 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049359.052005:0:5837:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789049359.052054:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8c59cb480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7ef694ec-1ea0-4f02-800c-d1279b4fdf12+17:3310:x1875954110577408:12345-0@lo:103: Request processed in 113us (730us total) trans 0 rc 0/0 00000100:00100000:1.0:1789049359.052060:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1789049359.052076:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1789049359.052082:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8c59c8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7ef694ec-1ea0-4f02-800c-d1279b4fdf12+16:3308:x1875954110577024:12345-0@lo:103: 00010000:00010000:1.0:1789049359.052090:0:5837:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789049359.052094:0:5837:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8cb8d6715200/0xf4f48ce5e1bbec0a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf4f48ce5e1bbec03 expref: 16 pid: 5843 timeout: 335 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049359.052103:0:5837:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8cb8d6715200/0xf4f48ce5e1bbec0a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf4f48ce5e1bbec03 expref: 16 pid: 5843 timeout: 335 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049359.052112:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cb8d6715200/0xf4f48ce5e1bbec0a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf4f48ce5e1bbec03 expref: 16 pid: 5843 timeout: 335 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049359.052121:0:5837:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789049359.052142:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8c59c8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7ef694ec-1ea0-4f02-800c-d1279b4fdf12+15:3308:x1875954110577024:12345-0@lo:103: Request processed in 60us (629us total) trans 0 rc 0/0 00000100:00100000:1.0:1789049359.052147:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1789049359.052470:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb8c59c9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7ef694ec-1ea0-4f02-800c-d1279b4fdf12:3308:1875954110577024:0@lo:103: 00000100:00100000:2.0:1789049359.052494:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954110577152 00000100:00100000:2.0:1789049359.052497:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954110577152 00010000:00010000:2.0:1789049359.052514:0:5836:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8cb8c146c000/0xf4f48ce5e1bbebee lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf4f48ce5e1bbebe7 expref: 15 pid: 5845 timeout: 335 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789049359.052544:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1789049359.052550:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8c59cad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7ef694ec-1ea0-4f02-800c-d1279b4fdf12+15:3308:x1875954110577152:12345-0@lo:103: 00010000:00010000:2.0:1789049359.052559:0:5836:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789049359.052563:0:5836:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8cb8c146c000/0xf4f48ce5e1bbebee lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf4f48ce5e1bbebe7 expref: 15 pid: 5845 timeout: 335 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049359.052570:0:5836:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8cb8c146c000/0xf4f48ce5e1bbebee lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf4f48ce5e1bbebe7 expref: 15 pid: 5845 timeout: 335 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049359.052580:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cb8c146c000/0xf4f48ce5e1bbebee lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf4f48ce5e1bbebe7 expref: 15 pid: 5845 timeout: 335 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049359.052589:0:5836:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789049359.052616:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8c59cad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7ef694ec-1ea0-4f02-800c-d1279b4fdf12+14:3308:x1875954110577152:12345-0@lo:103: Request processed in 66us (930us total) trans 0 rc 0/0 00000100:00100000:2.0:1789049359.052622:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1789049359.052639:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789049359.052656:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb8c59ca680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:7ef694ec-1ea0-4f02-800c-d1279b4fdf12:3311:1875954110577280:0@lo:103: 00000100:00100000:2.0:1789049359.052688:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789049359.052709:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954110576896 00000100:00100000:2.0:1789049359.052713:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954110576896 00010000:00010000:2.0:1789049359.052725:0:5836:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8cb8d6715400/0xf4f48ce5e1bbec34 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf4f48ce5e1bbec2d expref: 14 pid: 5844 timeout: 335 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789049359.052736:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954110577280 00000100:00100000:2.0:1789049359.052739:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954110577280 00010000:00010000:2.0:1789049359.052749:0:5836:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8cb8c146d200/0xf4f48ce5e1bbebc4 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf4f48ce5e1bbebbd expref: 15 pid: 5845 timeout: 335 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789049359.052772:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1789049359.052777:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8c59c9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7ef694ec-1ea0-4f02-800c-d1279b4fdf12+15:3311:x1875954110576896:12345-0@lo:103: 00010000:00010000:2.0:1789049359.052786:0:5836:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789049359.052790:0:5836:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8cb8d6715400/0xf4f48ce5e1bbec34 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf4f48ce5e1bbec2d expref: 15 pid: 5844 timeout: 335 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049359.052798:0:5836:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8cb8d6715400/0xf4f48ce5e1bbec34 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf4f48ce5e1bbec2d expref: 15 pid: 5844 timeout: 335 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049359.052808:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cb8d6715400/0xf4f48ce5e1bbec34 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf4f48ce5e1bbec2d expref: 15 pid: 5844 timeout: 335 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049359.052816:0:5836:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789049359.052867:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8c59c9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7ef694ec-1ea0-4f02-800c-d1279b4fdf12+14:3311:x1875954110576896:12345-0@lo:103: Request processed in 90us (226us total) trans 0 rc 0/0 00000100:00100000:2.0:1789049359.052873:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1789049359.052885:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1789049359.052891:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8c59c9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7ef694ec-1ea0-4f02-800c-d1279b4fdf12+13:3311:x1875954110577280:12345-0@lo:103: 00010000:00010000:2.0:1789049359.052898:0:5836:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789049359.052902:0:5836:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8cb8c146d200/0xf4f48ce5e1bbebc4 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf4f48ce5e1bbebbd expref: 13 pid: 5845 timeout: 335 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049359.052911:0:5836:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8cb8c146d200/0xf4f48ce5e1bbebc4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf4f48ce5e1bbebbd expref: 13 pid: 5845 timeout: 335 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049359.052921:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cb8c146d200/0xf4f48ce5e1bbebc4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf4f48ce5e1bbebbd expref: 13 pid: 5845 timeout: 335 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049359.052942:0:5836:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8cb8d6715a00/0xf4f48ce5e1bbec49 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049359.052950:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cb8d6715a00/0xf4f48ce5e1bbec49 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049359.052965:0:5836:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8cb8d6715a00/0xf4f48ce5e1bbec49 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049359.052972:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8cb8d6715a00/0xf4f48ce5e1bbec49 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049359.052979:0:5836:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8cb8d6715a00/0xf4f48ce5e1bbec49 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049359.052985:0:5836:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8cb8d6715a00/0xf4f48ce5e1bbec49 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049359.052991:0:5836:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cb8d6715a00 already unused, calling callback (ffffffffc166a8f0) 00010000:00010000:2.0:1789049359.052995:0:5836:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8cb8d6715a00/0xf4f48ce5e1bbec49 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049359.053003:0:5836:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8cb8d6715a00/0xf4f48ce5e1bbec49 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049359.053045:0:5836:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8cb8d6715a00/0xf4f48ce5e1bbec49 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049359.053055:0:5836:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789049359.053078:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8c59c9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7ef694ec-1ea0-4f02-800c-d1279b4fdf12+12:3311:x1875954110577280:12345-0@lo:103: Request processed in 187us (389us total) trans 0 rc 0/0 00000100:00100000:2.0:1789049359.053094:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1789049359.053120:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb8c59c8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:7ef694ec-1ea0-4f02-800c-d1279b4fdf12:3311:1875954110576896:0@lo:103: 00000100:00100000:2.0:1789049359.053128:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb8c59ca680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:7ef694ec-1ea0-4f02-800c-d1279b4fdf12:3311:1875954110577280:0@lo:103: 00000100:00100000:2.0:1789049359.053150:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb8f73c6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7ef694ec-1ea0-4f02-800c-d1279b4fdf12:3310:1875954110577408:0@lo:103: 00000100:00100000:2.0:1789049359.053170:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb8c59cbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7ef694ec-1ea0-4f02-800c-d1279b4fdf12:3308:1875954110577152:0@lo:103: 00010000:00010000:3.0:1789049359.053665:0:5843:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8cb8d6715a00/0xf4f48ce5e1bbec49 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049359.053686:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8cb8d6715a00/0xf4f48ce5e1bbec49 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049359.053692:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cb8d6715a00/0xf4f48ce5e1bbec49 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1789049359.053705:0:5843:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00010000:00010000:3.0:1789049359.067046:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789049359.193772:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8c6b80c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7ef694ec-1ea0-4f02-800c-d1279b4fdf12+11:7645:x1875954110576128:12345-0@lo:253: Request processed in 160716us (160996us total) trans 0 rc 0/0 00000100:00100000:3.0:1789049359.193787:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1789049359.193893:0:7645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb8d0ab5f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7ef694ec-1ea0-4f02-800c-d1279b4fdf12:7645:1875954110576128:0@lo:253: 10000000:01000000:1.0:1789049359.193907:0:7645:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:1.0:1789049359.193911:0:7645:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1789049359.193913:0:7645:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1789049359.193914:0:7645:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1789049359.193928:0:7645:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-OST0001_UUID 00000020:01000004:1.0:1789049359.193930:0:7645:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1789049359.193931:0:7645:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1789049359.193932:0:7645:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1789049359.193934:0:7645:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:1.0:1789049359.193935:0:7645:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1789049359.193937:0:7645:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:1.0:1789049359.193956:0:7645:0:(tgt_mount.c:101:server_register_mount()) register mount ffff8cb8c631b800 from lustre-OST0001 10000000:01000000:1.0:1789049359.193980:0:7645:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0001 from 0 10000000:01000000:1.0:1789049359.193983:0:7645:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0001-0000000000000000 10000000:01000000:1.0:1789049359.193989:0:7645:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff8cb8c59599c0 local copy 10000000:01000000:1.0:1789049359.193993:0:7645:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:1.0:1789049359.194041:0:7645:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.126@tcp lock: ffff8cb8c146dc00/0xf4f48ce5e1bbec50 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049359.194052:0:7645:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: MGC192.168.206.126@tcp lock: ffff8cb8c146dc00/0xf4f48ce5e1bbec50 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049359.194061:0:7645:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.126@tcp lock: ffff8cb8c146dc00/0xf4f48ce5e1bbec50 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789049359.194151:0:7645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb8d0ab5f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7ef694ec-1ea0-4f02-800c-d1279b4fdf12:7645:1875954110577536:0@lo:101: 00000100:00100000:1.0:1789049359.194184:0:7645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789049359.194311:0:7645:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cb8c5975480 going to sleep for 11 seconds 00000100:00100000:2.0:1789049359.194472:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954110577536 00000100:00100000:2.0:1789049359.194479:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954110577536 00000100:00100000:2.0:1789049359.194521:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1789049359.194530:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8c6b82450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7ef694ec-1ea0-4f02-800c-d1279b4fdf12+11:7645:x1875954110577536:12345-0@lo:101: 00010000:00010000:2.0:1789049359.194542:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789049359.194554:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cb8d6715400/0xf4f48ce5e1bbec57 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xf4f48ce5e1bbec50 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049359.194575:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cb8d6715400/0xf4f48ce5e1bbec57 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf4f48ce5e1bbec50 expref: 12 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049359.194585:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cb8d6715400/0xf4f48ce5e1bbec57 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf4f48ce5e1bbec50 expref: 12 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049359.194594:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cb8d6715400, rc 0) 00000100:00100000:2.0:1789049359.194634:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8c6b82450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7ef694ec-1ea0-4f02-800c-d1279b4fdf12+12:7645:x1875954110577536:12345-0@lo:101: Request processed in 105us (449us total) trans 0 rc 0/0 00000100:00100000:2.0:1789049359.194640:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1789049359.194722:0:7645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb8d0ab5f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7ef694ec-1ea0-4f02-800c-d1279b4fdf12:7645:1875954110577536:0@lo:101: 00010000:00010000:1.0:1789049359.194735:0:7645:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.126@tcp lock: ffff8cb8c146dc00/0xf4f48ce5e1bbec50 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0xf4f48ce5e1bbec57 expref: -99 pid: 7645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049359.194743:0:7645:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.126@tcp lock: ffff8cb8c146dc00/0xf4f48ce5e1bbec50 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0xf4f48ce5e1bbec57 expref: -99 pid: 7645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789049359.194829:0:7645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb8d0ab5f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7ef694ec-1ea0-4f02-800c-d1279b4fdf12:7645:1875954110577664:0@lo:501: 00000100:00100000:1.0:1789049359.194902:0:7645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789049359.194926:0:7645:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cb8c5975480 going to sleep for 11 seconds 00000100:00100000:3.0:1789049359.194980:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954110577664 00000100:00100000:3.0:1789049359.194984:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954110577664 00000100:00100000:3.0:1789049359.195005:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1789049359.195011:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8c624b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7ef694ec-1ea0-4f02-800c-d1279b4fdf12+12:7645:x1875954110577664:12345-0@lo:501: 00000100:00100000:3.0:1789049359.195235:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8c624b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7ef694ec-1ea0-4f02-800c-d1279b4fdf12+12:7645:x1875954110577664:12345-0@lo:501: Request processed in 223us (331us total) trans 0 rc -2/-2 00000100:00100000:3.0:1789049359.195242:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1789049359.195430:0:7645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb8d0ab5f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7ef694ec-1ea0-4f02-800c-d1279b4fdf12:7645:1875954110577664:0@lo:501: 10000000:01000000:1.0:1789049359.195442:0:7645:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.206.126@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:1.0:1789049359.195468:0:7645:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.206.126@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:1.0:1789049359.195474:0:7645:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.126@tcp lock: ffff8cb8c146dc00/0xf4f48ce5e1bbec50 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0xf4f48ce5e1bbec57 expref: -99 pid: 7645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049359.195482:0:7645:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.126@tcp lock: ffff8cb8c146dc00/0xf4f48ce5e1bbec50 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0xf4f48ce5e1bbec57 expref: -99 pid: 7645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049359.195489:0:7645:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.126@tcp lock: ffff8cb8c146dc00/0xf4f48ce5e1bbec50 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0xf4f48ce5e1bbec57 expref: -99 pid: 7645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049359.195514:0:7645:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:1.0:1789049359.195532:0:7645:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff8cb8c631b800 10000000:01000000:1.0:1789049359.195537:0:7645:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:1.0:1789049359.195542:0:7645:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0001-0000000000000000 10000000:01000000:1.0:1789049359.195544:0:7645:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1789049359.195548:0:7645:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 1 10000000:01000000:1.0:1789049359.195551:0:7645:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:1.0:1789049359.195569:0:7645:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.126@tcp lock: ffff8cb8c146d200/0xf4f48ce5e1bbec5e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049359.195576:0:7645:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.126@tcp lock: ffff8cb8c146d200/0xf4f48ce5e1bbec5e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049359.195584:0:7645:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.126@tcp lock: ffff8cb8c146d200/0xf4f48ce5e1bbec5e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789049359.195608:0:7645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb8d0ab5f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7ef694ec-1ea0-4f02-800c-d1279b4fdf12:7645:1875954110577792:0@lo:101: 00000100:00100000:1.0:1789049359.195634:0:7645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789049359.195649:0:7645:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cb8c59756c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789049359.195716:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954110577792 00000100:00100000:0.0:1789049359.195721:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954110577792 00000100:00100000:0.0:1789049359.195744:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1789049359.195751:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8c6248050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7ef694ec-1ea0-4f02-800c-d1279b4fdf12+12:7645:x1875954110577792:12345-0@lo:101: 00010000:00010000:0.0:1789049359.195758:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789049359.195767:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cb7c4c38e00/0xf4f48ce5e1bbec65 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xf4f48ce5e1bbec5e expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049359.195785:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cb7c4c38e00/0xf4f48ce5e1bbec65 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf4f48ce5e1bbec5e expref: 13 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049359.195794:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cb7c4c38e00/0xf4f48ce5e1bbec65 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf4f48ce5e1bbec5e expref: 13 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049359.195808:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cb7c4c38e00, rc 0) 00000100:00100000:0.0:1789049359.195875:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8c6248050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7ef694ec-1ea0-4f02-800c-d1279b4fdf12+13:7645:x1875954110577792:12345-0@lo:101: Request processed in 124us (240us total) trans 0 rc 0/0 00000100:00100000:0.0:1789049359.195881:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1789049359.195956:0:7645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb8d0ab5f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7ef694ec-1ea0-4f02-800c-d1279b4fdf12:7645:1875954110577792:0@lo:101: 00010000:00010000:1.0:1789049359.195969:0:7645:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.126@tcp lock: ffff8cb8c146d200/0xf4f48ce5e1bbec5e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf4f48ce5e1bbec65 expref: -99 pid: 7645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049359.195977:0:7645:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.126@tcp lock: ffff8cb8c146d200/0xf4f48ce5e1bbec5e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xf4f48ce5e1bbec65 expref: -99 pid: 7645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789049359.196041:0:7645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb8d0ab5f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7ef694ec-1ea0-4f02-800c-d1279b4fdf12:7645:1875954110577920:0@lo:501: 00000100:00100000:1.0:1789049359.196076:0:7645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789049359.196102:0:7645:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cb8c59756c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789049359.196260:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954110577920 00000100:00100000:0.0:1789049359.196265:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954110577920 00000100:00100000:0.0:1789049359.196283:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1789049359.196289:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8c6248c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7ef694ec-1ea0-4f02-800c-d1279b4fdf12+13:7645:x1875954110577920:12345-0@lo:501: 00000100:00100000:0.0:1789049359.196476:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8c6248c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7ef694ec-1ea0-4f02-800c-d1279b4fdf12+13:7645:x1875954110577920:12345-0@lo:501: Request processed in 187us (399us total) trans 0 rc 0/0 00000100:00100000:0.0:1789049359.196483:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00010000:00010000:3.0:1789049359.196587:0:5839:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789049359.196593:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.126@tcp lock: ffff8cb8c146dc00/0xf4f48ce5e1bbec50 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0xf4f48ce5e1bbec57 expref: -99 pid: 7645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049359.196601:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cb8c146dc00 already unused, calling callback (ffffffffc1ca3c20) 10000000:00010000:3.0:1789049359.196606:0:5839:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.126@tcp lock: ffff8cb8c146dc00/0xf4f48ce5e1bbec50 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0xf4f48ce5e1bbec57 expref: -99 pid: 7645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049359.196613:0:5839:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.126@tcp lock: ffff8cb8c146dc00/0xf4f48ce5e1bbec50 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x8400000000 nid: local remote: 0xf4f48ce5e1bbec57 expref: -99 pid: 7645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789049359.196620:0:5839:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.126@tcp lock: ffff8cb8c146dc00/0xf4f48ce5e1bbec50 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x9400000000 nid: local remote: 0xf4f48ce5e1bbec57 expref: -99 pid: 7645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789049359.196626:0:5839:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1789049359.196645:0:5839:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.126@tcp lock: ffff8cb8c146dc00/0xf4f48ce5e1bbec50 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0xf4f48ce5e1bbec57 expref: -99 pid: 7645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049359.196651:0:5839:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789049359.196687:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.126@tcp lock: ffff8cb8c146dc00/0xf4f48ce5e1bbec50 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0xf4f48ce5e1bbec57 expref: -99 pid: 7645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049359.196694:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.126@tcp lock: ffff8cb8c146dc00/0xf4f48ce5e1bbec50 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0xf4f48ce5e1bbec57 expref: -99 pid: 7645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049359.196706:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789049359.196708:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789049359.196709:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789049359.196716:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789049359.196726:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb8f73c6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:7ef694ec-1ea0-4f02-800c-d1279b4fdf12:3309:1875954110578048:0@lo:103: 00000100:00100000:3.0:1789049359.196755:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789049359.196790:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954110578048 00000100:00100000:3.0:1789049359.196793:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954110578048 00000100:00100000:3.0:1789049359.196823:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1789049359.196829:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8f73c5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7ef694ec-1ea0-4f02-800c-d1279b4fdf12+13:3309:x1875954110578048:12345-0@lo:103: 00010000:00010000:3.0:1789049359.196838:0:5837:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789049359.196879:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cb8d6715400/0xf4f48ce5e1bbec57 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xf4f48ce5e1bbec50 expref: 13 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049359.196889:0:5837:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789049359.196916:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8f73c5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7ef694ec-1ea0-4f02-800c-d1279b4fdf12+12:3309:x1875954110578048:12345-0@lo:103: Request processed in 88us (161us total) trans 0 rc 0/0 00000100:00100000:3.0:1789049359.196922:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1789049359.196950:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb8f73c6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:7ef694ec-1ea0-4f02-800c-d1279b4fdf12:3309:1875954110578048:0@lo:103: 00000100:00100000:1.0:1789049359.197214:0:7645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb8d0ab5f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7ef694ec-1ea0-4f02-800c-d1279b4fdf12:7645:1875954110577920:0@lo:501: 00000100:00100000:1.0:1789049359.197244:0:7645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb8d0ab5f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7ef694ec-1ea0-4f02-800c-d1279b4fdf12:7645:1875954110578176:0@lo:503: 00000100:00100000:1.0:1789049359.197282:0:7645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789049359.197308:0:7645:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cb8c59756c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789049359.197361:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954110578176 00000100:00100000:0.0:1789049359.197366:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954110578176 00000100:00100000:0.0:1789049359.197400:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1789049359.197406:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8c624a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7ef694ec-1ea0-4f02-800c-d1279b4fdf12+12:7645:x1875954110578176:12345-0@lo:503: 00000100:00100000:0.0:1789049359.197559:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8c624a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7ef694ec-1ea0-4f02-800c-d1279b4fdf12+12:7645:x1875954110578176:12345-0@lo:503: Request processed in 153us (277us total) trans 0 rc 0/0 00000100:00100000:0.0:1789049359.197566:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1789049359.197644:0:7645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb8d0ab5f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7ef694ec-1ea0-4f02-800c-d1279b4fdf12:7645:1875954110578176:0@lo:503: 00000040:00080000:1.0:1789049359.197940:0:7645:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1789049359.198005:0:7645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb8d0ab5f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7ef694ec-1ea0-4f02-800c-d1279b4fdf12:7645:1875954110578304:0@lo:502: 00000100:00100000:1.0:1789049359.198157:0:7645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789049359.198180:0:7645:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cb8c59756c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789049359.198240:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954110578304 00000100:00100000:2.0:1789049359.198245:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954110578304 00000100:00100000:2.0:1789049359.198277:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1789049359.198292:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8c624b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7ef694ec-1ea0-4f02-800c-d1279b4fdf12+12:7645:x1875954110578304:12345-0@lo:502: 00000100:00100000:2.0:1789049359.198436:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8c624b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7ef694ec-1ea0-4f02-800c-d1279b4fdf12+12:7645:x1875954110578304:12345-0@lo:502: Request processed in 144us (278us total) trans 0 rc 0/0 00000100:00100000:2.0:1789049359.198443:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1789049359.198645:0:7645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb8d0ab5f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7ef694ec-1ea0-4f02-800c-d1279b4fdf12:7645:1875954110578304:0@lo:502: 00000040:00080000:1.0:1789049359.198934:0:7645:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:1.0:1789049359.198991:0:7645:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 128 off8544 00000040:00080000:1.0:1789049359.199037:0:7645:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 112 off8656 00000040:00080000:1.0:1789049359.199162:0:7645:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8880 00000040:00080000:1.0:1789049359.199199:0:7645:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9104 00000040:00080000:1.0:1789049359.199228:0:7645:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 80 off9184 00000100:00100000:1.0:1789049359.199257:0:7645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb8d0ab5f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7ef694ec-1ea0-4f02-800c-d1279b4fdf12:7645:1875954110578432:0@lo:502: 00000100:00100000:1.0:1789049359.199298:0:7645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789049359.199330:0:7645:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cb8c59756c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789049359.199451:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954110578432 00000100:00100000:2.0:1789049359.199457:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954110578432 00000100:00100000:2.0:1789049359.199533:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1789049359.199541:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8c624bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7ef694ec-1ea0-4f02-800c-d1279b4fdf12+12:7645:x1875954110578432:12345-0@lo:502: 00000100:00100000:2.0:1789049359.199690:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8c624bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7ef694ec-1ea0-4f02-800c-d1279b4fdf12+12:7645:x1875954110578432:12345-0@lo:502: Request processed in 150us (391us total) trans 0 rc 0/0 00000100:00100000:2.0:1789049359.199697:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1789049359.199767:0:7645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb8d0ab5f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7ef694ec-1ea0-4f02-800c-d1279b4fdf12:7645:1875954110578432:0@lo:502: 00000040:00080000:1.0:1789049359.199877:0:7645:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9408 00000040:00080000:1.0:1789049359.199886:0:7645:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 7 count 8 00000020:01000000:3.0:1789049359.201893:0:7653:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1789049359.201903:0:7653:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-ost2/ost2 00000020:00000080:3.0:1789049359.201909:0:7653:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789049359.201911:0:7653:0:(obd_config.c:1563:class_process_config()) marker 17 (0x1) lustre-OST0001 add ost 00000020:00000080:3.0:1789049359.201916:0:7653:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1789049359.201929:0:7653:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001 (ffff8cb8c7c699c0) 00000020:00000080:3.0:1789049359.201950:0:7653:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type obdfilter with refcount 2 00000020:00000080:3.0:1789049359.201956:0:7653:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:3.0:1789049359.202021:0:7653:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8cb8c631b800 from lustre-OST0001, refs=2 00080000:01000000:3.0:1789049359.202029:0:7653:0:(osd_handler.c:1574:osd_obd_connect()) connect #1 00000020:00000080:3.0:1789049359.202034:0:7653:0:(genops.c:1384:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0xf4f48ce5e1bbec73 00010000:00010000:3.0:1789049359.205757:0:7653:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0001_UUID-3 is initialized 00000001:02000400:3.0:1789049359.206200:0:7653:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-OST0001: new disk, initializing 00000001:00000004:3.0:1789049359.209298:0:7653:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 0 40000000:02000000:3.0:1789049359.209576:0:7653:0:(fid_handler.c:560:seq_server_init()) srv-lustre-OST0001: No data found on store. Initialize space. 00080000:10000000:1.0:1789049359.218393:0:7653:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000001:0x3:0x0] (8/8/3) registered 00080000:10000000:1.0:1789049359.219171:0:7653:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x3:0x0] (8/8/4) registered 00000020:00000080:2.0:1789049359.231987:0:7653:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:01000000:2.0:1789049359.231998:0:7653:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789049359.232005:0:7653:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789049359.232007:0:7653:0:(obd_config.c:1563:class_process_config()) marker 17 (0x2) lustre-OST0001 add ost 00000020:01000000:2.0:1789049359.232011:0:7653:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789049359.232015:0:7653:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789049359.232017:0:7653:0:(obd_config.c:1563:class_process_config()) marker 22 (0x1) lustre sys.timeout 00000020:00000080:2.0:1789049359.235802:0:7653:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1789049359.235808:0:7653:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:2.0:1789049359.235883:0:7653:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789049359.235888:0:7653:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789049359.235890:0:7653:0:(obd_config.c:1563:class_process_config()) marker 22 (0x2) lustre sys.timeout 00000040:00080000:2.0:1789049359.235895:0:7653:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000020:01000000:1.0:1789049359.239668:0:7645:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 1-7 (rc=0) 10000000:01000000:1.0:1789049359.239717:0:7645:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.126@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:1.0:1789049359.239737:0:7645:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.126@tcp lock: ffff8cb8c146d200/0xf4f48ce5e1bbec5e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf4f48ce5e1bbec65 expref: -99 pid: 7645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049359.239751:0:7645:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.126@tcp lock: ffff8cb8c146d200/0xf4f48ce5e1bbec5e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf4f48ce5e1bbec65 expref: -99 pid: 7645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789049359.239759:0:7645:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8cb8c631b800 from 1 10000000:01000000:1.0:1789049359.239762:0:7645:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1789049359.239799:0:7645:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.126@tcp lock: ffff8cb8c146c000/0xf4f48ce5e1bbec7a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049359.239808:0:7645:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.126@tcp lock: ffff8cb8c146c000/0xf4f48ce5e1bbec7a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049359.239818:0:7645:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.126@tcp lock: ffff8cb8c146c000/0xf4f48ce5e1bbec7a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789049359.239862:0:7645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb8d0ab5f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7ef694ec-1ea0-4f02-800c-d1279b4fdf12:7645:1875954110578560:0@lo:101: 00000100:00100000:1.0:1789049359.239926:0:7645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789049359.239958:0:7645:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cb8c5975480 going to sleep for 11 seconds 00000100:00100000:3.0:1789049359.240134:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954110578560 00000100:00100000:3.0:1789049359.240142:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954110578560 00000100:00100000:3.0:1789049359.240198:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:3.0:1789049359.240207:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8c6249850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7ef694ec-1ea0-4f02-800c-d1279b4fdf12+12:7645:x1875954110578560:12345-0@lo:101: 00010000:00010000:3.0:1789049359.240221:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789049359.240235:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cb8d776fa00/0xf4f48ce5e1bbec81 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xf4f48ce5e1bbec7a expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049359.240257:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cb8d776fa00/0xf4f48ce5e1bbec81 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf4f48ce5e1bbec7a expref: 13 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049359.240268:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cb8d776fa00/0xf4f48ce5e1bbec81 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf4f48ce5e1bbec7a expref: 13 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049359.240275:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cb8d776fa00, rc 0) 00000100:00100000:3.0:1789049359.240316:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8c6249850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7ef694ec-1ea0-4f02-800c-d1279b4fdf12+13:7645:x1875954110578560:12345-0@lo:101: Request processed in 111us (390us total) trans 0 rc 0/0 00000100:00100000:3.0:1789049359.240321:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:3.0:1789049359.240364:0:7645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb8d0ab5f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7ef694ec-1ea0-4f02-800c-d1279b4fdf12:7645:1875954110578560:0@lo:101: 00010000:00010000:3.0:1789049359.240377:0:7645:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.126@tcp lock: ffff8cb8c146c000/0xf4f48ce5e1bbec7a lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf4f48ce5e1bbec81 expref: -99 pid: 7645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049359.240385:0:7645:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.126@tcp lock: ffff8cb8c146c000/0xf4f48ce5e1bbec7a lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xf4f48ce5e1bbec81 expref: -99 pid: 7645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789049359.240471:0:7645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb8f73c6300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7ef694ec-1ea0-4f02-800c-d1279b4fdf12:7645:1875954110578688:0@lo:501: 00000100:00100000:3.0:1789049359.240496:0:7645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789049359.240521:0:7645:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cb7c5414180 going to sleep for 11 seconds 00000100:00100000:3.0:1789049359.240992:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954110578688 00000100:00100000:3.0:1789049359.240998:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954110578688 00000100:00100000:3.0:1789049359.241244:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:3.0:1789049359.241262:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8c6249050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7ef694ec-1ea0-4f02-800c-d1279b4fdf12+13:7645:x1875954110578688:12345-0@lo:501: 00000100:00100000:3.0:1789049359.241495:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8c6249050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7ef694ec-1ea0-4f02-800c-d1279b4fdf12+13:7645:x1875954110578688:12345-0@lo:501: Request processed in 233us (997us total) trans 0 rc 0/0 00000100:00100000:3.0:1789049359.241501:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:2.0:1789049359.244220:0:7645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb8f73c6300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7ef694ec-1ea0-4f02-800c-d1279b4fdf12:7645:1875954110578688:0@lo:501: 00000100:00100000:2.0:1789049359.244273:0:7645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb8c59cbb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7ef694ec-1ea0-4f02-800c-d1279b4fdf12:7645:1875954110578816:0@lo:503: 00000100:00100000:2.0:1789049359.244340:0:7645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789049359.244381:0:7645:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cb8c62d9480 going to sleep for 11 seconds 00000100:00100000:1.0:1789049359.244426:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954110578816 00000100:00100000:1.0:1789049359.244432:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954110578816 00000100:00100000:1.0:1789049359.244469:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:1.0:1789049359.244478:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8c624b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7ef694ec-1ea0-4f02-800c-d1279b4fdf12+13:7645:x1875954110578816:12345-0@lo:503: 00000100:00100000:1.0:1789049359.244828:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8c624b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7ef694ec-1ea0-4f02-800c-d1279b4fdf12+13:7645:x1875954110578816:12345-0@lo:503: Request processed in 351us (487us total) trans 0 rc 0/0 00000100:00100000:1.0:1789049359.244836:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:2.0:1789049359.245001:0:7645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb8c59cbb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7ef694ec-1ea0-4f02-800c-d1279b4fdf12:7645:1875954110578816:0@lo:503: 00000040:00080000:2.0:1789049359.245283:0:7645:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1789049359.245341:0:7645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb8c59cbb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7ef694ec-1ea0-4f02-800c-d1279b4fdf12:7645:1875954110578944:0@lo:502: 00000100:00100000:2.0:1789049359.245377:0:7645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789049359.245409:0:7645:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cb8c62d9480 going to sleep for 11 seconds 00000100:00100000:1.0:1789049359.245512:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954110578944 00000100:00100000:1.0:1789049359.245517:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954110578944 00000100:00100000:1.0:1789049359.245535:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:1.0:1789049359.245542:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8c6248850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7ef694ec-1ea0-4f02-800c-d1279b4fdf12+13:7645:x1875954110578944:12345-0@lo:502: 00000100:00100000:1.0:1789049359.245711:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8c6248850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7ef694ec-1ea0-4f02-800c-d1279b4fdf12+13:7645:x1875954110578944:12345-0@lo:502: Request processed in 168us (332us total) trans 0 rc 0/0 00000100:00100000:1.0:1789049359.245718:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:2.0:1789049359.245944:0:7645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb8c59cbb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7ef694ec-1ea0-4f02-800c-d1279b4fdf12:7645:1875954110578944:0@lo:502: 00000040:00080000:2.0:1789049359.246321:0:7645:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 00000040:00080000:2.0:1789049359.246382:0:7645:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 112 off8528 00000100:00100000:2.0:1789049359.246411:0:7645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb8c59cbb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7ef694ec-1ea0-4f02-800c-d1279b4fdf12:7645:1875954110579072:0@lo:502: 00000100:00100000:2.0:1789049359.246448:0:7645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789049359.246479:0:7645:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cb8c62d9480 going to sleep for 11 seconds 00000100:00100000:1.0:1789049359.246525:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954110579072 00000100:00100000:1.0:1789049359.246530:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954110579072 00000100:00100000:1.0:1789049359.246561:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:1.0:1789049359.246567:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8c6249c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7ef694ec-1ea0-4f02-800c-d1279b4fdf12+13:7645:x1875954110579072:12345-0@lo:502: 00000100:00100000:1.0:1789049359.246716:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8c6249c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7ef694ec-1ea0-4f02-800c-d1279b4fdf12+13:7645:x1875954110579072:12345-0@lo:502: Request processed in 147us (266us total) trans 0 rc 0/0 00000100:00100000:1.0:1789049359.246723:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:2.0:1789049359.246888:0:7645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb8c59cbb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7ef694ec-1ea0-4f02-800c-d1279b4fdf12:7645:1875954110579072:0@lo:502: 00000040:00080000:2.0:1789049359.246983:0:7645:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 224 off8752 00000040:00080000:2.0:1789049359.246993:0:7645:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 3 count 4 00000020:01000000:2.0:1789049359.247701:0:7657:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789049359.247715:0:7657:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789049359.247717:0:7657:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:2.0:1789049359.247726:0:7657:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8cb8c631b800 00000020:00000080:2.0:1789049359.247729:0:7657:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1789049359.247752:0:7657:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789049359.247759:0:7657:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789049359.247761:0:7657:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:2.0:1789049359.247763:0:7657:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000020:01000000:0.0:1789049359.247917:0:7645:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:0.0:1789049359.247942:0:7645:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.126@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1789049359.247965:0:7645:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.126@tcp lock: ffff8cb8c146c000/0xf4f48ce5e1bbec7a lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf4f48ce5e1bbec81 expref: -99 pid: 7645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049359.247980:0:7645:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.126@tcp lock: ffff8cb8c146c000/0xf4f48ce5e1bbec7a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf4f48ce5e1bbec81 expref: -99 pid: 7645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789049359.248036:0:7645:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:0.0:1789049359.248040:0:7645:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff8cb8c631b800 10000000:01000000:0.0:1789049359.248042:0:7645:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff8cb8c631b800 10000000:01000000:0.0:1789049359.248050:0:7645:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1789049359.248055:0:7645:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8cb8c631b800 from 1 10000000:01000000:0.0:1789049359.248060:0:7645:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1789049359.248100:0:7645:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.126@tcp lock: ffff8cb7c4c38c00/0xf4f48ce5e1bbec88 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049359.248109:0:7645:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.126@tcp lock: ffff8cb7c4c38c00/0xf4f48ce5e1bbec88 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049359.248119:0:7645:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.126@tcp lock: ffff8cb7c4c38c00/0xf4f48ce5e1bbec88 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789049359.248136:0:7645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb8fc998000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7ef694ec-1ea0-4f02-800c-d1279b4fdf12:7645:1875954110579200:0@lo:101: 00000100:00100000:0.0:1789049359.248183:0:7645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789049359.248226:0:7645:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cb8c79f86c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789049359.248339:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954110579200 00000100:00100000:1.0:1789049359.248345:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954110579200 00000100:00100000:1.0:1789049359.248401:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:1.0:1789049359.248409:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8c624ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7ef694ec-1ea0-4f02-800c-d1279b4fdf12+13:7645:x1875954110579200:12345-0@lo:101: 00010000:00010000:1.0:1789049359.248419:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789049359.248430:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cb8c146c200/0xf4f48ce5e1bbec8f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xf4f48ce5e1bbec88 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049359.248450:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cb8c146c200/0xf4f48ce5e1bbec8f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf4f48ce5e1bbec88 expref: 14 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049359.248459:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cb8c146c200/0xf4f48ce5e1bbec8f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf4f48ce5e1bbec88 expref: 14 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049359.248467:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cb8c146c200, rc 0) 00000100:00100000:1.0:1789049359.248497:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8c624ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7ef694ec-1ea0-4f02-800c-d1279b4fdf12+14:7645:x1875954110579200:12345-0@lo:101: Request processed in 89us (314us total) trans 0 rc 0/0 00000100:00100000:1.0:1789049359.248504:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:0.0:1789049359.248780:0:7645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb8fc998000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7ef694ec-1ea0-4f02-800c-d1279b4fdf12:7645:1875954110579200:0@lo:101: 00010000:00010000:0.0:1789049359.248796:0:7645:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.126@tcp lock: ffff8cb7c4c38c00/0xf4f48ce5e1bbec88 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf4f48ce5e1bbec8f expref: -99 pid: 7645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049359.248810:0:7645:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.126@tcp lock: ffff8cb7c4c38c00/0xf4f48ce5e1bbec88 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xf4f48ce5e1bbec8f expref: -99 pid: 7645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789049359.248927:0:7645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb8fc998000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7ef694ec-1ea0-4f02-800c-d1279b4fdf12:7645:1875954110579328:0@lo:501: 00000100:00100000:0.0:1789049359.248963:0:7645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789049359.248986:0:7645:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cb8c79f86c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789049359.249056:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954110579328 00000100:00100000:1.0:1789049359.249070:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954110579328 00000100:00100000:1.0:1789049359.249103:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:1.0:1789049359.249110:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8c6248450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7ef694ec-1ea0-4f02-800c-d1279b4fdf12+14:7645:x1875954110579328:12345-0@lo:501: 00000100:00100000:1.0:1789049359.249339:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8c6248450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7ef694ec-1ea0-4f02-800c-d1279b4fdf12+14:7645:x1875954110579328:12345-0@lo:501: Request processed in 228us (377us total) trans 0 rc 0/0 00000100:00100000:1.0:1789049359.249350:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:2.0:1789049359.249560:0:7645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb8fc998000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7ef694ec-1ea0-4f02-800c-d1279b4fdf12:7645:1875954110579328:0@lo:501: 00000100:00100000:2.0:1789049359.249587:0:7645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb8c59cbb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7ef694ec-1ea0-4f02-800c-d1279b4fdf12:7645:1875954110579456:0@lo:503: 00000100:00100000:2.0:1789049359.249629:0:7645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789049359.249661:0:7645:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cb8c62d9b40 going to sleep for 11 seconds 00000100:00100000:1.0:1789049359.249777:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954110579456 00000100:00100000:1.0:1789049359.249782:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954110579456 00000100:00100000:1.0:1789049359.249813:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:1.0:1789049359.249823:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8c6249450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7ef694ec-1ea0-4f02-800c-d1279b4fdf12+14:7645:x1875954110579456:12345-0@lo:503: 00000100:00100000:1.0:1789049359.250029:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8c6249450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7ef694ec-1ea0-4f02-800c-d1279b4fdf12+14:7645:x1875954110579456:12345-0@lo:503: Request processed in 206us (404us total) trans 0 rc 0/0 00000100:00100000:1.0:1789049359.250045:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:2.0:1789049359.250283:0:7645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb8c59cbb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7ef694ec-1ea0-4f02-800c-d1279b4fdf12:7645:1875954110579456:0@lo:503: 00000040:00080000:2.0:1789049359.250536:0:7645:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1789049359.250660:0:7645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb8c59cbb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7ef694ec-1ea0-4f02-800c-d1279b4fdf12:7645:1875954110579584:0@lo:502: 00000100:00100000:2.0:1789049359.250708:0:7645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789049359.250739:0:7645:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cb8c62d9b40 going to sleep for 11 seconds 00000100:00100000:0.0:1789049359.250782:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954110579584 00000100:00100000:0.0:1789049359.250787:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954110579584 00000100:00100000:0.0:1789049359.250818:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:0.0:1789049359.250826:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8c624a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7ef694ec-1ea0-4f02-800c-d1279b4fdf12+14:7645:x1875954110579584:12345-0@lo:502: 00000100:00100000:0.0:1789049359.251015:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8c624a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7ef694ec-1ea0-4f02-800c-d1279b4fdf12+14:7645:x1875954110579584:12345-0@lo:502: Request processed in 189us (306us total) trans 0 rc 0/0 00000100:00100000:0.0:1789049359.251033:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:2.0:1789049359.251255:0:7645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb8c59cbb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7ef694ec-1ea0-4f02-800c-d1279b4fdf12:7645:1875954110579584:0@lo:502: 00000040:00080000:2.0:1789049359.251505:0:7645:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:2.0:1789049359.251633:0:7645:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:2.0:1789049359.251683:0:7645:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:2.0:1789049359.251732:0:7645:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:2.0:1789049359.251764:0:7645:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:2.0:1789049359.251810:0:7645:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:2.0:1789049359.252238:0:7645:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:2.0:1789049359.252280:0:7645:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:2.0:1789049359.252376:0:7645:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:2.0:1789049359.252414:0:7645:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:2.0:1789049359.252446:0:7645:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:2.0:1789049359.252489:0:7645:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:2.0:1789049359.252524:0:7645:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:2.0:1789049359.252703:0:7645:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:2.0:1789049359.252784:0:7645:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:2.0:1789049359.252825:0:7645:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:2.0:1789049359.252941:0:7645:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:2.0:1789049359.252984:0:7645:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:2.0:1789049359.253015:0:7645:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:2.0:1789049359.253061:0:7645:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:2.0:1789049359.253700:0:7645:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:2.0:1789049359.253737:0:7645:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:2.0:1789049359.253769:0:7645:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:2.0:1789049359.253814:0:7645:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:2.0:1789049359.253893:0:7645:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 128 off12440 00000040:00080000:2.0:1789049359.253943:0:7645:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12664 00000040:00080000:2.0:1789049359.253990:0:7645:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12888 00000040:00080000:2.0:1789049359.254026:0:7645:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off12968 00000040:00080000:2.0:1789049359.254060:0:7645:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13192 00000040:00080000:2.0:1789049359.255240:0:7645:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13416 00000040:00080000:2.0:1789049359.255311:0:7645:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 88 off13504 00000040:00080000:2.0:1789049359.255345:0:7645:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 128 off13632 00000040:00080000:2.0:1789049359.255380:0:7645:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 144 off13776 00000040:00080000:2.0:1789049359.255429:0:7645:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 128 off13904 00000040:00080000:2.0:1789049359.255466:0:7645:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 224 off14128 00000040:00080000:2.0:1789049359.255524:0:7645:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 224 off14352 00000040:00080000:2.0:1789049359.256734:0:7645:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].37, 80 off14432 00000100:00100000:2.0:1789049359.256788:0:7645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb8c59cbb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7ef694ec-1ea0-4f02-800c-d1279b4fdf12:7645:1875954110579712:0@lo:502: 00000100:00100000:2.0:1789049359.257734:0:7645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789049359.257812:0:7645:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cb8c62d9b40 going to sleep for 11 seconds 00000100:00100000:0.0:1789049359.262401:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954110579712 00000100:00100000:0.0:1789049359.262415:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954110579712 00000100:00100000:1.0:1789049359.262544:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:1.0:1789049359.262562:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8c624a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7ef694ec-1ea0-4f02-800c-d1279b4fdf12+14:7645:x1875954110579712:12345-0@lo:502: 00000100:00100000:1.0:1789049359.262863:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8c624a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7ef694ec-1ea0-4f02-800c-d1279b4fdf12+14:7645:x1875954110579712:12345-0@lo:502: Request processed in 282us (5109us total) trans 0 rc 0/0 00000100:00100000:1.0:1789049359.262871:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:0.0:1789049359.263367:0:7645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb8c59cbb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7ef694ec-1ea0-4f02-800c-d1279b4fdf12:7645:1875954110579712:0@lo:502: 00000040:00080000:0.0:1789049359.263485:0:7645:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].38, 224 off14656 00000040:00080000:0.0:1789049359.263502:0:7645:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 38 count 39 00000020:01000004:3.0:1789049359.265321:0:7658:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0001 (typ=lwp) 00000020:00000080:3.0:1789049359.265336:0:7658:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0001 (ffff8cb8c7c6b380) 00000020:00000080:3.0:1789049359.265357:0:7658:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type lwp with refcount 2 00000020:01000004:3.0:1789049359.265422:0:7658:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8cb8c631b800 from lustre-OST0001, refs=3 00000020:01000004:3.0:1789049359.265426:0:7658:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8cb8c631b800 from lustre-OST0001, refs=3 00000020:01000004:3.0:1789049359.265428:0:7658:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8cb8c631b800 3 00010000:00080000:3.0:1789049359.265457:0:7658:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8cb8f7b30800@lustre-MDT0000-lwp-OST0001: add connection 192.168.206.126@tcp at head 00010000:00010000:0.0:1789049359.271491:0:7658:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0001-4 is initialized 00000020:00000080:0.0:1789049359.271742:0:7658:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000010:01000000:0.0:1789049359.271797:0:7658:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1789049359.271809:0:7658:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-OST0001, cookie 0xf4f48ce5e1bbec9d 00000100:00080000:0.0:1789049359.271819:0:7658:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1789049359.271836:0:7658:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8cb8f7b30800 using connection 192.168.206.126@tcp/0@lo 00000100:00100000:0.0:1789049359.271886:0:7658:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8cb8fc99bb80 x1875954110579840/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1789049359.271906:0:7658:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00100000:1.0:1789049359.272124:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789049359.272139:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb8d0ab6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3308:1875954110579968:0@lo:400: 00000100:00100000:1.0:1789049359.272206:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000040:00080000:1.0:1789049359.272456:0:7658:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 39 count 39 00000100:00080000:1.0:1789049359.272584:0:7659:0:(client.c:1846:ptlrpc_send_new_req()) @@@ req waiting for recovery: (FULL != CONNECTING) req@ffff8cb8d0ab7480 x1875954110580352/t0(0) o901->lustre-MDT0000-lwp-OST0001@0@lo:29/10 lens 248/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789049359.272593:0:7659:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cb8d0b1b6c0 going to sleep for 0 seconds 00000020:01000000:0.0:1789049359.273157:0:7645:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-38 (rc=0) 10000000:01000000:0.0:1789049359.273185:0:7645:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.126@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1789049359.273202:0:7645:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.126@tcp lock: ffff8cb7c4c38c00/0xf4f48ce5e1bbec88 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf4f48ce5e1bbec8f expref: -99 pid: 7645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049359.273212:0:7645:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.126@tcp lock: ffff8cb7c4c38c00/0xf4f48ce5e1bbec88 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf4f48ce5e1bbec8f expref: -99 pid: 7645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:0.0:1789049359.273255:0:7645:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:0.0:1789049359.273257:0:7645:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1789049359.273258:0:7645:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789049359.273259:0:7645:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1789049359.273260:0:7645:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789049359.273261:0:7645:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789049359.273263:0:7645:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1789049359.273264:0:7645:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1789049359.273266:0:7645:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1789049359.273267:0:7645:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789049359.273268:0:7645:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1789049359.273272:0:7645:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x40020062 00000020:01000004:0.0:1789049359.273274:0:7645:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1789049359.273275:0:7645:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1789049359.273276:0:7645:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789049359.273277:0:7645:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1789049359.273279:0:7645:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789049359.273280:0:7645:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789049359.273281:0:7645:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1789049359.273282:0:7645:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1789049359.273283:0:7645:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1789049359.273284:0:7645:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789049359.273285:0:7645:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1789049359.273306:0:7645:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:0.0:1789049359.273315:0:7645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb8fc99ad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7ef694ec-1ea0-4f02-800c-d1279b4fdf12:7645:1875954110580480:0@lo:253: 00000100:00100000:0.0:1789049359.273370:0:7645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789049359.273406:0:7645:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cb8c79f8840 going to sleep for 11 seconds 00000100:00100000:0.0:1789049359.273548:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb8d0ab4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3311:1875954110580224:0@lo:400: 00000100:00100000:0.0:1789049359.273576:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789049359.273607:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1789049359.273613:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb8d0ab7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3311:1875954110580096:0@lo:400: 00000100:00100000:0.0:1789049359.273634:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789049359.273668:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb8fc99bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3307:1875954110579840:0@lo:38: 00000100:00100000:0.0:1789049359.273704:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789049359.273766:0:6705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954110580224 00000100:00100000:1.0:1789049359.273773:0:6705:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954110580224 00000100:00100000:1.0:1789049359.273830:0:6705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1789049359.273839:0:6705:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8fc999500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3311:x1875954110580224:12345-0@lo:400: 00000100:00100000:1.0:1789049359.273907:0:6705:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8fc999500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3311:x1875954110580224:12345-0@lo:400: Request processed in 69us (329us total) trans 0 rc 0/0 00000100:00100000:1.0:1789049359.273914:0:6705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:1.0:1789049359.273949:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8cb8d0ab4700 x1875954110580224/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789049375 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789049359.273961:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb8d0ab4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3311:1875954110580224:0@lo:400: 00000100:00080000:0.0:1789049359.274013:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789049359.274743:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954110579968 00000100:00100000:2.0:1789049359.274750:0:5852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954110579968 00000100:00100000:2.0:1789049359.274780:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954110580096 00000100:00100000:2.0:1789049359.274783:0:5852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954110580096 00000100:00100000:2.0:1789049359.274813:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954110579840 00000100:00100000:2.0:1789049359.274816:0:5852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954110579840 00000100:00100000:2.0:1789049359.274826:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1789049359.274833:0:5852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8d0ab4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1875954110579968:12345-0@lo:400: 00000100:00100000:2.0:1789049359.274909:0:5852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8d0ab4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1875954110579968:12345-0@lo:400: Request processed in 75us (2702us total) trans 0 rc 0/0 00000100:00100000:2.0:1789049359.274915:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1789049359.274928:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1789049359.274935:0:5852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8fc998e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1875954110580096:12345-0@lo:400: 00000100:00100000:2.0:1789049359.274967:0:5852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8fc998e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1875954110580096:12345-0@lo:400: Request processed in 33us (1331us total) trans 0 rc 0/0 00000100:00100000:2.0:1789049359.274984:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1789049359.274996:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1789049359.275000:0:5852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8fc998a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3307:x1875954110579840:12345-0@lo:38: 00010000:00080000:2.0:1789049359.275034:0:5852:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 185 last 0 00000020:00000080:2.0:1789049359.275137:0:5852:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0xf4f48ce5e1bbeca4 00000004:00100000:2.0:1789049359.275152:0:5852:0:(mdt_handler.c:7315:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1789049359.275182:0:5852:0:(import.c:65:import_set_state_nolock()) ffff8cb7c4c11000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1789049359.275222:0:5852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8fc998a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1875954110579840:12345-0@lo:38: Request processed in 220us (1517us total) trans 0 rc 0/0 00000100:00100000:2.0:1789049359.275230:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:2.0:1789049359.275286:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8cb8d0ab6d80 x1875954110579968/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789049375 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789049359.275299:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb8d0ab6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3308:1875954110579968:0@lo:400: 00010000:00080000:2.0:1789049359.275334:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8cb8fc99bb80 x1875954110579840/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1789049369 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789049359.275342:0:3307:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:2.0:1789049359.275349:0:3307:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 1 00000100:00080000:2.0:1789049359.275358:0:3307:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:2.0:1789049359.275363:0:3307:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:2.0:1789049359.275365:0:3307:0:(import.c:65:import_set_state_nolock()) ffff8cb8f7b30800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00080000:2.0:1789049359.275372:0:3307:0:(recover.c:191:ptlrpc_wake_delayed()) @@@ waking (set 00000000fc452f29): req@ffff8cb8d0ab7480 x1875954110580352/t0(0) o901->lustre-MDT0000-lwp-OST0001@0@lo:29/10 lens 248/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789049359.275388:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb8fc99bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3307:1875954110579840:0@lo:38: 00010000:00080000:2.0:1789049359.275411:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8cb8d0ab7800 x1875954110580096/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789049375 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789049359.275428:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb8d0ab7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3311:1875954110580096:0@lo:400: 00000100:00100000:2.0:1789049359.275515:0:7659:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789049359.275545:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954110580352 00000100:00100000:2.0:1789049359.275550:0:5861:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954110580352 00000100:00100000:2.0:1789049359.275577:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1789049359.275583:0:5861:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8c59ca680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-OST0001_UUID+5:7659:x1875954110580352:12345-0@lo:901: 00000100:00100000:2.0:1789049359.275966:0:5861:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8c59ca680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-OST0001_UUID+5:7659:x1875954110580352:12345-0@lo:901: Request processed in 382us (450us total) trans 0 rc 0/0 00000100:00100000:2.0:1789049359.275973:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:2.0:1789049359.276004:0:7659:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8cb8d0ab7480 x1875954110580352/t0(0) o901->lustre-MDT0000-lwp-OST0001@0@lo:29/10 lens 248/4320 e 0 to 0 dl 1789049375 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789049359.276012:0:7659:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb8d0ab7480 pname:cluuid:pid:xid:nid:opc:job lwp_notify_lust:lustre-MDT0000-lwp-OST0001_UUID:7659:1875954110580352:0@lo:901: 00000100:00100000:3.0:1789049359.276286:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954110580480 00000100:00100000:3.0:1789049359.276303:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954110580480 00000100:00100000:3.0:1789049359.276336:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:3.0:1789049359.276343:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8c6297050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7ef694ec-1ea0-4f02-800c-d1279b4fdf12+14:7645:x1875954110580480:12345-0@lo:253: 20000000:01000000:3.0:1789049359.276369:0:5844:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:3.0:1789049359.276383:0:5844:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00080000:1.0:1789049359.278666:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 20000000:01000000:3.0:1789049359.318348:0:5844:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:3.0:1789049359.318369:0:5844:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 20000000:01000000:0.0:1789049359.318470:0:5866:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1789049359.318475:0:5866:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1789049359.318496:0:5866:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8cb7c4c38400/0xf4f48ce5e1bbecab lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5866 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049359.318513:0:5866:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8cb8c146c600/0xf4f48ce5e1bbebfc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf4f48ce5e1bbebf5 expref: 14 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049359.318522:0:5866:0:(ldlm_resource.c:1751:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8cb7c4c38400/0xf4f48ce5e1bbecab lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5866 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049359.318562:0:5866:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8cb8c146c600/0xf4f48ce5e1bbebfc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf4f48ce5e1bbebf5 expref: 14 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049359.318576:0:5866:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8cb8c146c600/0xf4f48ce5e1bbebfc lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf4f48ce5e1bbebf5 expref: 14 pid: 5843 timeout: 335 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789049359.318589:0:5866:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb8fc999c00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5866:1875954110580608:0@lo:104: 00000100:00100000:0.0:1789049359.318665:0:5866:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789049359.318724:0:5866:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cb8c79f86c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789049359.318813:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954110580608 00000100:00100000:3.0:1789049359.318821:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954110580608 00000100:00100000:3.0:1789049359.318883:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1789049359.318892:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8fc99a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:7ef694ec-1ea0-4f02-800c-d1279b4fdf12+3:5866:x1875954110580608:12345-0@lo:104: 00010000:00010000:3.0:1789049359.318904:0:5834:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.126@tcp lock: ffff8cb8d776ea00/0xf4f48ce5e1bbebf5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xf4f48ce5e1bbebfc expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049359.318959:0:5834:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1789049359.318965:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8fc99a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:7ef694ec-1ea0-4f02-800c-d1279b4fdf12+3:5866:x1875954110580608:12345-0@lo:104: Request processed in 75us (300us total) trans 0 rc 0/0 00000100:00100000:3.0:1789049359.318980:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00010000:3.0:1789049359.319002:0:6719:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789049359.319008:0:6719:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.126@tcp lock: ffff8cb8d776ea00/0xf4f48ce5e1bbebf5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xf4f48ce5e1bbebfc expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049359.319031:0:6719:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cb8d776ea00 already unused, calling callback (ffffffffc1ca3c20) 10000000:00010000:3.0:1789049359.319034:0:6719:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.126@tcp lock: ffff8cb8d776ea00/0xf4f48ce5e1bbebf5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xf4f48ce5e1bbebfc expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049359.319043:0:6719:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.126@tcp lock: ffff8cb8d776ea00/0xf4f48ce5e1bbebf5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xf4f48ce5e1bbebfc expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789049359.319051:0:6719:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.126@tcp lock: ffff8cb8d776ea00/0xf4f48ce5e1bbebf5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xf4f48ce5e1bbebfc expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789049359.319057:0:6719:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1789049359.319084:0:6719:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.126@tcp lock: ffff8cb8d776ea00/0xf4f48ce5e1bbebf5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf4f48ce5e1bbebfc expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049359.319090:0:6719:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789049359.319108:0:6719:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.126@tcp lock: ffff8cb8d776ea00/0xf4f48ce5e1bbebf5 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf4f48ce5e1bbebfc expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049359.319115:0:6719:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.126@tcp lock: ffff8cb8d776ea00/0xf4f48ce5e1bbebf5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf4f48ce5e1bbebfc expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049359.319130:0:6719:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789049359.319132:0:6719:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789049359.319134:0:6719:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789049359.319145:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb8f73c6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7ef694ec-1ea0-4f02-800c-d1279b4fdf12:3308:1875954110580736:0@lo:103: 00000100:00100000:3.0:1789049359.319183:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789049359.319214:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954110580736 00000100:00100000:3.0:1789049359.319218:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954110580736 00010000:00010000:3.0:1789049359.319236:0:5836:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8cb8c146c600/0xf4f48ce5e1bbebfc lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf4f48ce5e1bbebf5 expref: 15 pid: 5843 timeout: 335 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789049359.319257:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1789049359.319264:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8c7dec450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7ef694ec-1ea0-4f02-800c-d1279b4fdf12+15:3308:x1875954110580736:12345-0@lo:103: 00010000:00010000:3.0:1789049359.319273:0:5836:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789049359.319278:0:5836:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8cb8c146c600/0xf4f48ce5e1bbebfc lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf4f48ce5e1bbebf5 expref: 15 pid: 5843 timeout: 335 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049359.319288:0:5836:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8cb8c146c600/0xf4f48ce5e1bbebfc lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf4f48ce5e1bbebf5 expref: 15 pid: 5843 timeout: 335 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049359.319303:0:5836:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8cb7c4c38400/0xf4f48ce5e1bbecab lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5866 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049359.319311:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cb7c4c38400/0xf4f48ce5e1bbecab lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5866 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1789049359.319323:0:5836:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.002812352s 00010000:00010000:3.0:1789049359.319327:0:5836:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8cb7c4c38400/0xf4f48ce5e1bbecab lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5866 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049359.319334:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8cb7c4c38400/0xf4f48ce5e1bbecab lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5866 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049359.319340:0:5836:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8cb7c4c38400/0xf4f48ce5e1bbecab lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5866 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049359.319357:0:5836:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8cb7c4c38400/0xf4f48ce5e1bbecab lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5866 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049359.319362:0:5836:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cb7c4c38400 already unused, calling callback (ffffffffc166a8f0) 00010000:00010000:3.0:1789049359.319366:0:5836:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8cb7c4c38400/0xf4f48ce5e1bbecab lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5866 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049359.319373:0:5836:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8cb7c4c38400/0xf4f48ce5e1bbecab lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5866 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049359.319382:0:5836:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8cb7c4c38400/0xf4f48ce5e1bbecab lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5866 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049359.319391:0:5836:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789049359.319419:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8c7dec450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7ef694ec-1ea0-4f02-800c-d1279b4fdf12+15:3308:x1875954110580736:12345-0@lo:103: Request processed in 155us (235us total) trans 0 rc 0/0 00000100:00100000:3.0:1789049359.319425:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1789049359.319488:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb8f73c6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7ef694ec-1ea0-4f02-800c-d1279b4fdf12:3308:1875954110580736:0@lo:103: 00010000:00010000:0.0:1789049359.319696:0:5866:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cb8c146c600/0xf4f48ce5e1bbebfc lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf4f48ce5e1bbebf5 expref: 14 pid: 5843 timeout: 335 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789049359.319706:0:5866:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb8fc999c00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5866:1875954110580608:0@lo:104: 00010000:00010000:0.0:1789049359.319718:0:5866:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8cb7c4c38400/0xf4f48ce5e1bbecab lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5866 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049359.319726:0:5866:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8cb7c4c38400/0xf4f48ce5e1bbecab lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5866 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049359.319733:0:5866:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8cb7c4c38400/0xf4f48ce5e1bbecab lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5866 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049359.319738:0:5866:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cb7c4c38400/0xf4f48ce5e1bbecab lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5866 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789049359.330293:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8c6297050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7ef694ec-1ea0-4f02-800c-d1279b4fdf12+13:7645:x1875954110580480:12345-0@lo:253: Request processed in 53942us (56915us total) trans 0 rc 0/0 00000100:00100000:1.0:1789049359.330322:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:0.0:1789049359.330405:0:7645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb8fc99ad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7ef694ec-1ea0-4f02-800c-d1279b4fdf12:7645:1875954110580480:0@lo:253: 10000000:01000000:0.0:1789049359.330419:0:7645:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:0.0:1789049359.330422:0:7645:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1789049359.330424:0:7645:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1789049359.330425:0:7645:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789049359.330427:0:7645:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1789049359.330428:0:7645:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789049359.330429:0:7645:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789049359.330431:0:7645:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1789049359.330432:0:7645:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1789049359.330434:0:7645:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1789049359.330435:0:7645:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789049359.330437:0:7645:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:0.0:1789049359.330449:0:7645:0:(tgt_mount.c:2694:server_calc_timeout()) lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:0.0:1789049359.339310:0:7645:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:0.0:1789049359.339504:0:7645:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:0.0:1789049359.339742:0:7645:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:0.0:1789049359.339958:0:7645:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:0.0:1789049359.340164:0:7645:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:0.0:1789049359.340377:0:7645:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:0.0:1789049359.347267:0:7645:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967296 00002000:00080000:3.0:1789049359.575236:0:7645:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0001: recovery is over 00100000:10000000:3.0:1789049359.575244:0:7645:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0001-osd: start master thread 00000020:01000004:3.0:1789049359.575278:0:7645:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:3.0:1789049359.575333:0:7645:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.206.126@tcp: cl_mgc_mutex unlock 00000020:01000004:3.0:1789049359.575347:0:7645:0:(tgt_mount.c:2460:server_fill_super_common()) Server sb, dev=49 00000080:00000004:3.0:1789049359.575376:0:7645:0:(super25.c:182:lustre_fill_super()) lustre-ost2/ost2: Mount complete 00010000:00010000:3.0:1789049360.101197:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789049361.117498:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789049362.139335:0:6719:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789049362.846483:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789049362.846511:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb8f73c6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1875954110580864:0@lo:13: 00000100:00100000:2.0:1789049362.846586:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789049362.846719:0:6706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954110580864 00000100:00100000:3.0:1789049362.846727:0:6706:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954110580864 00000100:00100000:3.0:1789049362.846795:0:6706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1789049362.846815:0:6706:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8c59c8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1875954110580864:12345-0@lo:13: 00002000:00000024:3.0:1789049362.846878:0:6706:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00080000:1.0:1789049362.847123:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789049362.847174:0:6706:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8c59c8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1875954110580864:12345-0@lo:13: Request processed in 360us (588us total) trans 0 rc 0/0 00000100:00100000:3.0:1789049362.847182:0:6706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:2.0:1789049362.847259:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cb8f73c6d80 x1875954110580864/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789049378 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789049362.847280:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb8f73c6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1875954110580864:0@lo:13: 00010000:00010000:3.0:1789049363.162965:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789049364.188381:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789049364.380575:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb8fc99ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7ef694ec-1ea0-4f02-800c-d1279b4fdf12:3310:1875954110580992:0@lo:400: 00000100:00100000:0.0:1789049364.380640:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789049364.380696:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb8fc99b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3310:1875954110581504:0@lo:400: 00000100:00100000:0.0:1789049364.380751:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789049364.380779:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789049364.380785:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb8fc999c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3310:1875954110581120:0@lo:400: 00000100:00100000:0.0:1789049364.380807:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789049364.380836:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb8fc99bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3308:1875954110581248:0@lo:400: 00000100:00100000:0.0:1789049364.380879:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789049364.380899:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789049364.380904:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb8fc998000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1875954110581376:0@lo:400: 00000100:00100000:0.0:1789049364.380927:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789049364.380956:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954110580992 00000100:00100000:0.0:1789049364.380964:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954110580992 00000100:00100000:0.0:1789049364.381677:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:0.0:1789049364.381694:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8c6294050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7ef694ec-1ea0-4f02-800c-d1279b4fdf12+13:3310:x1875954110580992:12345-0@lo:400: 00000100:00100000:0.0:1789049364.381812:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8c6294050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7ef694ec-1ea0-4f02-800c-d1279b4fdf12+13:3310:x1875954110580992:12345-0@lo:400: Request processed in 121us (1171us total) trans 0 rc 0/0 00000100:00100000:0.0:1789049364.381820:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:0.0:1789049364.381873:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954110581504 00000100:00100000:0.0:1789049364.381887:0:5852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954110581504 00000100:00100000:0.0:1789049364.381924:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954110581120 00000100:00100000:0.0:1789049364.381927:0:5852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954110581120 00000100:00100000:0.0:1789049364.381939:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954110581248 00000100:00100000:0.0:1789049364.381941:0:5852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954110581248 00000100:00100000:0.0:1789049364.381955:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1789049364.381961:0:5852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8c6323b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1875954110581504:12345-0@lo:400: 00000100:00100000:0.0:1789049364.382009:0:5852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8c6323b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1875954110581504:12345-0@lo:400: Request processed in 48us (1258us total) trans 0 rc 0/0 00000100:00100000:0.0:1789049364.382016:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1789049364.382186:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1789049364.382193:0:5852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8c6320380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1875954110581120:12345-0@lo:400: 00000100:00100000:0.0:1789049364.382224:0:5852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8c6320380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1875954110581120:12345-0@lo:400: Request processed in 31us (1416us total) trans 0 rc 0/0 00000100:00100000:0.0:1789049364.382229:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1789049364.382240:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1789049364.382246:0:5852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8c6322300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1875954110581248:12345-0@lo:400: 00000100:00100000:0.0:1789049364.382274:0:5852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8c6322300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1875954110581248:12345-0@lo:400: Request processed in 29us (1394us total) trans 0 rc 0/0 00000100:00100000:0.0:1789049364.382280:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1789049364.382305:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954110581376 00000100:00100000:0.0:1789049364.382309:0:6704:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954110581376 00000100:00100000:0.0:1789049364.382334:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1789049364.382341:0:6704:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8c6322a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3308:x1875954110581376:12345-0@lo:400: 00000100:00100000:0.0:1789049364.382370:0:6704:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8c6322a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3308:x1875954110581376:12345-0@lo:400: Request processed in 29us (1442us total) trans 0 rc 0/0 00000100:00100000:0.0:1789049364.382376:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:0.0:1789049364.382426:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cb8fc998000 x1875954110581376/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789049380 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789049364.382446:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb8fc998000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1875954110581376:0@lo:400: 00010000:00080000:0.0:1789049364.382459:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cb8fc99bb80 x1875954110581248/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789049380 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789049364.382467:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb8fc99bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3308:1875954110581248:0@lo:400: 00000100:00080000:2.0:1789049364.382765:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1789049364.382770:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789049364.383738:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb8fc99ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7ef694ec-1ea0-4f02-800c-d1279b4fdf12:3310:1875954110580992:0@lo:400: 00010000:00080000:1.0:1789049364.383761:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cb8fc99b800 x1875954110581504/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789049380 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789049364.383771:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb8fc99b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3310:1875954110581504:0@lo:400: 00010000:00080000:1.0:1789049364.383793:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cb8fc999c00 x1875954110581120/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789049380 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789049364.383802:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb8fc999c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3310:1875954110581120:0@lo:400: 00010000:00010000:2.0:1789049365.217877:0:6719:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1789049365.875564:0:8003:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg626-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:3.0:1789049366.235347:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789049367.262518:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789049367.963119:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb8f73c5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3311:1875954110581632:0@lo:13: 00000100:00100000:0.0:1789049367.963191:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789049367.963275:0:6707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954110581632 00000100:00100000:2.0:1789049367.963284:0:6707:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954110581632 00000100:00080000:3.0:1789049367.963434:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789049367.963835:0:6707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1789049367.963873:0:6707:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8c6323480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1875954110581632:12345-0@lo:13: 00002000:00000024:2.0:1789049367.963928:0:6707:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789049367.963994:0:6707:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8c6323480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1875954110581632:12345-0@lo:13: Request processed in 150us (802us total) trans 0 rc 0/0 00000100:00100000:2.0:1789049367.964002:0:6707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:1.0:1789049367.964145:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cb8f73c5f80 x1875954110581632/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789049383 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789049367.964162:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb8f73c5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3311:1875954110581632:0@lo:13: 00010000:00010000:2.0:1789049368.283188:0:6719:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1789049368.989695:0:5848:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1789049368.989701:0:5848:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8cb8d1c83000 from 30 10000000:01000000:1.0:1789049368.989707:0:5848:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1789049368.989745:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.126@tcp lock: ffff8cb8c146dc00/0xf4f48ce5e1bbecb2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049368.989757:0:5848:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.126@tcp lock: ffff8cb8c146dc00/0xf4f48ce5e1bbecb2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049368.989767:0:5848:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.126@tcp lock: ffff8cb8c146dc00/0xf4f48ce5e1bbecb2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789049368.989790:0:5848:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb8d0ab4700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7ef694ec-1ea0-4f02-800c-d1279b4fdf12:5848:1875954110581760:0@lo:101: 00000100:00100000:1.0:1789049368.989882:0:5848:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789049368.989922:0:5848:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cb8df429b40 going to sleep for 11 seconds 00000100:00100000:1.0:1789049368.989942:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954110581760 00000100:00100000:1.0:1789049368.989949:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954110581760 00000100:00100000:1.0:1789049368.989994:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:1.0:1789049368.990003:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8c6294c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7ef694ec-1ea0-4f02-800c-d1279b4fdf12+13:5848:x1875954110581760:12345-0@lo:101: 00010000:00010000:1.0:1789049368.990016:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789049368.990027:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cb8c146c600/0xf4f48ce5e1bbecb9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xf4f48ce5e1bbecb2 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049368.990050:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cb8c146c600/0xf4f48ce5e1bbecb9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf4f48ce5e1bbecb2 expref: 14 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049368.990060:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cb8c146c600/0xf4f48ce5e1bbecb9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf4f48ce5e1bbecb2 expref: 14 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049368.990069:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cb8c146c600, rc 0) 00000100:00100000:1.0:1789049368.990106:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8c6294c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7ef694ec-1ea0-4f02-800c-d1279b4fdf12+14:5848:x1875954110581760:12345-0@lo:101: Request processed in 104us (223us total) trans 0 rc 0/0 00000100:00100000:1.0:1789049368.990112:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:1.0:1789049368.990163:0:5848:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb8d0ab4700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7ef694ec-1ea0-4f02-800c-d1279b4fdf12:5848:1875954110581760:0@lo:101: 00010000:00010000:1.0:1789049368.990178:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.126@tcp lock: ffff8cb8c146dc00/0xf4f48ce5e1bbecb2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf4f48ce5e1bbecb9 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049368.990187:0:5848:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.126@tcp lock: ffff8cb8c146dc00/0xf4f48ce5e1bbecb2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xf4f48ce5e1bbecb9 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789049368.990233:0:5848:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb8d0ab4700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7ef694ec-1ea0-4f02-800c-d1279b4fdf12:5848:1875954110581888:0@lo:501: 00000100:00100000:1.0:1789049368.990264:0:5848:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789049368.990293:0:5848:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cb8df429b40 going to sleep for 11 seconds 00000100:00100000:1.0:1789049368.990306:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954110581888 00000100:00100000:1.0:1789049368.990309:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954110581888 00000100:00100000:1.0:1789049368.990329:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:1.0:1789049368.990334:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8c6296450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7ef694ec-1ea0-4f02-800c-d1279b4fdf12+14:5848:x1875954110581888:12345-0@lo:501: 00000100:00100000:1.0:1789049368.992781:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8c6296450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7ef694ec-1ea0-4f02-800c-d1279b4fdf12+14:5848:x1875954110581888:12345-0@lo:501: Request processed in 2440us (2510us total) trans 0 rc 0/0 00000100:00100000:1.0:1789049368.992792:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:1.0:1789049368.992894:0:5848:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb8d0ab4700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7ef694ec-1ea0-4f02-800c-d1279b4fdf12:5848:1875954110581888:0@lo:501: 00000100:00100000:1.0:1789049368.992939:0:5848:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb8d0ab4700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7ef694ec-1ea0-4f02-800c-d1279b4fdf12:5848:1875954110582016:0@lo:503: 00000100:00100000:1.0:1789049368.992979:0:5848:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789049368.993006:0:5848:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cb8df429b40 going to sleep for 11 seconds 00000100:00100000:1.0:1789049368.993022:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954110582016 00000100:00100000:1.0:1789049368.993027:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954110582016 00000100:00100000:1.0:1789049368.993059:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:1.0:1789049368.993066:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8c6297450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7ef694ec-1ea0-4f02-800c-d1279b4fdf12+14:5848:x1875954110582016:12345-0@lo:503: 00000100:00100000:1.0:1789049368.993327:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8c6297450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7ef694ec-1ea0-4f02-800c-d1279b4fdf12+14:5848:x1875954110582016:12345-0@lo:503: Request processed in 261us (347us total) trans 0 rc 0/0 00000100:00100000:1.0:1789049368.993334:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:1.0:1789049368.993365:0:5848:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb8d0ab4700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7ef694ec-1ea0-4f02-800c-d1279b4fdf12:5848:1875954110582016:0@lo:503: 00000100:00100000:0.0:1789049368.999191:0:8121:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb8c6321c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7ef694ec-1ea0-4f02-800c-d1279b4fdf12:8121:1875954110582144:0@lo:502: 00000100:00100000:0.0:1789049368.999263:0:8121:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789049368.999304:0:8121:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cb8c79f8000 going to sleep for 11 seconds 00000100:00100000:1.0:1789049368.999348:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954110582144 00000100:00100000:1.0:1789049368.999355:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954110582144 00000100:00100000:1.0:1789049368.999407:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:1.0:1789049368.999415:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8c6297c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7ef694ec-1ea0-4f02-800c-d1279b4fdf12+14:8121:x1875954110582144:12345-0@lo:502: 00000100:00100000:1.0:1789049368.999712:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8c6297c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7ef694ec-1ea0-4f02-800c-d1279b4fdf12+14:8121:x1875954110582144:12345-0@lo:502: Request processed in 297us (448us total) trans 0 rc 0/0 00000100:00100000:1.0:1789049368.999724:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:0.0:1789049368.999892:0:8121:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb8c6321c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7ef694ec-1ea0-4f02-800c-d1279b4fdf12:8121:1875954110582144:0@lo:502: 00000100:00100000:0.0:1789049368.999954:0:8121:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb8c6321c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7ef694ec-1ea0-4f02-800c-d1279b4fdf12:8121:1875954110582272:0@lo:502: 00000100:00100000:0.0:1789049368.999988:0:8121:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789049369.000013:0:8121:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cb8c79f8000 going to sleep for 11 seconds 00000100:00100000:3.0:1789049369.000061:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954110582272 00000100:00100000:3.0:1789049369.000066:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954110582272 00000100:00100000:3.0:1789049369.000096:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:3.0:1789049369.000104:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8c6295850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7ef694ec-1ea0-4f02-800c-d1279b4fdf12+14:8121:x1875954110582272:12345-0@lo:502: 00000100:00100000:3.0:1789049369.000235:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8c6295850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7ef694ec-1ea0-4f02-800c-d1279b4fdf12+14:8121:x1875954110582272:12345-0@lo:502: Request processed in 132us (246us total) trans 0 rc 0/0 00000100:00100000:3.0:1789049369.000242:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:0.0:1789049369.000398:0:8121:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb8c6321c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7ef694ec-1ea0-4f02-800c-d1279b4fdf12:8121:1875954110582272:0@lo:502: 00000040:00080000:0.0:1789049369.000418:0:8121:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000020:01000000:3.0:1789049369.000563:0:5848:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 30-38 (rc=0) 10000000:01000000:3.0:1789049369.000581:0:5848:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.126@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1789049369.000589:0:5848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.126@tcp lock: ffff8cb8c146dc00/0xf4f48ce5e1bbecb2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf4f48ce5e1bbecb9 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049369.000600:0:5848:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.126@tcp lock: ffff8cb8c146dc00/0xf4f48ce5e1bbecb2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf4f48ce5e1bbecb9 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789049369.000609:0:5848:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:3.0:1789049369.000611:0:5848:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 8 10000000:01000000:3.0:1789049369.000614:0:5848:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:3.0:1789049369.000645:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.126@tcp lock: ffff8cb8d776f400/0xf4f48ce5e1bbecc0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049369.000659:0:5848:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.126@tcp lock: ffff8cb8d776f400/0xf4f48ce5e1bbecc0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049369.000668:0:5848:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.126@tcp lock: ffff8cb8d776f400/0xf4f48ce5e1bbecc0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789049369.000680:0:5848:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb8f73c4000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7ef694ec-1ea0-4f02-800c-d1279b4fdf12:5848:1875954110582400:0@lo:101: 00000100:00100000:3.0:1789049369.000708:0:5848:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789049369.000735:0:5848:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cb8c62d9480 going to sleep for 11 seconds 00000100:00100000:0.0:1789049369.004804:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954110582400 00000100:00100000:0.0:1789049369.004817:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954110582400 00000100:00100000:0.0:1789049369.004876:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:0.0:1789049369.004886:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8c6295050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7ef694ec-1ea0-4f02-800c-d1279b4fdf12+14:5848:x1875954110582400:12345-0@lo:101: 00010000:00010000:0.0:1789049369.004903:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789049369.004919:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cb7c4c39200/0xf4f48ce5e1bbecc7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xf4f48ce5e1bbecc0 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049369.005321:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cb7c4c39200/0xf4f48ce5e1bbecc7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf4f48ce5e1bbecc0 expref: 15 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049369.005334:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cb7c4c39200/0xf4f48ce5e1bbecc7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf4f48ce5e1bbecc0 expref: 15 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049369.005343:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cb7c4c39200, rc 0) 00000100:00100000:1.0:1789049369.005483:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8c6295050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7ef694ec-1ea0-4f02-800c-d1279b4fdf12+15:5848:x1875954110582400:12345-0@lo:101: Request processed in 598us (4773us total) trans 0 rc 0/0 00000100:00100000:1.0:1789049369.005490:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:3.0:1789049369.005689:0:5848:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb8f73c4000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7ef694ec-1ea0-4f02-800c-d1279b4fdf12:5848:1875954110582400:0@lo:101: 00010000:00010000:3.0:1789049369.005710:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.126@tcp lock: ffff8cb8d776f400/0xf4f48ce5e1bbecc0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xf4f48ce5e1bbecc7 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049369.005719:0:5848:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.126@tcp lock: ffff8cb8d776f400/0xf4f48ce5e1bbecc0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xf4f48ce5e1bbecc7 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789049369.005784:0:5848:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb8f73c4000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7ef694ec-1ea0-4f02-800c-d1279b4fdf12:5848:1875954110582528:0@lo:501: 00000100:00100000:3.0:1789049369.005822:0:5848:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789049369.005883:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954110582528 00000100:00100000:0.0:1789049369.005888:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954110582528 00000100:00100000:3.0:1789049369.005918:0:5848:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cb8c62d9480 going to sleep for 11 seconds 00000100:00100000:0.0:1789049369.005920:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:0.0:1789049369.005928:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8c6297850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7ef694ec-1ea0-4f02-800c-d1279b4fdf12+15:5848:x1875954110582528:12345-0@lo:501: 00000100:00100000:2.0:1789049369.007237:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8c6297850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7ef694ec-1ea0-4f02-800c-d1279b4fdf12+15:5848:x1875954110582528:12345-0@lo:501: Request processed in 1306us (1411us total) trans 0 rc 0/0 00000100:00100000:2.0:1789049369.007246:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:3.0:1789049369.009271:0:5848:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb8f73c4000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7ef694ec-1ea0-4f02-800c-d1279b4fdf12:5848:1875954110582528:0@lo:501: 00000100:00100000:3.0:1789049369.009344:0:5848:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb8f73c4000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7ef694ec-1ea0-4f02-800c-d1279b4fdf12:5848:1875954110582656:0@lo:503: 00000100:00100000:3.0:1789049369.009487:0:5848:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789049369.009529:0:5848:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cb8c62d9480 going to sleep for 11 seconds 00000100:00100000:1.0:1789049369.009589:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954110582656 00000100:00100000:1.0:1789049369.009596:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954110582656 00000100:00100000:1.0:1789049369.009650:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:1.0:1789049369.009659:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8c6294850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7ef694ec-1ea0-4f02-800c-d1279b4fdf12+15:5848:x1875954110582656:12345-0@lo:503: 00000100:00100000:1.0:1789049369.010029:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8c6294850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7ef694ec-1ea0-4f02-800c-d1279b4fdf12+15:5848:x1875954110582656:12345-0@lo:503: Request processed in 371us (541us total) trans 0 rc 0/0 00000100:00100000:1.0:1789049369.010036:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:0.0:1789049369.010155:0:5848:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb8f73c4000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7ef694ec-1ea0-4f02-800c-d1279b4fdf12:5848:1875954110582656:0@lo:503: 00000100:00100000:3.0:1789049369.014798:0:8122:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb8f73c5180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7ef694ec-1ea0-4f02-800c-d1279b4fdf12:8122:1875954110582784:0@lo:502: 00000100:00100000:3.0:1789049369.015029:0:8122:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789049369.015212:0:8122:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cb8c62d9000 going to sleep for 11 seconds 00000100:00100000:2.0:1789049369.015373:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954110582784 00000100:00100000:2.0:1789049369.015381:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954110582784 00000100:00100000:2.0:1789049369.015489:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:2.0:1789049369.015498:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8c6295c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7ef694ec-1ea0-4f02-800c-d1279b4fdf12+15:8122:x1875954110582784:12345-0@lo:502: 00000100:00100000:2.0:1789049369.015755:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8c6295c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7ef694ec-1ea0-4f02-800c-d1279b4fdf12+15:8122:x1875954110582784:12345-0@lo:502: Request processed in 258us (824us total) trans 0 rc 0/0 00000100:00100000:2.0:1789049369.015762:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:3.0:1789049369.015870:0:8122:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb8f73c5180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7ef694ec-1ea0-4f02-800c-d1279b4fdf12:8122:1875954110582784:0@lo:502: 00000020:01000000:3.0:1789049369.015897:0:8122:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789049369.015906:0:8122:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789049369.015908:0:8122:0:(obd_config.c:1563:class_process_config()) marker 21 (0x1) lustre sys.timeout 00000020:00000080:3.0:1789049369.015913:0:8122:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1789049369.015915:0:8122:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:3.0:1789049369.015932:0:8122:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb8f73c5180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7ef694ec-1ea0-4f02-800c-d1279b4fdf12:8122:1875954110582912:0@lo:502: 00000100:00100000:3.0:1789049369.015965:0:8122:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789049369.015993:0:8122:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cb8c62d9000 going to sleep for 11 seconds 00000100:00100000:0.0:1789049369.016085:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954110582912 00000100:00100000:0.0:1789049369.016089:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954110582912 00000100:00100000:0.0:1789049369.016119:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:0.0:1789049369.016127:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8c6296c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7ef694ec-1ea0-4f02-800c-d1279b4fdf12+15:8122:x1875954110582912:12345-0@lo:502: 00000100:00100000:0.0:1789049369.017783:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8c6296c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7ef694ec-1ea0-4f02-800c-d1279b4fdf12+15:8122:x1875954110582912:12345-0@lo:502: Request processed in 1649us (1809us total) trans 0 rc 0/0 00000100:00100000:0.0:1789049369.017796:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:2.0:1789049369.020919:0:8122:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb8f73c5180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7ef694ec-1ea0-4f02-800c-d1279b4fdf12:8122:1875954110582912:0@lo:502: 00000020:01000000:3.0:1789049369.021068:0:8122:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789049369.021077:0:8122:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789049369.021079:0:8122:0:(obd_config.c:1563:class_process_config()) marker 21 (0x2) lustre sys.timeout 00000040:00080000:3.0:1789049369.021085:0:8122:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 11 count 11 00000020:01000000:0.0:1789049369.021182:0:5848:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 8-10 (rc=0) 10000000:01000000:0.0:1789049369.021199:0:5848:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.126@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:0.0:1789049369.021209:0:5848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.126@tcp lock: ffff8cb8d776f400/0xf4f48ce5e1bbecc0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xf4f48ce5e1bbecc7 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049369.021221:0:5848:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.126@tcp lock: ffff8cb8d776f400/0xf4f48ce5e1bbecc0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xf4f48ce5e1bbecc7 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789049369.021230:0:5848:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1789049369.021233:0:5848:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8cb8e01c3000 from 30 10000000:01000000:0.0:1789049369.021235:0:5848:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1789049369.021266:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.126@tcp lock: ffff8cb7c4c38800/0xf4f48ce5e1bbecce lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049369.021273:0:5848:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.126@tcp lock: ffff8cb7c4c38800/0xf4f48ce5e1bbecce lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049369.021289:0:5848:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.126@tcp lock: ffff8cb7c4c38800/0xf4f48ce5e1bbecce lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789049369.021308:0:5848:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb8c6321c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7ef694ec-1ea0-4f02-800c-d1279b4fdf12:5848:1875954110583040:0@lo:101: 00000100:00100000:0.0:1789049369.021365:0:5848:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789049369.021404:0:5848:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cb8c79f8f00 going to sleep for 11 seconds 00000100:00100000:2.0:1789049369.021482:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954110583040 00000100:00100000:2.0:1789049369.021489:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954110583040 00000100:00100000:2.0:1789049369.021540:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:2.0:1789049369.021548:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8c6294450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7ef694ec-1ea0-4f02-800c-d1279b4fdf12+15:5848:x1875954110583040:12345-0@lo:101: 00010000:00010000:2.0:1789049369.021561:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789049369.021574:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cb8d6714400/0xf4f48ce5e1bbecd5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xf4f48ce5e1bbecce expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049369.021595:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cb8d6714400/0xf4f48ce5e1bbecd5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf4f48ce5e1bbecce expref: 16 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049369.021606:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cb8d6714400/0xf4f48ce5e1bbecd5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf4f48ce5e1bbecce expref: 16 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049369.021630:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cb8d6714400, rc 0) 00000100:00100000:2.0:1789049369.021676:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8c6294450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7ef694ec-1ea0-4f02-800c-d1279b4fdf12+16:5848:x1875954110583040:12345-0@lo:101: Request processed in 128us (310us total) trans 0 rc 0/0 00000100:00100000:2.0:1789049369.021682:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:0.0:1789049369.021703:0:5848:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb8c6321c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7ef694ec-1ea0-4f02-800c-d1279b4fdf12:5848:1875954110583040:0@lo:101: 00010000:00010000:0.0:1789049369.021715:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.126@tcp lock: ffff8cb7c4c38800/0xf4f48ce5e1bbecce lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xf4f48ce5e1bbecd5 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049369.021734:0:5848:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.126@tcp lock: ffff8cb7c4c38800/0xf4f48ce5e1bbecce lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xf4f48ce5e1bbecd5 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789049369.021777:0:5848:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb8c6321c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7ef694ec-1ea0-4f02-800c-d1279b4fdf12:5848:1875954110583168:0@lo:501: 00000100:00100000:0.0:1789049369.021802:0:5848:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789049369.021823:0:5848:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cb8c79f8f00 going to sleep for 11 seconds 00000100:00100000:3.0:1789049369.021924:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954110583168 00000100:00100000:3.0:1789049369.021928:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954110583168 00000100:00100000:3.0:1789049369.021960:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:3.0:1789049369.021967:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8c6295450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7ef694ec-1ea0-4f02-800c-d1279b4fdf12+16:5848:x1875954110583168:12345-0@lo:501: 00000100:00100000:3.0:1789049369.022203:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8c6295450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7ef694ec-1ea0-4f02-800c-d1279b4fdf12+16:5848:x1875954110583168:12345-0@lo:501: Request processed in 235us (399us total) trans 0 rc 0/0 00000100:00100000:3.0:1789049369.022209:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:0.0:1789049369.022299:0:5848:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb8c6321c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7ef694ec-1ea0-4f02-800c-d1279b4fdf12:5848:1875954110583168:0@lo:501: 00000100:00100000:0.0:1789049369.022326:0:5848:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb8c6321c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7ef694ec-1ea0-4f02-800c-d1279b4fdf12:5848:1875954110583296:0@lo:503: 00000100:00100000:0.0:1789049369.022364:0:5848:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789049369.022390:0:5848:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cb8c79f8f00 going to sleep for 11 seconds 00000100:00100000:3.0:1789049369.022469:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954110583296 00000100:00100000:3.0:1789049369.022473:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954110583296 00000100:00100000:3.0:1789049369.022503:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:3.0:1789049369.022509:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8c6296850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7ef694ec-1ea0-4f02-800c-d1279b4fdf12+16:5848:x1875954110583296:12345-0@lo:503: 00000100:00100000:3.0:1789049369.022644:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8c6296850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7ef694ec-1ea0-4f02-800c-d1279b4fdf12+16:5848:x1875954110583296:12345-0@lo:503: Request processed in 135us (279us total) trans 0 rc 0/0 00000100:00100000:3.0:1789049369.022651:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:0.0:1789049369.022696:0:5848:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb8c6321c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7ef694ec-1ea0-4f02-800c-d1279b4fdf12:5848:1875954110583296:0@lo:503: 00000100:00100000:3.0:1789049369.023366:0:8125:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb8f73c4700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7ef694ec-1ea0-4f02-800c-d1279b4fdf12:8125:1875954110583424:0@lo:502: 00000100:00100000:3.0:1789049369.023431:0:8125:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789049369.023462:0:8125:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cb8c62d9780 going to sleep for 11 seconds 00000100:00100000:0.0:1789049369.023526:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954110583424 00000100:00100000:0.0:1789049369.023531:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954110583424 00000100:00100000:0.0:1789049369.023566:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:0.0:1789049369.023572:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8c6296050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7ef694ec-1ea0-4f02-800c-d1279b4fdf12+16:8125:x1875954110583424:12345-0@lo:502: 00000100:00100000:0.0:1789049369.023775:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8c6296050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7ef694ec-1ea0-4f02-800c-d1279b4fdf12+16:8125:x1875954110583424:12345-0@lo:502: Request processed in 202us (343us total) trans 0 rc 0/0 00000100:00100000:0.0:1789049369.023781:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:3.0:1789049369.023927:0:8125:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb8f73c4700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7ef694ec-1ea0-4f02-800c-d1279b4fdf12:8125:1875954110583424:0@lo:502: 00000100:00100000:3.0:1789049369.023971:0:8125:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb8f73c4700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7ef694ec-1ea0-4f02-800c-d1279b4fdf12:8125:1875954110583552:0@lo:502: 00000100:00100000:3.0:1789049369.024001:0:8125:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789049369.024028:0:8125:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cb8c62d9780 going to sleep for 11 seconds 00000100:00100000:0.0:1789049369.024165:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954110583552 00000100:00100000:0.0:1789049369.024169:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954110583552 00000100:00100000:0.0:1789049369.024195:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:0.0:1789049369.024202:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8c6befc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7ef694ec-1ea0-4f02-800c-d1279b4fdf12+16:8125:x1875954110583552:12345-0@lo:502: 00000100:00100000:0.0:1789049369.024321:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8c6befc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7ef694ec-1ea0-4f02-800c-d1279b4fdf12+16:8125:x1875954110583552:12345-0@lo:502: Request processed in 119us (319us total) trans 0 rc 0/0 00000100:00100000:0.0:1789049369.024328:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:3.0:1789049369.024376:0:8125:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb8f73c4700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7ef694ec-1ea0-4f02-800c-d1279b4fdf12:8125:1875954110583552:0@lo:502: 00000040:00080000:3.0:1789049369.024460:0:8125:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000020:01000000:0.0:1789049369.024681:0:5848:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 30-38 (rc=0) 10000000:01000000:0.0:1789049369.024700:0:5848:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.126@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1789049369.024708:0:5848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.126@tcp lock: ffff8cb7c4c38800/0xf4f48ce5e1bbecce lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xf4f48ce5e1bbecd5 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049369.024719:0:5848:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.126@tcp lock: ffff8cb7c4c38800/0xf4f48ce5e1bbecce lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xf4f48ce5e1bbecd5 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789049369.024728:0:5848:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1789049369.024730:0:5848:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8cb8e01c3000 from 5 10000000:01000000:0.0:1789049369.024733:0:5848:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1789049369.024755:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.126@tcp lock: ffff8cb7c4c38600/0xf4f48ce5e1bbecdc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049369.024763:0:5848:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.126@tcp lock: ffff8cb7c4c38600/0xf4f48ce5e1bbecdc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049369.024772:0:5848:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.126@tcp lock: ffff8cb7c4c38600/0xf4f48ce5e1bbecdc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789049369.024793:0:5848:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb8c6321c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7ef694ec-1ea0-4f02-800c-d1279b4fdf12:5848:1875954110583680:0@lo:101: 00000100:00100000:0.0:1789049369.024817:0:5848:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789049369.024838:0:5848:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cb8c79f8780 going to sleep for 11 seconds 00000100:00100000:3.0:1789049369.025495:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954110583680 00000100:00100000:3.0:1789049369.025502:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954110583680 00000100:00100000:3.0:1789049369.025543:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:3.0:1789049369.025552:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8c6bed850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7ef694ec-1ea0-4f02-800c-d1279b4fdf12+16:5848:x1875954110583680:12345-0@lo:101: 00010000:00010000:3.0:1789049369.025564:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789049369.025578:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cb8d776ea00/0xf4f48ce5e1bbece3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xf4f48ce5e1bbecdc expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049369.025599:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cb8d776ea00/0xf4f48ce5e1bbece3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf4f48ce5e1bbecdc expref: 17 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049369.025609:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cb8d776ea00/0xf4f48ce5e1bbece3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf4f48ce5e1bbecdc expref: 17 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049369.025625:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cb8d776ea00, rc 0) 00000100:00100000:3.0:1789049369.025671:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8c6bed850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7ef694ec-1ea0-4f02-800c-d1279b4fdf12+17:5848:x1875954110583680:12345-0@lo:101: Request processed in 120us (852us total) trans 0 rc 0/0 00000100:00100000:3.0:1789049369.025677:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:0.0:1789049369.025704:0:5848:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb8c6321c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7ef694ec-1ea0-4f02-800c-d1279b4fdf12:5848:1875954110583680:0@lo:101: 00010000:00010000:0.0:1789049369.025717:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.126@tcp lock: ffff8cb7c4c38600/0xf4f48ce5e1bbecdc lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf4f48ce5e1bbece3 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049369.025726:0:5848:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.126@tcp lock: ffff8cb7c4c38600/0xf4f48ce5e1bbecdc lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xf4f48ce5e1bbece3 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789049369.025775:0:5848:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb8c6321c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7ef694ec-1ea0-4f02-800c-d1279b4fdf12:5848:1875954110583808:0@lo:256: 00000100:00100000:0.0:1789049369.025806:0:5848:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789049369.025836:0:5848:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cb8c79f8780 going to sleep for 11 seconds 00000100:00100000:3.0:1789049369.025942:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954110583808 00000100:00100000:3.0:1789049369.025952:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954110583808 00000100:00100000:3.0:1789049369.025982:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:3.0:1789049369.025988:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8c6bed050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7ef694ec-1ea0-4f02-800c-d1279b4fdf12+17:5848:x1875954110583808:12345-0@lo:256: 20000000:01000000:3.0:1789049369.026000:0:5844:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1789049369.026017:0:5844:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1789049369.026020:0:5844:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 5 00000100:00100000:3.0:1789049369.026096:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8c6bed050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7ef694ec-1ea0-4f02-800c-d1279b4fdf12+17:5848:x1875954110583808:12345-0@lo:256: Request processed in 108us (289us total) trans 0 rc 0/0 00000100:00100000:3.0:1789049369.026103:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:0.0:1789049369.026117:0:5848:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb8c6321c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7ef694ec-1ea0-4f02-800c-d1279b4fdf12:5848:1875954110583808:0@lo:256: 10000000:01000000:0.0:1789049369.026156:0:5848:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.126@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1789049369.026162:0:5848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.126@tcp lock: ffff8cb7c4c38600/0xf4f48ce5e1bbecdc lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf4f48ce5e1bbece3 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049369.026171:0:5848:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.126@tcp lock: ffff8cb7c4c38600/0xf4f48ce5e1bbecdc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf4f48ce5e1bbece3 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789049369.026178:0:5848:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:0.0:1789049369.026181:0:5848:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 25 10000000:01000000:0.0:1789049369.026183:0:5848:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:0.0:1789049369.026199:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.126@tcp lock: ffff8cb7c4c38000/0xf4f48ce5e1bbecea lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049369.026213:0:5848:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.126@tcp lock: ffff8cb7c4c38000/0xf4f48ce5e1bbecea lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049369.026220:0:5848:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.126@tcp lock: ffff8cb7c4c38000/0xf4f48ce5e1bbecea lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789049369.026230:0:5848:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb8c6321c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7ef694ec-1ea0-4f02-800c-d1279b4fdf12:5848:1875954110583936:0@lo:101: 00000100:00100000:0.0:1789049369.026253:0:5848:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789049369.026280:0:5848:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cb8c79f8780 going to sleep for 11 seconds 00000100:00100000:2.0:1789049369.026304:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954110583936 00000100:00100000:2.0:1789049369.026308:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954110583936 00000100:00100000:2.0:1789049369.026340:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:2.0:1789049369.026346:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8c6bef850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7ef694ec-1ea0-4f02-800c-d1279b4fdf12+17:5848:x1875954110583936:12345-0@lo:101: 00010000:00010000:2.0:1789049369.026353:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789049369.026361:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cb8d6715c00/0xf4f48ce5e1bbecf1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xf4f48ce5e1bbecea expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049369.026375:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cb8d6715c00/0xf4f48ce5e1bbecf1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf4f48ce5e1bbecea expref: 18 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049369.026383:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cb8d6715c00/0xf4f48ce5e1bbecf1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf4f48ce5e1bbecea expref: 18 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049369.026400:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cb8d6715c00, rc 0) 00000100:00100000:2.0:1789049369.026438:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8c6bef850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7ef694ec-1ea0-4f02-800c-d1279b4fdf12+18:5848:x1875954110583936:12345-0@lo:101: Request processed in 92us (184us total) trans 0 rc 0/0 00000100:00100000:2.0:1789049369.026443:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:3.0:1789049369.026552:0:5848:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb8c6321c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7ef694ec-1ea0-4f02-800c-d1279b4fdf12:5848:1875954110583936:0@lo:101: 00010000:00010000:3.0:1789049369.026563:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.126@tcp lock: ffff8cb7c4c38000/0xf4f48ce5e1bbecea lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xf4f48ce5e1bbecf1 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049369.026570:0:5848:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.126@tcp lock: ffff8cb7c4c38000/0xf4f48ce5e1bbecea lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0xf4f48ce5e1bbecf1 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789049369.026609:0:5848:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb8f73c4700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7ef694ec-1ea0-4f02-800c-d1279b4fdf12:5848:1875954110584064:0@lo:501: 00000100:00100000:3.0:1789049369.026644:0:5848:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789049369.026666:0:5848:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cb8c62d9000 going to sleep for 11 seconds 00000100:00100000:0.0:1789049369.026713:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954110584064 00000100:00100000:0.0:1789049369.026717:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954110584064 00000100:00100000:0.0:1789049369.026744:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:0.0:1789049369.026750:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8c6bec850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7ef694ec-1ea0-4f02-800c-d1279b4fdf12+18:5848:x1875954110584064:12345-0@lo:501: 00000100:00100000:0.0:1789049369.026972:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8c6bec850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7ef694ec-1ea0-4f02-800c-d1279b4fdf12+18:5848:x1875954110584064:12345-0@lo:501: Request processed in 221us (327us total) trans 0 rc 0/0 00000100:00100000:0.0:1789049369.026979:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:3.0:1789049369.027160:0:5848:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb8f73c4700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7ef694ec-1ea0-4f02-800c-d1279b4fdf12:5848:1875954110584064:0@lo:501: 00000100:00100000:3.0:1789049369.027185:0:5848:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb8f73c4700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7ef694ec-1ea0-4f02-800c-d1279b4fdf12:5848:1875954110584192:0@lo:503: 00000100:00100000:3.0:1789049369.027220:0:5848:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789049369.027243:0:5848:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cb8c62d9000 going to sleep for 11 seconds 00000100:00100000:2.0:1789049369.027332:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954110584192 00000100:00100000:2.0:1789049369.027336:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954110584192 00000100:00100000:2.0:1789049369.027363:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:2.0:1789049369.027370:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8c6bedc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7ef694ec-1ea0-4f02-800c-d1279b4fdf12+18:5848:x1875954110584192:12345-0@lo:503: 00000100:00100000:2.0:1789049369.027713:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8c6bedc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7ef694ec-1ea0-4f02-800c-d1279b4fdf12+18:5848:x1875954110584192:12345-0@lo:503: Request processed in 342us (491us total) trans 0 rc 0/0 00000100:00100000:2.0:1789049369.027724:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:2.0:1789049369.027760:0:5848:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb8f73c4700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7ef694ec-1ea0-4f02-800c-d1279b4fdf12:5848:1875954110584192:0@lo:503: 00000100:00100000:2.0:1789049369.027970:0:8126:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb8c59cb800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7ef694ec-1ea0-4f02-800c-d1279b4fdf12:8126:1875954110584320:0@lo:502: 00000100:00100000:2.0:1789049369.028001:0:8126:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789049369.028020:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954110584320 00000100:00100000:2.0:1789049369.028023:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954110584320 00000100:00100000:2.0:1789049369.028041:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:2.0:1789049369.028047:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8c6beec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7ef694ec-1ea0-4f02-800c-d1279b4fdf12+18:8126:x1875954110584320:12345-0@lo:502: 00000100:00100000:2.0:1789049369.028232:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8c6beec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7ef694ec-1ea0-4f02-800c-d1279b4fdf12+18:8126:x1875954110584320:12345-0@lo:502: Request processed in 184us (229us total) trans 0 rc 0/0 00000100:00100000:2.0:1789049369.028238:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:2.0:1789049369.028271:0:8126:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cb8c79e0f00 going to sleep for 11 seconds 00000100:00100000:2.0:1789049369.028282:0:8126:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb8c59cb800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7ef694ec-1ea0-4f02-800c-d1279b4fdf12:8126:1875954110584320:0@lo:502: 00000020:01000000:2.0:1789049369.028304:0:8126:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1789049369.028311:0:8126:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-mdt1/mdt1 00000020:00000080:2.0:1789049369.028316:0:8126:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789049369.028318:0:8126:0:(obd_config.c:1563:class_process_config()) marker 18 (0x1) lustre-OST0001 add osc 00000020:00000080:2.0:1789049369.028324:0:8126:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1789049369.028327:0:8126:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.206.126@tcp to nid 0x20000c0a8ce7e (192.168.206.126@tcp) 00000020:01000000:2.0:1789049369.028346:0:8126:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:2.0:1789049369.028349:0:8126:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1789049369.028361:0:8126:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff8cb900bab380) 00000020:00000080:2.0:1789049369.028379:0:8126:0:(obd_config.c:720:class_attach_name()) OBD: dev 17 attached type osp with refcount 2 00000020:00000080:2.0:1789049369.028384:0:8126:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1789049369.030677:0:8126:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:3.0:1789049369.030685:0:8126:0:(osd_handler.c:1574:osd_obd_connect()) connect #6 00000020:00000080:3.0:1789049369.030694:0:8126:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xf4f48ce5e1bbecff 00010000:00080000:3.0:1789049369.030725:0:8126:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8cb8f7b33000@lustre-OST0001-osc-MDT0000: add connection 192.168.206.126@tcp at head 00010000:00010000:3.0:1789049369.031011:0:8126:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-5 is initialized 00000040:01000000:3.0:1789049369.032336:0:8126:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000040:01000000:3.0:1789049369.032355:0:8126:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:3.0:1789049369.033292:0:8126:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1789049369.033580:0:8126:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1789049369.033711:0:8126:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].1, 64 off8256 00000040:00080000:3.0:1789049369.033768:0:8126:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1, 64 off8256 00000040:00080000:1.0:1789049369.034394:0:8128:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1789049369.034399:0:8128:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x6:0x0] at index 1 of catalog [0x1:0x5:0x0] 00000020:00000080:3.0:1789049369.035705:0:8126:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1789049369.035718:0:8126:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:3.0:1789049369.035747:0:8126:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:3.0:1789049369.035766:0:8126:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xf4f48ce5e1bbed06 00000100:00080000:3.0:1789049369.036178:0:8126:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1789049369.036190:0:8126:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff8cb8f7b33000 using connection 192.168.206.126@tcp/0@lo 00000100:00100000:3.0:1789049369.036222:0:8126:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8cb8f73c4e00 x1875954110584448/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1789049369.036280:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb8f73c4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3307:1875954110584448:0@lo:8: 00000100:00100000:0.0:1789049369.036337:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789049369.036411:0:6703:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954110584448 00000100:00100000:1.0:1789049369.036417:0:6703:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954110584448 00000100:00100000:1.0:1789049369.036458:0:6703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1789049369.036465:0:6703:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8c6320a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3307:x1875954110584448:12345-0@lo:8: 00010000:00080000:1.0:1789049369.036490:0:6703:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 195 last 0 00000020:00000080:1.0:1789049369.036515:0:6703:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xf4f48ce5e1bbed0d 00002000:00100000:1.0:1789049369.036527:0:6703:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff8cb8c622d000 ocd_connect_flags: 0xa044c01443000026 ocd_version: 2113a28 ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:1.0:1789049369.036539:0:6703:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00000001:00000004:1.0:1789049369.036542:0:6703:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967296 00002000:00100000:1.0:1789049369.036664:0:6703:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:1.0:1789049369.036793:0:6703:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:1.0:1789049369.036814:0:6703:0:(import.c:65:import_set_state_nolock()) ffff8cb8c622f800 : changing import state from RECOVER to FULL 00000100:00080000:3.0:1789049369.036903:0:8126:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000100:00100000:3.0:1789049369.037376:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb8f73c7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3309:1875954110584704:0@lo:400: 00000100:00100000:3.0:1789049369.037410:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789049369.037447:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789049369.037453:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb8f73c5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3309:1875954110584576:0@lo:400: 00000100:00100000:3.0:1789049369.037475:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789049369.037497:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb8f73c6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1875954110584832:0@lo:400: 00000100:00100000:3.0:1789049369.037519:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789049369.037535:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789049369.037539:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb8f73c4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3310:1875954110584960:0@lo:400: 00000100:00100000:3.0:1789049369.037558:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:01000000:3.0:1789049369.037650:0:8126:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789049369.037656:0:8126:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789049369.037663:0:8126:0:(obd_config.c:1563:class_process_config()) marker 18 (0x2) lustre-OST0001 add osc 00000020:01000000:3.0:1789049369.037666:0:8126:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789049369.037670:0:8126:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789049369.037672:0:8126:0:(obd_config.c:1563:class_process_config()) marker 23 (0x1) lustre sys.timeout 00000020:00000080:3.0:1789049369.037674:0:8126:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1789049369.037676:0:8126:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:3.0:1789049369.037696:0:8126:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb8f73c6300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7ef694ec-1ea0-4f02-800c-d1279b4fdf12:8126:1875954110585088:0@lo:502: 00000100:00100000:3.0:1789049369.037731:0:8126:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789049369.037755:0:8126:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cb900da9f00 going to sleep for 11 seconds 00000100:00100000:3.0:1789049369.037922:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954110585088 00000100:00100000:3.0:1789049369.037938:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954110585088 00000100:00100000:3.0:1789049369.038179:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:3.0:1789049369.038189:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8c6bec450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7ef694ec-1ea0-4f02-800c-d1279b4fdf12+18:8126:x1875954110585088:12345-0@lo:502: 00000100:00100000:3.0:1789049369.038409:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8c6bec450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7ef694ec-1ea0-4f02-800c-d1279b4fdf12+18:8126:x1875954110585088:12345-0@lo:502: Request processed in 222us (677us total) trans 0 rc 0/0 00000100:00100000:3.0:1789049369.038418:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:3.0:1789049369.038526:0:8126:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb8f73c6300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7ef694ec-1ea0-4f02-800c-d1279b4fdf12:8126:1875954110585088:0@lo:502: 00000020:01000000:3.0:1789049369.038550:0:8126:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789049369.038555:0:8126:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789049369.038557:0:8126:0:(obd_config.c:1563:class_process_config()) marker 23 (0x2) lustre sys.timeout 00000040:00080000:3.0:1789049369.038561:0:8126:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 34 count 34 00000020:01000000:2.0:1789049369.038802:0:5848:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 25-33 (rc=0) 10000000:01000000:2.0:1789049369.038821:0:5848:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.126@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:2.0:1789049369.038830:0:5848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.126@tcp lock: ffff8cb7c4c38000/0xf4f48ce5e1bbecea lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xf4f48ce5e1bbecf1 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049369.038866:0:5848:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.126@tcp lock: ffff8cb7c4c38000/0xf4f48ce5e1bbecea lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xf4f48ce5e1bbecf1 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789049369.038875:0:5848:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:2.0:1789049369.038878:0:5848:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff8cb8c59599c0 from 1 10000000:01000000:2.0:1789049369.038880:0:5848:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1789049369.038905:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.126@tcp lock: ffff8cb8d6714c00/0xf4f48ce5e1bbed14 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049369.038913:0:5848:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.126@tcp lock: ffff8cb8d6714c00/0xf4f48ce5e1bbed14 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049369.038922:0:5848:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.126@tcp lock: ffff8cb8d6714c00/0xf4f48ce5e1bbed14 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789049369.038936:0:5848:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb8c59cb800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7ef694ec-1ea0-4f02-800c-d1279b4fdf12:5848:1875954110585216:0@lo:101: 00000100:00100000:2.0:1789049369.038967:0:5848:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789049369.038988:0:5848:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cb8c79e0480 going to sleep for 11 seconds 00000100:00100000:3.0:1789049369.039204:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954110585216 00000100:00100000:3.0:1789049369.039209:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954110585216 00000100:00100000:3.0:1789049369.039235:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:3.0:1789049369.039241:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8c6bed450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7ef694ec-1ea0-4f02-800c-d1279b4fdf12+18:5848:x1875954110585216:12345-0@lo:101: 00010000:00010000:3.0:1789049369.039251:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789049369.039262:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cb8d776f600/0xf4f48ce5e1bbed1b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0xf4f48ce5e1bbed14 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049369.039281:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cb8d776f600/0xf4f48ce5e1bbed1b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf4f48ce5e1bbed14 expref: 19 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049369.039297:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cb8d776f600/0xf4f48ce5e1bbed1b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf4f48ce5e1bbed14 expref: 19 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049369.039305:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cb8d776f600, rc 0) 00000100:00100000:3.0:1789049369.039334:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8c6bed450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7ef694ec-1ea0-4f02-800c-d1279b4fdf12+19:5848:x1875954110585216:12345-0@lo:101: Request processed in 93us (367us total) trans 0 rc 0/0 00000100:00100000:3.0:1789049369.039340:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:3.0:1789049369.039368:0:5848:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb8c59cb800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7ef694ec-1ea0-4f02-800c-d1279b4fdf12:5848:1875954110585216:0@lo:101: 00010000:00010000:3.0:1789049369.039380:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.126@tcp lock: ffff8cb8d6714c00/0xf4f48ce5e1bbed14 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xf4f48ce5e1bbed1b expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049369.039387:0:5848:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.126@tcp lock: ffff8cb8d6714c00/0xf4f48ce5e1bbed14 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xf4f48ce5e1bbed1b expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789049369.039435:0:5848:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb8f73c6300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7ef694ec-1ea0-4f02-800c-d1279b4fdf12:5848:1875954110585344:0@lo:501: 00000100:00100000:3.0:1789049369.039458:0:5848:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789049369.039469:0:5848:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cb900da9780 going to sleep for 11 seconds 00000100:00100000:3.0:1789049369.039479:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954110585344 00000100:00100000:3.0:1789049369.039482:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954110585344 00000100:00100000:3.0:1789049369.039495:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:3.0:1789049369.039499:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8c6bee850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7ef694ec-1ea0-4f02-800c-d1279b4fdf12+19:5848:x1875954110585344:12345-0@lo:501: 00000100:00100000:3.0:1789049369.039693:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8c6bee850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7ef694ec-1ea0-4f02-800c-d1279b4fdf12+19:5848:x1875954110585344:12345-0@lo:501: Request processed in 192us (233us total) trans 0 rc -2/-2 00000100:00100000:3.0:1789049369.039699:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:3.0:1789049369.039725:0:5848:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb8f73c6300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7ef694ec-1ea0-4f02-800c-d1279b4fdf12:5848:1875954110585344:0@lo:501: 10000000:01000000:3.0:1789049369.039743:0:5848:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.126@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:3.0:1789049369.039754:0:5848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.126@tcp lock: ffff8cb8d6714c00/0xf4f48ce5e1bbed14 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xf4f48ce5e1bbed1b expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049369.039761:0:5848:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.126@tcp lock: ffff8cb8d6714c00/0xf4f48ce5e1bbed14 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xf4f48ce5e1bbed1b expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789049369.040515:0:6703:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8c6320a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3307:x1875954110584448:12345-0@lo:8: Request processed in 4044us (4172us total) trans 0 rc 0/0 00000100:00100000:1.0:1789049369.040526:0:6703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1789049369.040543:0:6703:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954110584832 00000100:00100000:1.0:1789049369.040548:0:6703:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954110584832 00000100:00100000:1.0:1789049369.040639:0:6703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1789049369.040647:0:6703:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8f73c5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3310:x1875954110584832:12345-0@lo:400: 00000100:00100000:1.0:1789049369.040696:0:6703:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8f73c5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3310:x1875954110584832:12345-0@lo:400: Request processed in 51us (3176us total) trans 0 rc 0/0 00000100:00100000:1.0:1789049369.040702:0:6703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:0.0:1789049369.040783:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cb8f73c4e00 x1875954110584448/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1789049379 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789049369.040794:0:3307:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1789049369.040801:0:3307:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 1 00000100:00080000:0.0:1789049369.040809:0:3307:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040c01443000026 00000100:00080000:0.0:1789049369.040814:0:3307:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:0.0:1789049369.040817:0:3307:0:(import.c:65:import_set_state_nolock()) ffff8cb8f7b33000 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:0.0:1789049369.040832:0:3307:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:0.0:1789049369.040863:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb8f73c4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3307:1875954110584448:0@lo:8: 00000100:00100000:0.0:1789049369.040898:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954110584704 00000100:00100000:0.0:1789049369.040902:0:5852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954110584704 00000100:00080000:3.0:1789049369.041299:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789049369.041305:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789049369.041469:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954110584576 00000100:00100000:0.0:1789049369.041473:0:5852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954110584576 00000100:00100000:0.0:1789049369.041487:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954110584960 00000100:00100000:0.0:1789049369.041490:0:5852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954110584960 00000100:00100000:0.0:1789049369.041503:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1789049369.041510:0:5852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8f73c5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1875954110584704:12345-0@lo:400: 00000100:00100000:0.0:1789049369.041557:0:5852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8f73c5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1875954110584704:12345-0@lo:400: Request processed in 47us (4146us total) trans 0 rc 0/0 00000100:00100000:0.0:1789049369.041563:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1789049369.041576:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1789049369.041582:0:5852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8f73c4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1875954110584576:12345-0@lo:400: 00000100:00080000:3.0:1789049369.041680:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789049369.041773:0:5852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8f73c4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1875954110584576:12345-0@lo:400: Request processed in 191us (4297us total) trans 0 rc 0/0 00000100:00100000:0.0:1789049369.041779:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1789049369.041791:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1789049369.041797:0:5852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8f73c6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1875954110584960:12345-0@lo:400: 00000100:00100000:0.0:1789049369.041822:0:5852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8f73c6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1875954110584960:12345-0@lo:400: Request processed in 26us (4263us total) trans 0 rc 0/0 00000100:00100000:0.0:1789049369.041827:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00010000:00080000:0.0:1789049369.041911:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cb8f73c5c00 x1875954110584576/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789049385 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789049369.041923:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb8f73c5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3309:1875954110584576:0@lo:400: 00010000:00080000:0.0:1789049369.042242:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cb8f73c7480 x1875954110584704/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789049385 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789049369.042264:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb8f73c7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3309:1875954110584704:0@lo:400: 00010000:00080000:1.0:1789049369.043696:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cb8f73c4700 x1875954110584960/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789049385 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789049369.043710:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb8f73c4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3310:1875954110584960:0@lo:400: 00010000:00080000:1.0:1789049369.043724:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cb8f73c6a00 x1875954110584832/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789049385 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789049369.043732:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb8f73c6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1875954110584832:0@lo:400: 00000004:00080000:1.0:1789049369.043762:0:8128:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:1.0:1789049369.044533:0:8128:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 195096689063ns, next at 0ns, rc = 0 00000004:00080000:3.0:1789049369.080161:0:8129:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x100010000:0x1:0x0] 00000100:00100000:3.0:1789049369.080195:0:8129:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb8f73c6a00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8129:1875954110585600:0@lo:7: 00000100:00100000:3.0:1789049369.080260:0:8129:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789049369.080909:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1789049369.080926:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb8f73c6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3309:1875954110585472:0@lo:13: 00000100:00100000:2.0:1789049369.080979:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789049369.082488:0:6703:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954110585600 00000100:00100000:1.0:1789049369.082500:0:6703:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954110585600 00000100:00100000:1.0:1789049369.082571:0:6703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1789049369.082592:0:6703:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8f73c4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:8129:x1875954110585600:12345-0@lo:7: 00000100:00080000:2.0:1789049369.082767:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789049369.083833:0:6706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954110585472 00000100:00100000:0.0:1789049369.084279:0:6706:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954110585472 00000100:00100000:0.0:1789049369.084368:0:6706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1789049369.084378:0:6706:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8c59cb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3309:x1875954110585472:12345-0@lo:13: 00002000:00000024:0.0:1789049369.084411:0:6706:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3860856832 avail 3858759680 00000100:00100000:0.0:1789049369.084505:0:6706:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8c59cb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3309:x1875954110585472:12345-0@lo:13: Request processed in 129us (3524us total) trans 0 rc 0/0 00000100:00100000:0.0:1789049369.084511:0:6706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1789049369.084572:0:8129:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cb8c79f89c0 going to sleep for 11 seconds 00010000:00080000:0.0:1789049369.084733:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cb8f73c6300 x1875954110585472/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789049385 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789049369.084750:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb8f73c6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3309:1875954110585472:0@lo:13: 00002000:00080000:1.0:1789049369.099666:0:6703:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x0 00002000:00080000:1.0:1789049369.099675:0:6703:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0001: LAST FID is [0x100010000:0x0:0x0] 00000100:00100000:1.0:1789049369.099766:0:6703:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8f73c4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:8129:x1875954110585600:12345-0@lo:7: Request processed in 17171us (19501us total) trans 0 rc 0/0 00000100:00100000:1.0:1789049369.099776:0:6703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:1.0:1789049369.099832:0:8129:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cb8f73c6a00 x1875954110585600/t0(0) o7->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 264/240 e 0 to 0 dl 1789049385 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789049369.099874:0:8129:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb8f73c6a00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8129:1875954110585600:0@lo:7: 00000004:00080000:1.0:1789049369.099888:0:8129:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0001-osc-MDT0000: Got last_fid [0x100010000:0x0:0x0] 00000100:00100000:1.0:1789049369.099923:0:8129:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb8d0ab4700 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8129:1875954110585728:0@lo:5: 00000100:00100000:1.0:1789049369.099953:0:8129:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789049369.099984:0:8129:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cb8df429540 going to sleep for 11 seconds 00000100:00100000:1.0:1789049369.100009:0:6703:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954110585728 00000100:00100000:1.0:1789049369.100015:0:6703:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954110585728 00000100:00100000:1.0:1789049369.100053:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1789049369.100060:0:6704:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8d0ab5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:8129:x1875954110585728:12345-0@lo:5: 00002000:00080000:1.0:1789049369.100082:0:6704:0:(ofd_dev.c:1646:ofd_create_hdl()) ofd_last_id() = 0 -> diff = 1 00002000:00080000:1.0:1789049369.100085:0:6704:0:(ofd_dev.c:1753:ofd_create_hdl()) lustre-OST0001: reserve 1 objects in group 0x0 at 1 00000100:00100000:1.0:1789049369.107891:0:6704:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8d0ab5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:8129:x1875954110585728:12345-0@lo:5: Request processed in 7821us (7926us total) trans 4294967297 rc 0/0 00000100:00100000:1.0:1789049369.107904:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:2.0:1789049369.107941:0:8129:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cb8d0ab4700 x1875954110585728/t0(0) o5->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1789049385 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789049369.107959:0:8129:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb8d0ab4700 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8129:1875954110585728:0@lo:5: 00000004:00080000:2.0:1789049369.107984:0:8129:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x100010000:0x1:0x0] from OST, last_created [0x100010000:0x1:0x0]last_used is [0x100010000:0x1:0x0] 00000100:00100000:2.0:1789049369.108595:0:8129:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb8c59cb480 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8129:1875954110585856:0@lo:700: 00000100:00100000:2.0:1789049369.108669:0:8129:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789049369.108715:0:8129:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cb8c79e0480 going to sleep for 11 seconds 00000100:00100000:1.0:1789049369.113087:0:6711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954110585856 00000100:00100000:1.0:1789049369.113101:0:6711:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954110585856 00000100:00100000:1.0:1789049369.113163:0:6711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1789049369.113174:0:6711:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8c59c8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+7:8129:x1875954110585856:12345-0@lo:700: 00000100:00100000:1.0:1789049369.113226:0:6711:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb8d0ab6300 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0001_UUID:6711:1875954110585984:0@lo:700: 00000100:00100000:1.0:1789049369.113286:0:6711:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789049369.113318:0:6711:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cb8df429780 going to sleep for 11 seconds 00000100:00100000:1.0:1789049369.113332:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954110585984 00000100:00100000:1.0:1789049369.113335:0:5857:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954110585984 00000100:00100000:1.0:1789049369.113357:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1789049369.113363:0:5857:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8d0ab4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0001_UUID+5:6711:x1875954110585984:12345-0@lo:700: 00000004:00080000:2.0:1789049369.139536:0:5872:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 40000000:02000000:2.0:1789049369.180193:0:5857:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000280000400-0x00000002c0000400]:1:ost 00010000:00080000:0.0:1789049369.193069:0:6711:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cb8d0ab6300 x1875954110585984/t0(0) o700->lustre-MDT0000-lwp-OST0001@0@lo:32/10 lens 264/248 e 0 to 0 dl 1789049385 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789049369.193097:0:6711:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb8d0ab6300 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0001_UUID:6711:1875954110585984:0@lo:700: 40000000:02000000:0.0:1789049369.193111:0:6711:0:(fid_request.c:122:seq_client_rpc()) cli-lustre-OST0001-super: Allocated super-sequence [0x0000000280000400-0x00000002c0000400]:1:ost] 00000100:00100000:2.0:1789049369.194133:0:5857:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8d0ab4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0001_UUID+5:6711:x1875954110585984:12345-0@lo:700: Request processed in 80763us (80840us total) trans 0 rc 0/0 00000100:00100000:2.0:1789049369.194151:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000001:00080000:3.0:1789049369.270782:0:7663:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967297 is committed 00000001:00100000:3.0:1789049369.270799:0:7663:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:0.0:1789049369.270956:0:6711:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8c59c8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+5:8129:x1875954110585856:12345-0@lo:700: Request processed in 157780us (162282us total) trans 0 rc 0/0 00010000:00080000:3.0:1789049369.271079:0:8129:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cb8c59cb480 x1875954110585856/t0(0) o700->lustre-OST0001-osc-MDT0000@0@lo:31/4 lens 264/248 e 0 to 0 dl 1789049385 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789049369.271091:0:8129:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967297 gen 2 00000100:00100000:3.0:1789049369.271106:0:8129:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb8c59cb480 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8129:1875954110585856:0@lo:700: 00000100:00100000:0.0:1789049369.271370:0:6711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00010000:3.0:1789049369.310312:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:02000040:2.0:1789049369.314872:0:8129:0:(osp_precreate.c:485:osp_precreate_rollover_new_seq()) lustre-OST0001-osc-MDT0000: update sequence from 0x100010000 to 0x280000400 00000100:00100000:2.0:1789049369.321182:0:8129:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb8c59cad80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8129:1875954110586112:0@lo:5: 00000100:00100000:2.0:1789049369.321245:0:8129:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789049369.321283:0:6705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954110586112 00000100:00100000:0.0:1789049369.321291:0:6705:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954110586112 00000100:00100000:2.0:1789049369.321297:0:8129:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cb8c79e0540 going to sleep for 11 seconds 00000100:00100000:0.0:1789049369.321344:0:6705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1789049369.321353:0:6705:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8c59c9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:8129:x1875954110586112:12345-0@lo:5: 00002000:00080000:0.0:1789049369.328265:0:6705:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x280000400 00002000:00080000:0.0:1789049369.328291:0:6705:0:(ofd_dev.c:1753:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x280000400 at 2 00000100:00100000:1.0:1789049369.331658:0:6705:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8c59c9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:8129:x1875954110586112:12345-0@lo:5: Request processed in 10299us (10406us total) trans 4294967298 rc 0/0 00000100:00100000:1.0:1789049369.331671:0:6705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:2.0:1789049369.331708:0:8129:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cb8c59cad80 x1875954110586112/t0(0) o5->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1789049385 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789049369.331726:0:8129:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb8c59cad80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8129:1875954110586112:0@lo:5: 00000004:00080000:2.0:1789049369.331740:0:8129:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x280000400:0x1:0x0]-[0x280000400:0x21:0x0] 00010000:00010000:3.0:1789049370.331266:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1789049370.756939:0:7663:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967298 is committed 00000100:00100000:0.0:1789049371.292352:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.26@tcp (source: 12345-192.168.206.26@tcp) 00000100:00100000:3.0:1789049371.292905:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954089590912 00000100:00100000:3.0:1789049371.292916:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954089590912 00000100:00100000:3.0:1789049371.292969:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.26@tcp, seq: 111 00000100:00100000:3.0:1789049371.292980:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8c6bee050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0+-99:2354:x1875954089590912:12345-192.168.206.26@tcp:250: 00010000:00080000:3.0:1789049371.293010:0:5844:0:(ldlm_lib.c:1453:target_handle_connect()) MGS: connection from de93d576-ed8d-4d27-ab00-9189a62cea33@192.168.206.26@tcp t0 exp 0000000000000000 cur 197 last 0 00000020:00000080:3.0:1789049371.293041:0:5844:0:(genops.c:1384:class_connect()) connect: client de93d576-ed8d-4d27-ab00-9189a62cea33, cookie 0xf4f48ce5e1bbed22 00000100:00080000:3.0:1789049371.293199:0:5844:0:(import.c:65:import_set_state_nolock()) ffff8cb8df601000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1789049371.293274:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8c6bee050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:de93d576-ed8d-4d27-ab00-9189a62cea33+5:2354:x1875954089590912:12345-192.168.206.26@tcp:250: Request processed in 295us (933us total) trans 0 rc 0/0 00000100:00100000:3.0:1789049371.293282:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.26@tcp, seq: 111 00000100:00100000:3.0:1789049371.300056:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.26@tcp (source: 12345-192.168.206.26@tcp) 00000100:00100000:0.0:1789049371.300193:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954089591040 00000100:00100000:0.0:1789049371.300204:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954089591040 00000100:00100000:0.0:1789049371.300261:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.26@tcp, seq: 112 00000100:00100000:0.0:1789049371.300270:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8c6bef050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:de93d576-ed8d-4d27-ab00-9189a62cea33+5:5583:x1875954089591040:12345-192.168.206.26@tcp:101: 00010000:00010000:0.0:1789049371.300285:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789049371.300302:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cb7c4c39e00/0xf4f48ce5e1bbed29 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x7fc5e358805a323a expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049371.300330:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cb7c4c39e00/0xf4f48ce5e1bbed29 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a323a expref: 6 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049371.300342:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cb7c4c39e00/0xf4f48ce5e1bbed29 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a323a expref: 6 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049371.300352:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cb7c4c39e00, rc 0) 00000100:00100000:0.0:1789049371.300407:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8c6bef050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:de93d576-ed8d-4d27-ab00-9189a62cea33+6:5583:x1875954089591040:12345-192.168.206.26@tcp:101: Request processed in 139us (362us total) trans 0 rc 0/0 00000100:00100000:0.0:1789049371.300413:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.26@tcp, seq: 112 00000100:00100000:0.0:1789049371.303522:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.26@tcp (source: 12345-192.168.206.26@tcp) 00000100:00100000:3.0:1789049371.307218:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954089591168 00000100:00100000:3.0:1789049371.307238:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954089591168 00000100:00100000:3.0:1789049371.307309:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.26@tcp, seq: 113 00000100:00100000:3.0:1789049371.307320:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8c6bec050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:de93d576-ed8d-4d27-ab00-9189a62cea33+6:5583:x1875954089591168:12345-192.168.206.26@tcp:501: 00000100:00100000:3.0:1789049371.307675:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8c6bec050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:de93d576-ed8d-4d27-ab00-9189a62cea33+6:5583:x1875954089591168:12345-192.168.206.26@tcp:501: Request processed in 356us (4162us total) trans 0 rc -2/-2 00000100:00100000:3.0:1789049371.307684:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.26@tcp, seq: 113 00000100:00100000:1.0:1789049371.317065:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.26@tcp (source: 12345-192.168.206.26@tcp) 00000100:00100000:3.0:1789049371.317211:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954089591296 00000100:00100000:3.0:1789049371.317223:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954089591296 00000100:00100000:3.0:1789049371.317279:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.26@tcp, seq: 114 00000100:00100000:3.0:1789049371.317288:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8c6becc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:de93d576-ed8d-4d27-ab00-9189a62cea33+6:5583:x1875954089591296:12345-192.168.206.26@tcp:101: 00010000:00010000:3.0:1789049371.317304:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789049371.317318:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cb8d776f200/0xf4f48ce5e1bbed30 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x7fc5e358805a3241 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049371.317343:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cb8d776f200/0xf4f48ce5e1bbed30 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a3241 expref: 7 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049371.317353:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cb8d776f200/0xf4f48ce5e1bbed30 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a3241 expref: 7 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049371.317362:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cb8d776f200, rc 0) 00000100:00100000:3.0:1789049371.317407:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8c6becc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:de93d576-ed8d-4d27-ab00-9189a62cea33+7:5583:x1875954089591296:12345-192.168.206.26@tcp:101: Request processed in 121us (353us total) trans 0 rc 0/0 00000100:00100000:3.0:1789049371.317420:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.26@tcp, seq: 114 00000100:00100000:2.0:1789049371.322462:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.26@tcp (source: 12345-192.168.206.26@tcp) 00000100:00100000:0.0:1789049371.323306:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954089591424 00000100:00100000:0.0:1789049371.323319:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954089591424 00000100:00100000:0.0:1789049371.323373:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.26@tcp, seq: 115 00000100:00100000:0.0:1789049371.323382:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8c6bee450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:de93d576-ed8d-4d27-ab00-9189a62cea33+7:5583:x1875954089591424:12345-192.168.206.26@tcp:501: 00000100:00100000:0.0:1789049371.323631:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8c6bee450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:de93d576-ed8d-4d27-ab00-9189a62cea33+8:5583:x1875954089591424:12345-192.168.206.26@tcp:501: Request processed in 249us (1176us total) trans 0 rc 0/0 00000100:00100000:0.0:1789049371.323648:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.26@tcp, seq: 115 00000100:00100000:0.0:1789049371.326053:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.26@tcp (source: 12345-192.168.206.26@tcp) 00000100:00100000:2.0:1789049371.326177:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954089591552 00000100:00100000:2.0:1789049371.326186:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954089591552 00000100:00100000:2.0:1789049371.326238:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.26@tcp, seq: 116 00000100:00100000:2.0:1789049371.326247:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8c6bef450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:de93d576-ed8d-4d27-ab00-9189a62cea33+8:5583:x1875954089591552:12345-192.168.206.26@tcp:503: 00000100:00100000:2.0:1789049371.326555:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8c6bef450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:de93d576-ed8d-4d27-ab00-9189a62cea33+8:5583:x1875954089591552:12345-192.168.206.26@tcp:503: Request processed in 308us (509us total) trans 0 rc 0/0 00000100:00100000:2.0:1789049371.326562:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.26@tcp, seq: 116 00000100:00100000:2.0:1789049371.330643:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.26@tcp (source: 12345-192.168.206.26@tcp) 00000100:00100000:3.0:1789049371.330718:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954089591680 00000100:00100000:3.0:1789049371.330727:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954089591680 00000100:00100000:3.0:1789049371.330782:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.26@tcp, seq: 117 00000100:00100000:3.0:1789049371.330792:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8d6af9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:de93d576-ed8d-4d27-ab00-9189a62cea33+8:5602:x1875954089591680:12345-192.168.206.26@tcp:502: 00000100:00100000:3.0:1789049371.335645:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8d6af9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:de93d576-ed8d-4d27-ab00-9189a62cea33+8:5602:x1875954089591680:12345-192.168.206.26@tcp:502: Request processed in 4844us (5000us total) trans 0 rc 0/0 00000100:00100000:3.0:1789049371.335658:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.26@tcp, seq: 117 00010000:00010000:0.0:1789049371.355474:0:6719:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789049371.360728:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.26@tcp (source: 12345-192.168.206.26@tcp) 00000100:00100000:3.0:1789049371.360794:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954089591808 00000100:00100000:3.0:1789049371.360803:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954089591808 00000100:00100000:3.0:1789049371.360873:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.26@tcp, seq: 118 00000100:00100000:3.0:1789049371.360882:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8d6afb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:de93d576-ed8d-4d27-ab00-9189a62cea33+8:5602:x1875954089591808:12345-192.168.206.26@tcp:502: 00000100:00100000:3.0:1789049371.361120:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8d6afb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:de93d576-ed8d-4d27-ab00-9189a62cea33+8:5602:x1875954089591808:12345-192.168.206.26@tcp:502: Request processed in 239us (399us total) trans 0 rc 0/0 00000100:00100000:3.0:1789049371.361128:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.26@tcp, seq: 118 00000100:00100000:0.0:1789049371.367954:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.26@tcp (source: 12345-192.168.206.26@tcp) 00000100:00100000:3.0:1789049371.368195:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954089591936 00000100:00100000:3.0:1789049371.368205:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954089591936 00000100:00100000:3.0:1789049371.368261:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.26@tcp, seq: 119 00000100:00100000:3.0:1789049371.368270:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8d11e1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:de93d576-ed8d-4d27-ab00-9189a62cea33+8:5583:x1875954089591936:12345-192.168.206.26@tcp:101: 00010000:00010000:3.0:1789049371.368285:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789049371.368300:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cb8d776e400/0xf4f48ce5e1bbed37 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x7fc5e358805a326b expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049371.368326:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cb8d776e400/0xf4f48ce5e1bbed37 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a326b expref: 9 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049371.368354:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cb8d776e400/0xf4f48ce5e1bbed37 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a326b expref: 9 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049371.368364:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cb8d776e400, rc 0) 00000100:00100000:3.0:1789049371.368795:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8d11e1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:de93d576-ed8d-4d27-ab00-9189a62cea33+9:5583:x1875954089591936:12345-192.168.206.26@tcp:101: Request processed in 524us (847us total) trans 0 rc 0/0 00000100:00100000:3.0:1789049371.368802:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.26@tcp, seq: 119 00000100:00100000:0.0:1789049371.371917:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.26@tcp (source: 12345-192.168.206.26@tcp) 00000100:00100000:3.0:1789049371.372034:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954089592064 00000100:00100000:3.0:1789049371.372044:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954089592064 00000100:00100000:3.0:1789049371.372096:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.26@tcp, seq: 120 00000100:00100000:3.0:1789049371.372106:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8d11e2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:de93d576-ed8d-4d27-ab00-9189a62cea33+9:5583:x1875954089592064:12345-192.168.206.26@tcp:256: 20000000:01000000:3.0:1789049371.372129:0:5844:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:3.0:1789049371.372151:0:5844:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:3.0:1789049371.372155:0:5844:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:3.0:1789049371.372158:0:5844:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:3.0:1789049371.372160:0:5844:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 5 00000100:00100000:3.0:1789049371.374356:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8d11e2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:de93d576-ed8d-4d27-ab00-9189a62cea33+9:5583:x1875954089592064:12345-192.168.206.26@tcp:256: Request processed in 1904us (2100us total) trans 0 rc 0/0 00000100:00100000:3.0:1789049371.374371:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.26@tcp, seq: 120 00000100:00100000:3.0:1789049371.377037:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.26@tcp (source: 12345-192.168.206.26@tcp) 00000100:00100000:3.0:1789049371.377076:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954089592192 00000100:00100000:3.0:1789049371.377085:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954089592192 00000100:00100000:3.0:1789049371.377155:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.26@tcp, seq: 121 00000100:00100000:3.0:1789049371.377166:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8d11e0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:de93d576-ed8d-4d27-ab00-9189a62cea33+9:5583:x1875954089592192:12345-192.168.206.26@tcp:101: 00010000:00010000:3.0:1789049371.377182:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789049371.377199:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cb8d776e200/0xf4f48ce5e1bbed3e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x7fc5e358805a3272 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049371.377241:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cb8d776e200/0xf4f48ce5e1bbed3e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a3272 expref: 10 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049371.377253:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cb8d776e200/0xf4f48ce5e1bbed3e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a3272 expref: 10 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049371.377263:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cb8d776e200, rc 0) 00000100:00100000:3.0:1789049371.377328:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8d11e0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:de93d576-ed8d-4d27-ab00-9189a62cea33+10:5583:x1875954089592192:12345-192.168.206.26@tcp:101: Request processed in 163us (299us total) trans 0 rc 0/0 00000100:00100000:3.0:1789049371.377335:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.26@tcp, seq: 121 00000100:00100000:0.0:1789049371.380947:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.26@tcp (source: 12345-192.168.206.26@tcp) 00000100:00100000:3.0:1789049371.381080:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954089592320 00000100:00100000:3.0:1789049371.381089:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954089592320 00000100:00100000:3.0:1789049371.381148:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.26@tcp, seq: 122 00000100:00100000:3.0:1789049371.381158:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8d11e1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:de93d576-ed8d-4d27-ab00-9189a62cea33+10:5583:x1875954089592320:12345-192.168.206.26@tcp:501: 00000100:00100000:3.0:1789049371.381456:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8d11e1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:de93d576-ed8d-4d27-ab00-9189a62cea33+10:5583:x1875954089592320:12345-192.168.206.26@tcp:501: Request processed in 287us (506us total) trans 0 rc 0/0 00000100:00100000:3.0:1789049371.381464:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.26@tcp, seq: 122 00000100:00100000:0.0:1789049371.385971:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.26@tcp (source: 12345-192.168.206.26@tcp) 00000100:00100000:3.0:1789049371.386054:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954089592448 00000100:00100000:3.0:1789049371.386065:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954089592448 00000100:00100000:3.0:1789049371.386116:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.26@tcp, seq: 123 00000100:00100000:3.0:1789049371.386127:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8d11e2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:de93d576-ed8d-4d27-ab00-9189a62cea33+10:5583:x1875954089592448:12345-192.168.206.26@tcp:503: 00000100:00100000:3.0:1789049371.386882:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8d11e2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:de93d576-ed8d-4d27-ab00-9189a62cea33+10:5583:x1875954089592448:12345-192.168.206.26@tcp:503: Request processed in 752us (916us total) trans 0 rc 0/0 00000100:00100000:3.0:1789049371.386892:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.26@tcp, seq: 123 00000100:00100000:0.0:1789049371.392323:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.26@tcp (source: 12345-192.168.206.26@tcp) 00000100:00100000:3.0:1789049371.392813:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954089592576 00000100:00100000:3.0:1789049371.392829:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954089592576 00000100:00100000:3.0:1789049371.392910:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.26@tcp, seq: 124 00000100:00100000:3.0:1789049371.392920:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8d11e2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:de93d576-ed8d-4d27-ab00-9189a62cea33+10:5607:x1875954089592576:12345-192.168.206.26@tcp:502: 00000100:00100000:3.0:1789049371.393147:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8d11e2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:de93d576-ed8d-4d27-ab00-9189a62cea33+10:5607:x1875954089592576:12345-192.168.206.26@tcp:502: Request processed in 227us (832us total) trans 0 rc 0/0 00000100:00100000:3.0:1789049371.393156:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.26@tcp, seq: 124 00000100:00100000:3.0:1789049371.396282:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.26@tcp (source: 12345-192.168.206.26@tcp) 00000100:00100000:1.0:1789049371.396817:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954089592704 00000100:00100000:1.0:1789049371.396827:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954089592704 00000100:00100000:1.0:1789049371.396904:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.26@tcp, seq: 125 00000100:00100000:1.0:1789049371.396915:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8d11e3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:de93d576-ed8d-4d27-ab00-9189a62cea33+10:5607:x1875954089592704:12345-192.168.206.26@tcp:502: 00000100:00100000:1.0:1789049371.397158:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8d11e3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:de93d576-ed8d-4d27-ab00-9189a62cea33+10:5607:x1875954089592704:12345-192.168.206.26@tcp:502: Request processed in 245us (886us total) trans 0 rc 0/0 00000100:00100000:1.0:1789049371.397167:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.26@tcp, seq: 125 00000100:00100000:0.0:1789049371.401545:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.26@tcp (source: 12345-192.168.206.26@tcp) 00000100:00100000:1.0:1789049371.401644:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954089592832 00000100:00100000:1.0:1789049371.401655:0:5852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954089592832 00000100:00100000:1.0:1789049371.401700:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.26@tcp, seq: 4 00000100:00100000:1.0:1789049371.401708:0:5852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8c6320e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2354:x1875954089592832:12345-192.168.206.26@tcp:38: 00010000:00080000:1.0:1789049371.401737:0:5852:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from e823b53a-3591-475c-8624-c682227e5c13@192.168.206.26@tcp t0 exp 0000000000000000 cur 197 last 0 00000020:00000080:1.0:1789049371.401783:0:5852:0:(genops.c:1384:class_connect()) connect: client e823b53a-3591-475c-8624-c682227e5c13, cookie 0xf4f48ce5e1bbed45 00000004:00100000:1.0:1789049371.401812:0:5852:0:(mdt_handler.c:7311:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000001:00000004:1.0:1789049371.401818:0:5852:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967296 00000100:00080000:1.0:1789049371.436719:0:5852:0:(import.c:65:import_set_state_nolock()) ffff8cb8c6229000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1789049371.436810:0:5852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8c6320e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e823b53a-3591-475c-8624-c682227e5c13+6:2354:x1875954089592832:12345-192.168.206.26@tcp:38: Request processed in 35099us (35272us total) trans 0 rc 0/0 00000100:00100000:1.0:1789049371.436821:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.26@tcp, seq: 4 00010000:00010000:3.0:1789049372.379175:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789049372.448481:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.26@tcp (source: 12345-192.168.206.26@tcp) 00000100:00100000:2.0:1789049372.448594:0:6841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954089593088 00000100:00100000:2.0:1789049372.448622:0:6841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954089593088 00000100:00100000:2.0:1789049372.448697:0:6841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.26@tcp, seq: 5 00000100:00100000:2.0:1789049372.448717:0:6841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8c6320700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e823b53a-3591-475c-8624-c682227e5c13+6:5583:x1875954089593088:12345-192.168.206.26@tcp:41: 00000004:00000024:2.0:1789049372.448755:0:6841:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261778432 avail 2259681280 00000100:00100000:2.0:1789049372.448838:0:6841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8c6320700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e823b53a-3591-475c-8624-c682227e5c13+6:5583:x1875954089593088:12345-192.168.206.26@tcp:41: Request processed in 123us (364us total) trans 0 rc 0/0 00000100:00100000:2.0:1789049372.448883:0:6841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.26@tcp, seq: 5 00000100:00080000:3.0:1789049372.450344:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789049372.451216:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.26@tcp (source: 12345-192.168.206.26@tcp) 00000100:00100000:0.0:1789049372.451256:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.26@tcp (source: 12345-192.168.206.26@tcp) 00000100:00100000:1.0:1789049372.451338:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954089592960 00000100:00100000:1.0:1789049372.451346:0:5852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954089592960 00000100:00100000:1.0:1789049372.451394:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954089593216 00000100:00100000:1.0:1789049372.451397:0:5852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954089593216 00000100:00100000:1.0:1789049372.451423:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.26@tcp, seq: 6 00000100:00100000:1.0:1789049372.451433:0:5852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8c6321500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e823b53a-3591-475c-8624-c682227e5c13+7:0:x1875954089592960:12345-192.168.206.26@tcp:41: 00000004:00000024:1.0:1789049372.451459:0:5852:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261778432 avail 2259681280 00000100:00100000:1.0:1789049372.451513:0:5852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8c6321500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e823b53a-3591-475c-8624-c682227e5c13+7:0:x1875954089592960:12345-192.168.206.26@tcp:41: Request processed in 81us (302us total) trans 0 rc 0/0 00000100:00100000:1.0:1789049372.451520:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.26@tcp, seq: 6 00000100:00100000:1.0:1789049372.451536:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.26@tcp, seq: 7 00000100:00100000:1.0:1789049372.451543:0:5852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8c6321180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e823b53a-3591-475c-8624-c682227e5c13+6:5583:x1875954089593216:12345-192.168.206.26@tcp:40: 00000100:00100000:1.0:1789049372.454049:0:5852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8c6321180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e823b53a-3591-475c-8624-c682227e5c13+6:5583:x1875954089593216:12345-192.168.206.26@tcp:40: Request processed in 2495us (2780us total) trans 0 rc 0/0 00000100:00100000:1.0:1789049372.454063:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.26@tcp, seq: 7 00000100:00100000:0.0:1789049372.462664:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.26@tcp (source: 12345-192.168.206.26@tcp) 00000100:00100000:0.0:1789049372.462709:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.26@tcp (source: 12345-192.168.206.26@tcp) 00000100:00100000:0.0:1789049372.462736:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.26@tcp (source: 12345-192.168.206.26@tcp) 00000100:00100000:0.0:1789049372.462775:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.26@tcp (source: 12345-192.168.206.26@tcp) 00000100:00100000:1.0:1789049372.462963:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954089593344 00000100:00100000:1.0:1789049372.462973:0:6704:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954089593344 00000100:00100000:1.0:1789049372.463014:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954089593472 00000100:00100000:1.0:1789049372.463017:0:6704:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954089593472 00000100:00100000:1.0:1789049372.463031:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.26@tcp, seq: 8 00000100:00100000:1.0:1789049372.463039:0:6704:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8c6320000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2354:x1875954089593344:12345-192.168.206.26@tcp:8: 00010000:00080000:1.0:1789049372.463070:0:6704:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0000: connection from e823b53a-3591-475c-8624-c682227e5c13@192.168.206.26@tcp t0 exp 0000000000000000 cur 198 last 0 00000020:00000080:1.0:1789049372.463101:0:6704:0:(genops.c:1384:class_connect()) connect: client e823b53a-3591-475c-8624-c682227e5c13, cookie 0xf4f48ce5e1bbed4c 00002000:00100000:1.0:1789049372.463112:0:6704:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli e823b53a-3591-475c-8624-c682227e5c13/ffff8cb8c6bc2000 ocd_connect_flags: 0xa046faf2e3640038 ocd_version: 2113a28 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1789049372.463148:0:6704:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:1.0:1789049372.463469:0:6704:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:1.0:1789049372.463497:0:6704:0:(import.c:65:import_set_state_nolock()) ffff8cb8c6bc2800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1789049372.463746:0:6704:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8c6320000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e823b53a-3591-475c-8624-c682227e5c13+6:2354:x1875954089593344:12345-192.168.206.26@tcp:8: Request processed in 705us (1007us total) trans 0 rc 0/0 00000100:00100000:1.0:1789049372.463755:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.26@tcp, seq: 8 00000100:00100000:1.0:1789049372.463830:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.26@tcp, seq: 9 00000100:00100000:1.0:1789049372.463838:0:6704:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8c6322d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2354:x1875954089593472:12345-192.168.206.26@tcp:8: 00000100:00100000:3.0:1789049372.464014:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954089593728 00000100:00100000:3.0:1789049372.464018:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954089593728 00000100:00100000:2.0:1789049372.466489:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954089593600 00000100:00100000:2.0:1789049372.466502:0:5853:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954089593600 00000100:00100000:2.0:1789049372.466560:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.26@tcp, seq: 0 00000100:00100000:2.0:1789049372.466571:0:5853:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8c6323800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e823b53a-3591-475c-8624-c682227e5c13+6:5583:x1875954089593600:12345-192.168.206.26@tcp:33: 00000100:00100000:3.0:1789049372.471452:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.26@tcp, seq: 126 00000100:00100000:3.0:1789049372.471473:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8d11e0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:de93d576-ed8d-4d27-ab00-9189a62cea33+10:2356:x1875954089593728:12345-192.168.206.26@tcp:400: 00000100:00100000:3.0:1789049372.471547:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8d11e0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:de93d576-ed8d-4d27-ab00-9189a62cea33+10:2356:x1875954089593728:12345-192.168.206.26@tcp:400: Request processed in 82us (8836us total) trans 0 rc 0/0 00000100:00100000:3.0:1789049372.471555:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.26@tcp, seq: 126 00010000:00080000:1.0:1789049372.480787:0:6704:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0001: connection from e823b53a-3591-475c-8624-c682227e5c13@192.168.206.26@tcp t0 exp 0000000000000000 cur 198 last 0 00000020:00000080:1.0:1789049372.480824:0:6704:0:(genops.c:1384:class_connect()) connect: client e823b53a-3591-475c-8624-c682227e5c13, cookie 0xf4f48ce5e1bbed53 00002000:00100000:1.0:1789049372.480838:0:6704:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli e823b53a-3591-475c-8624-c682227e5c13/ffff8cb8c6bc5800 ocd_connect_flags: 0xa046faf2e3640038 ocd_version: 2113a28 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1789049372.481272:0:6704:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:1.0:1789049372.481824:0:6704:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:1.0:1789049372.482115:0:6704:0:(import.c:65:import_set_state_nolock()) ffff8cb8c6bc0800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1789049372.482181:0:6704:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8c6322d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e823b53a-3591-475c-8624-c682227e5c13+6:2354:x1875954089593472:12345-192.168.206.26@tcp:8: Request processed in 18340us (19411us total) trans 0 rc 0/0 00000100:00100000:1.0:1789049372.482190:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.26@tcp, seq: 9 00000004:00080000:3.0:1789049372.501188:0:5853:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 34545us 00000004:00200000:2.0:1789049372.520427:0:5853:0:(mdt_handler.c:922:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000100:00100000:2.0:1789049372.520574:0:5853:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8c6323800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e823b53a-3591-475c-8624-c682227e5c13+6:5583:x1875954089593600:12345-192.168.206.26@tcp:33: Request processed in 53999us (57913us total) trans 0 rc 0/0 00000100:00100000:2.0:1789049372.520586:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.26@tcp, seq: 0 00000100:00100000:0.0:1789049372.768376:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.26@tcp (source: 12345-192.168.206.26@tcp) 00000100:00100000:2.0:1789049372.768524:0:6841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954089593856 00000100:00100000:2.0:1789049372.768533:0:6841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954089593856 00000100:00100000:2.0:1789049372.768676:0:6841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.26@tcp, seq: 8 00000100:00100000:2.0:1789049372.768687:0:6841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8c6321f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e823b53a-3591-475c-8624-c682227e5c13+6:5624:x1875954089593856:12345-192.168.206.26@tcp:101: 00010000:00010000:2.0:1789049372.768706:0:6841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789049372.768780:0:6841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6714600/0xf4f48ce5e1bbed5a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7fc5e358805a329c expref: -99 pid: 6841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049372.769057:0:6841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6714e00/0xf4f48ce5e1bbed61 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049372.769073:0:6841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6714e00/0xf4f48ce5e1bbed61 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049372.769150:0:6841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6714e00/0xf4f48ce5e1bbed61 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6841 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789049372.769185:0:6841:0:(mdt_handler.c:922:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:2.0:1789049372.769189:0:6841:0:(mdt_handler.c:1587:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1789049372.769969:0:6841:0:(mdt_handler.c:2522:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6714e00/0xf4f48ce5e1bbed61 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049372.770080:0:6841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6714600/0xf4f48ce5e1bbed5a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a329c expref: 8 pid: 6841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049372.770111:0:6841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6714e00/0xf4f48ce5e1bbed61 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a329c expref: 7 pid: 6841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049372.770121:0:6841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8cb8e0130100) 00010000:00010000:2.0:1789049372.770124:0:6841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789049372.770128:0:6841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cb8d6714e00, rc 0) 00000100:00100000:2.0:1789049372.770260:0:6841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8c6321f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e823b53a-3591-475c-8624-c682227e5c13+7:5624:x1875954089593856:12345-192.168.206.26@tcp:101: Request processed in 1574us (1891us total) trans 0 rc 0/0 00000100:00100000:2.0:1789049372.770268:0:6841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.26@tcp, seq: 8 00000100:00100000:2.0:1789049373.089405:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789049373.089429:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb8f73c7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1875954110586240:0@lo:13: 00000100:00100000:2.0:1789049373.089488:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789049373.089921:0:6707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954110586240 00000100:00100000:3.0:1789049373.089931:0:6707:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954110586240 00000100:00100000:3.0:1789049373.090027:0:6707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1789049373.090038:0:6707:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8c59c9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1875954110586240:12345-0@lo:13: 00002000:00000024:3.0:1789049373.090061:0:6707:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789049373.090116:0:6707:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8c59c9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1875954110586240:12345-0@lo:13: Request processed in 80us (627us total) trans 0 rc 0/0 00000100:00100000:3.0:1789049373.090124:0:6707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:0.0:1789049373.090149:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cb8f73c7480 x1875954110586240/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789049389 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789049373.090167:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb8f73c7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1875954110586240:0@lo:13: 00000100:00080000:2.0:1789049373.090358:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1789049373.403012:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1789049373.713994:0:6731:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of e823b53a-3591-475c-8624-c682227e5c13 00000100:00100000:1.0:1789049374.107391:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb8d0ab7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3308:1875954110586624:0@lo:400: 00000100:00100000:1.0:1789049374.107454:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789049374.107513:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789049374.107520:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb8d0ab7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1875954110586752:0@lo:400: 00000100:00100000:0.0:1789049374.107671:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb8d0ab6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3311:1875954110586496:0@lo:400: 00000100:00100000:2.0:1789049374.107976:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1789049374.107985:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb8c59cbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3309:1875954110587136:0@lo:13: 00000100:00100000:3.0:1789049374.108036:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb8d0ab4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7ef694ec-1ea0-4f02-800c-d1279b4fdf12:3310:1875954110586368:0@lo:400: 00000100:00100000:1.0:1789049374.111607:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789049374.111684:0:6705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954110586752 00000100:00100000:1.0:1789049374.111762:0:6705:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954110586752 00000100:00100000:1.0:1789049374.112012:0:6705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1789049374.112023:0:6705:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8d0ab4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3308:x1875954110586752:12345-0@lo:400: 00000100:00100000:1.0:1789049374.112082:0:6705:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8d0ab4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3308:x1875954110586752:12345-0@lo:400: Request processed in 63us (491us total) trans 0 rc 0/0 00000100:00100000:1.0:1789049374.112090:0:6705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:1.0:1789049374.112251:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cb8d0ab7800 x1875954110586752/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789049390 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789049374.112266:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb8d0ab7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1875954110586752:0@lo:400: 00000100:00100000:2.0:1789049374.112506:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789049374.112560:0:6707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954110587136 00000100:00100000:2.0:1789049374.112573:0:6707:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954110587136 00000100:00100000:1.0:1789049374.112578:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954110586624 00000100:00100000:1.0:1789049374.112585:0:5850:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954110586624 00000100:00100000:2.0:1789049374.112634:0:6707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1789049374.112642:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1789049374.112648:0:6707:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8c59cb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1875954110587136:12345-0@lo:13: 00000100:00100000:1.0:1789049374.112657:0:5850:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8d0ab5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1875954110586624:12345-0@lo:400: 00002000:00000024:2.0:1789049374.112679:0:6707:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789049374.112721:0:6707:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8c59cb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1875954110587136:12345-0@lo:13: Request processed in 79us (215us total) trans 0 rc 0/0 00000100:00100000:2.0:1789049374.112727:0:6707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00080000:2.0:1789049374.112745:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789049374.112749:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:2.0:1789049374.112773:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cb8c59cbb80 x1875954110587136/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789049390 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789049374.112782:0:3309:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967298 gen 2 00000100:00100000:2.0:1789049374.112799:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb8c59cbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3309:1875954110587136:0@lo:13: 00000100:00100000:0.0:1789049374.113458:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789049374.113505:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb8d0ab5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3311:1875954110587008:0@lo:400: 00000100:00100000:0.0:1789049374.113541:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789049374.113653:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954110587008 00000100:00100000:0.0:1789049374.113669:0:6704:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954110587008 00000100:00100000:0.0:1789049374.113704:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1789049374.113711:0:6704:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8c6323100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3311:x1875954110587008:12345-0@lo:400: 00000100:00100000:0.0:1789049374.113753:0:6704:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8c6323100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3311:x1875954110587008:12345-0@lo:400: Request processed in 42us (211us total) trans 0 rc 0/0 00000100:00100000:0.0:1789049374.113760:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:0.0:1789049374.113792:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cb8d0ab5f80 x1875954110587008/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789049390 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789049374.113802:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb8d0ab5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3311:1875954110587008:0@lo:400: 00000100:00100000:2.0:1789049374.113930:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954110586496 00000100:00100000:2.0:1789049374.113935:0:5852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954110586496 00000100:00100000:2.0:1789049374.113967:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1789049374.113975:0:5852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8c6321880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1875954110586496:12345-0@lo:400: 00000100:00100000:2.0:1789049374.114012:0:5852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8c6321880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1875954110586496:12345-0@lo:400: Request processed in 38us (2445us total) trans 0 rc 0/0 00000100:00100000:2.0:1789049374.114018:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1789049374.114475:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb8d0ab6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3311:1875954110586496:0@lo:400: 00000100:00100000:1.0:1789049374.121214:0:5850:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8d0ab5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1875954110586624:12345-0@lo:400: Request processed in 8550us (13749us total) trans 0 rc 0/0 00000100:00100000:1.0:1789049374.121231:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1789049374.125752:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789049374.125752:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb8d0ab7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3308:1875954110586624:0@lo:400: 00000100:00100000:3.0:1789049374.125930:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb8d0ab6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3310:1875954110586880:0@lo:400: 00000100:00100000:3.0:1789049374.125987:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789049374.126103:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954110586880 00000100:00100000:0.0:1789049374.126111:0:5851:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954110586880 00000100:00100000:0.0:1789049374.126184:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1789049374.126194:0:5851:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8f73c5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1875954110586880:12345-0@lo:400: 00000100:00100000:0.0:1789049374.126256:0:5851:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8f73c5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1875954110586880:12345-0@lo:400: Request processed in 64us (269us total) trans 0 rc 0/0 00000100:00100000:0.0:1789049374.126262:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00080000:1.0:1789049374.126326:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789049374.126519:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb8d0ab6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3310:1875954110586880:0@lo:400: 00000100:00100000:2.0:1789049374.129629:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954110586368 00000100:00100000:2.0:1789049374.129648:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954110586368 00000100:00100000:2.0:1789049374.129771:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 127 00000100:00100000:2.0:1789049374.129783:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8d11e0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7ef694ec-1ea0-4f02-800c-d1279b4fdf12+19:3310:x1875954110586368:12345-0@lo:400: 00000100:00100000:2.0:1789049374.129900:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8d11e0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7ef694ec-1ea0-4f02-800c-d1279b4fdf12+19:3310:x1875954110586368:12345-0@lo:400: Request processed in 119us (4153us total) trans 0 rc 0/0 00000100:00100000:2.0:1789049374.129907:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 127 00000100:00100000:1.0:1789049374.129930:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb8d0ab4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7ef694ec-1ea0-4f02-800c-d1279b4fdf12:3310:1875954110586368:0@lo:400: 00010000:00010000:0.0:1789049374.430863:0:6719:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789049375.168636:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.26@tcp (source: 12345-192.168.206.26@tcp) 00000100:00100000:2.0:1789049375.168724:0:6841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954089593984 00000100:00100000:2.0:1789049375.168734:0:6841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954089593984 00000100:00100000:2.0:1789049375.168815:0:6841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.26@tcp, seq: 9 00000100:00100000:2.0:1789049375.168825:0:6841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8c6322680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e823b53a-3591-475c-8624-c682227e5c13+7:5676:x1875954089593984:12345-192.168.206.26@tcp:41: 00000004:00000024:2.0:1789049375.168893:0:6841:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261778432 avail 2259681280 00000100:00100000:2.0:1789049375.168968:0:6841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8c6322680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e823b53a-3591-475c-8624-c682227e5c13+7:5676:x1875954089593984:12345-192.168.206.26@tcp:41: Request processed in 144us (341us total) trans 0 rc 0/0 00000100:00100000:2.0:1789049375.168975:0:6841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.26@tcp, seq: 9 00000100:00080000:1.0:1789049375.169797:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789049375.173680:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.26@tcp (source: 12345-192.168.206.26@tcp) 00000100:00100000:2.0:1789049375.173755:0:6707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954089594112 00000100:00100000:2.0:1789049375.173764:0:6707:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954089594112 00000100:00100000:2.0:1789049375.173834:0:6707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.26@tcp, seq: 9 00000100:00100000:2.0:1789049375.173871:0:6707:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8c6321c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:e823b53a-3591-475c-8624-c682227e5c13+5:5676:x1875954089594112:12345-192.168.206.26@tcp:13: 00002000:00000024:2.0:1789049375.173906:0:6707:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789049375.173970:0:6707:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8c6321c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:e823b53a-3591-475c-8624-c682227e5c13+5:5676:x1875954089594112:12345-192.168.206.26@tcp:13: Request processed in 127us (298us total) trans 0 rc 0/0 00000100:00100000:2.0:1789049375.173979:0:6707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.26@tcp, seq: 9 00000100:00080000:1.0:1789049375.174223:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789049375.176826:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.26@tcp (source: 12345-192.168.206.26@tcp) 00000100:00100000:2.0:1789049375.176967:0:6707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954089594240 00000100:00100000:2.0:1789049375.176977:0:6707:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954089594240 00000100:00100000:2.0:1789049375.177043:0:6707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.26@tcp, seq: 10 00000100:00100000:2.0:1789049375.177062:0:6707:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8fc999c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:e823b53a-3591-475c-8624-c682227e5c13+6:5676:x1875954089594240:12345-192.168.206.26@tcp:13: 00002000:00000024:2.0:1789049375.177086:0:6707:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789049375.177150:0:6707:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8fc999c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:e823b53a-3591-475c-8624-c682227e5c13+6:5676:x1875954089594240:12345-192.168.206.26@tcp:13: Request processed in 98us (333us total) trans 0 rc 0/0 00000100:00100000:2.0:1789049375.177158:0:6707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.26@tcp, seq: 10 00000100:00080000:1.0:1789049375.177572:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:3.0:1789049375.451353:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789049376.475340:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1789049376.741272:0:5872:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of e823b53a-3591-475c-8624-c682227e5c13 00000001:00100000:3.0:1789049376.742335:0:7663:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of e823b53a-3591-475c-8624-c682227e5c13 00000001:02000400:3.0:1789049377.461107:0:8318:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00010000:00010000:0.0:1789049377.499249:0:6719:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789049377.610564:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.26@tcp (source: 12345-192.168.206.26@tcp) 00000100:00100000:0.0:1789049377.610606:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.26@tcp (source: 12345-192.168.206.26@tcp) 00000100:00100000:0.0:1789049377.610627:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.26@tcp (source: 12345-192.168.206.26@tcp) 00000100:00100000:0.0:1789049377.610659:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.26@tcp (source: 12345-192.168.206.26@tcp) 00000100:00100000:0.0:1789049377.610685:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954089594368 00000100:00100000:0.0:1789049377.610693:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954089594368 00000100:00100000:0.0:1789049377.610735:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.26@tcp, seq: 128 00000100:00100000:0.0:1789049377.610744:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8c6b82050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:de93d576-ed8d-4d27-ab00-9189a62cea33+10:2357:x1875954089594368:12345-192.168.206.26@tcp:400: 00000100:00100000:0.0:1789049377.610803:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8c6b82050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:de93d576-ed8d-4d27-ab00-9189a62cea33+10:2357:x1875954089594368:12345-192.168.206.26@tcp:400: Request processed in 61us (247us total) trans 0 rc 0/0 00000100:00100000:0.0:1789049377.610810:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.26@tcp, seq: 128 00000100:00100000:0.0:1789049377.610839:0:6703:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954089594624 00000100:00100000:0.0:1789049377.610859:0:6703:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954089594624 00000100:00100000:0.0:1789049377.610888:0:6703:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954089594752 00000100:00100000:0.0:1789049377.610891:0:6703:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954089594752 00000100:00100000:0.0:1789049377.610905:0:6703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.26@tcp, seq: 8 00000100:00100000:0.0:1789049377.610911:0:6703:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8fc99b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e823b53a-3591-475c-8624-c682227e5c13+5:2357:x1875954089594624:12345-192.168.206.26@tcp:400: 00000100:00100000:0.0:1789049377.610937:0:6703:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8fc99b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e823b53a-3591-475c-8624-c682227e5c13+5:2357:x1875954089594624:12345-192.168.206.26@tcp:400: Request processed in 26us (331us total) trans 0 rc 0/0 00000100:00100000:0.0:1789049377.610943:0:6703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.26@tcp, seq: 8 00000100:00100000:0.0:1789049377.610954:0:6703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.26@tcp, seq: 9 00000100:00100000:0.0:1789049377.610960:0:6703:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8fc99bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e823b53a-3591-475c-8624-c682227e5c13+5:2357:x1875954089594752:12345-192.168.206.26@tcp:400: 00000100:00100000:0.0:1789049377.610982:0:6703:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8fc99bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e823b53a-3591-475c-8624-c682227e5c13+5:2357:x1875954089594752:12345-192.168.206.26@tcp:400: Request processed in 22us (322us total) trans 0 rc 0/0 00000100:00100000:0.0:1789049377.610988:0:6703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.26@tcp, seq: 9 00000100:00100000:0.0:1789049377.611003:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954089594496 00000100:00100000:0.0:1789049377.611006:0:5852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954089594496 00000100:00100000:0.0:1789049377.611032:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.26@tcp, seq: 22 00000100:00100000:0.0:1789049377.611038:0:5852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8fc99ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e823b53a-3591-475c-8624-c682227e5c13+6:2357:x1875954089594496:12345-192.168.206.26@tcp:400: 00000100:00100000:0.0:1789049377.611076:0:5852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8fc99ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e823b53a-3591-475c-8624-c682227e5c13+6:2357:x1875954089594496:12345-192.168.206.26@tcp:400: Request processed in 38us (448us total) trans 0 rc 0/0 00000100:00100000:0.0:1789049377.611081:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.26@tcp, seq: 22 00000100:00080000:0.0:1789049377.611201:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789049377.611205:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789049377.611207:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789049378.202971:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789049378.202995:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb8fc998000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1875954110587264:0@lo:13: 00000100:00100000:0.0:1789049378.203070:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789049378.205248:0:6707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954110587264 00000100:00100000:2.0:1789049378.205262:0:6707:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954110587264 00000100:00100000:2.0:1789049378.205356:0:6707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1789049378.205366:0:6707:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8c633d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1875954110587264:12345-0@lo:13: 00002000:00000024:2.0:1789049378.205402:0:6707:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789049378.205470:0:6707:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8c633d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1875954110587264:12345-0@lo:13: Request processed in 107us (2400us total) trans 0 rc 0/0 00000100:00100000:2.0:1789049378.205478:0:6707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00080000:2.0:1789049378.205523:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1789049378.207047:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cb8fc998000 x1875954110587264/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789049394 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789049378.207069:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb8fc998000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1875954110587264:0@lo:13: 00010000:00010000:3.0:1789049378.523456:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789049379.227308:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789049379.227333:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb8c59cbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3311:1875954110587392:0@lo:13: 00000100:00100000:3.0:1789049379.228253:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789049379.229670:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb8f73c6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3308:1875954110587648:0@lo:400: 00000100:00100000:3.0:1789049379.229712:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789049379.229746:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789049379.229753:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb8f73c6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3308:1875954110587776:0@lo:400: 00000100:00100000:3.0:1789049379.229777:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789049379.229796:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb8fce94380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1875954110587904:0@lo:400: 00000100:00100000:3.0:1789049379.229811:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954110587648 00000100:00100000:3.0:1789049379.229819:0:5850:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954110587648 00000100:00100000:1.0:1789049379.229834:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789049379.229951:0:6841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954110587776 00000100:00100000:0.0:1789049379.229956:0:6841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954110587776 00000100:00100000:1.0:1789049379.230053:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1789049379.230059:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb8f73c7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7ef694ec-1ea0-4f02-800c-d1279b4fdf12:3310:1875954110587520:0@lo:400: 00000100:00100000:1.0:1789049379.230089:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789049379.230108:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb8fce96300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3310:1875954110588032:0@lo:400: 00000100:00100000:1.0:1789049379.230137:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789049379.230159:0:6703:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954110587904 00000100:00100000:0.0:1789049379.230485:0:6841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954110588032 00000100:00100000:0.0:1789049379.230490:0:6841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954110588032 00000100:00100000:0.0:1789049379.230511:0:6841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1789049379.230518:0:6841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8fce96a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1875954110587648:12345-0@lo:400: 00000100:00100000:0.0:1789049379.230584:0:6841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8fce96a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1875954110587648:12345-0@lo:400: Request processed in 65us (871us total) trans 0 rc 0/0 00000100:00100000:0.0:1789049379.230591:0:6841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1789049379.230606:0:6841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1789049379.230612:0:6841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8fce97480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1875954110587776:12345-0@lo:400: 00000100:00100000:0.0:1789049379.230639:0:6841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8fce97480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1875954110587776:12345-0@lo:400: Request processed in 28us (863us total) trans 0 rc 0/0 00000100:00100000:0.0:1789049379.230645:0:6841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1789049379.230657:0:6841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1789049379.230669:0:6841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8d0ab7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1875954110588032:12345-0@lo:400: 00000100:00100000:0.0:1789049379.230704:0:6841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8d0ab7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1875954110588032:12345-0@lo:400: Request processed in 36us (566us total) trans 0 rc 0/0 00000100:00100000:0.0:1789049379.230711:0:6841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1789049379.230749:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb8f73c6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3308:1875954110587776:0@lo:400: 00000100:00100000:0.0:1789049379.230759:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb8f73c6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3308:1875954110587648:0@lo:400: 00000100:00100000:1.0:1789049379.230804:0:6703:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954110587904 00000100:00100000:1.0:1789049379.230836:0:6703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1789049379.230867:0:6703:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8d0ab4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3310:x1875954110587904:12345-0@lo:400: 00000100:00100000:1.0:1789049379.230968:0:6703:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8d0ab4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3310:x1875954110587904:12345-0@lo:400: Request processed in 126us (1133us total) trans 0 rc 0/0 00000100:00100000:1.0:1789049379.230975:0:6703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1789049379.231027:0:6707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954110587392 00000100:00100000:2.0:1789049379.231033:0:6707:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954110587392 00000100:00100000:1.0:1789049379.231090:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb8fce96300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3310:1875954110588032:0@lo:400: 00010000:00080000:1.0:1789049379.231101:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cb8fce94380 x1875954110587904/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789049395 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789049379.231111:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb8fce94380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1875954110587904:0@lo:400: 00000100:00100000:2.0:1789049379.231484:0:6707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1789049379.231494:0:6707:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8f73c4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1875954110587392:12345-0@lo:13: 00002000:00000024:2.0:1789049379.231521:0:6707:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789049379.231560:0:6707:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8f73c4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1875954110587392:12345-0@lo:13: Request processed in 69us (3311us total) trans 0 rc 0/0 00000100:00100000:2.0:1789049379.231578:0:6707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00080000:2.0:1789049379.231602:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789049379.231607:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789049379.231616:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954110587520 00000100:00100000:2.0:1789049379.231620:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954110587520 00000100:00100000:2.0:1789049379.231654:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 129 00000100:00100000:2.0:1789049379.231661:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8c6b83050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7ef694ec-1ea0-4f02-800c-d1279b4fdf12+19:3310:x1875954110587520:12345-0@lo:400: 00000100:00100000:2.0:1789049379.231707:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8c6b83050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7ef694ec-1ea0-4f02-800c-d1279b4fdf12+19:3310:x1875954110587520:12345-0@lo:400: Request processed in 47us (1616us total) trans 0 rc 0/0 00000100:00100000:2.0:1789049379.231714:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 129 00000100:00100000:1.0:1789049379.232329:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb8f73c7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7ef694ec-1ea0-4f02-800c-d1279b4fdf12:3310:1875954110587520:0@lo:400: 00010000:00080000:3.0:1789049379.233602:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cb8c59cbb80 x1875954110587392/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789049395 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789049379.233624:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb8c59cbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3311:1875954110587392:0@lo:13: 00010000:00010000:3.0:1789049379.549046:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789049380.571003:0:6719:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1789049380.960833:0:8465:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffca92d14e0 20000000:00000080:3.0:1789049380.960876:0:8465:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff8cb900ece800 uarg=0000000000000000 20000000:01000000:3.0:1789049380.961403:0:8465:0:(mgs_llog.c:2006:mgs_parse_devname()) Device name lustre without fsname 20000000:01000000:3.0:1789049380.961405:0:8465:0:(mgs_llog.c:6069:mgs_set_conf_param()) lustre is seen as a file system name 20000000:01000000:3.0:1789049380.961408:0:8465:0:(mgs_llog.c:6100:mgs_set_conf_param()) set_conf_param fs='lustre' device='lustre' param='sys.jobid_var=procname_uid' 20000000:01000000:3.0:1789049380.961411:0:8465:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.jobid_var=procname_uid' 20000000:01000000:3.0:1789049380.961416:0:8465:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.jobid_var=procname_uid' val=procname_uid 20000000:01000000:3.0:1789049380.961430:0:8465:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:3.0:1789049380.961432:0:8465:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:3.0:1789049380.961716:0:8465:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:3.0:1789049380.961719:0:8465:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.jobid_var fl=4 00000040:00080000:2.0:1789049380.973651:0:8466:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000040:00080000:2.0:1789049380.974765:0:8465:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].39, 224 off14880 00000040:00080000:2.0:1789049380.974819:0:8465:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].40, 120 off15000 00000040:00080000:2.0:1789049380.975009:0:8465:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].41, 224 off15224 20000000:01000000:2.0:1789049380.975113:0:8465:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:2.0:1789049380.975117:0:8465:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.jobid_var fl=4 00000040:00080000:3.0:1789049380.978210:0:8467:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 11 count 11 00000040:00080000:2.0:1789049380.978819:0:8465:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].11, 224 off10160 00000040:00080000:2.0:1789049380.979162:0:8465:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].12, 120 off10280 00000040:00080000:2.0:1789049380.979202:0:8465:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].13, 224 off10504 20000000:01000000:2.0:1789049380.979217:0:8465:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0001 20000000:01000000:2.0:1789049380.979219:0:8465:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0001/lustre/sys.jobid_var fl=4 00000040:00080000:0.0:1789049380.980279:0:8468:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 8 count 8 00000040:00080000:2.0:1789049380.980807:0:8465:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9632 00000040:00080000:2.0:1789049380.981017:0:8465:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 120 off9752 00000040:00080000:2.0:1789049380.981166:0:8465:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 224 off9976 20000000:01000000:2.0:1789049380.981180:0:8465:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:2.0:1789049380.981183:0:8465:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.jobid_var fl=4 00000040:00080000:0.0:1789049380.983575:0:8469:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 34 count 34 00000040:00080000:2.0:1789049380.984260:0:8465:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 224 off14144 00000040:00080000:2.0:1789049380.984311:0:8465:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 120 off14264 00000040:00080000:2.0:1789049380.984363:0:8465:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 224 off14488 10000000:01000000:2.0:1789049380.984379:0:8465:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:2.0:1789049380.984399:0:8465:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8cb8d6715a00/0xf4f48ce5e1bbed68 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049380.984416:0:8465:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8cb7c4c38e00/0xf4f48ce5e1bbec65 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf4f48ce5e1bbec5e expref: 18 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049380.984423:0:8465:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8cb8c146c200/0xf4f48ce5e1bbec8f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf4f48ce5e1bbec88 expref: 18 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049380.984429:0:8465:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8cb8c146c600/0xf4f48ce5e1bbecb9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf4f48ce5e1bbecb2 expref: 18 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049380.984435:0:8465:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8cb7c4c39200/0xf4f48ce5e1bbecc7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf4f48ce5e1bbecc0 expref: 18 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049380.984442:0:8465:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8cb8d6714400/0xf4f48ce5e1bbecd5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf4f48ce5e1bbecce expref: 18 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049380.984463:0:8465:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8cb8d6715c00/0xf4f48ce5e1bbecf1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf4f48ce5e1bbecea expref: 18 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049380.984469:0:8465:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8cb8d776f600/0xf4f48ce5e1bbed1b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf4f48ce5e1bbed14 expref: 18 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049380.984477:0:8465:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8cb7c4c39e00/0xf4f48ce5e1bbed29 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a323a expref: 9 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049380.984484:0:8465:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8cb8d776f200/0xf4f48ce5e1bbed30 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a3241 expref: 9 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049380.984490:0:8465:0:(ldlm_resource.c:1751:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8cb8d6715a00/0xf4f48ce5e1bbed68 lrc: 12/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 8465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049380.984615:0:8465:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8cb8d776f200/0xf4f48ce5e1bbed30 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a3241 expref: 9 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049380.984631:0:8465:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8cb8d776f200/0xf4f48ce5e1bbed30 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a3241 expref: 9 pid: 5845 timeout: 307 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789049380.984646:0:8465:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb8c59cad80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8465:1875954110588160:192.168.206.26@tcp:104: 00010000:00010000:2.0:1789049380.984806:0:8465:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8cb7c4c39e00/0xf4f48ce5e1bbed29 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a323a expref: 9 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049380.984815:0:8465:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8cb7c4c39e00/0xf4f48ce5e1bbed29 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a323a expref: 9 pid: 5843 timeout: 307 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789049380.984824:0:8465:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb8c59cbb80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8465:1875954110588288:192.168.206.26@tcp:104: 00010000:00010000:2.0:1789049380.984924:0:8465:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8cb8d776f600/0xf4f48ce5e1bbed1b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf4f48ce5e1bbed14 expref: 18 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049380.984933:0:8465:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8cb8d776f600/0xf4f48ce5e1bbed1b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf4f48ce5e1bbed14 expref: 18 pid: 5845 timeout: 357 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789049380.984943:0:8465:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb8d0aaed80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8465:1875954110588416:0@lo:104: 00000100:00100000:2.0:1789049380.984984:0:8465:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1789049380.985018:0:8465:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8cb8d6715c00/0xf4f48ce5e1bbecf1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf4f48ce5e1bbecea expref: 18 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049380.985156:0:8465:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8cb8d6715c00/0xf4f48ce5e1bbecf1 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf4f48ce5e1bbecea expref: 18 pid: 5845 timeout: 357 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789049380.985166:0:8465:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb8d0aad880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8465:1875954110588544:0@lo:104: 00000100:00100000:2.0:1789049380.985194:0:8465:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1789049380.985223:0:8465:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8cb8d6714400/0xf4f48ce5e1bbecd5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf4f48ce5e1bbecce expref: 18 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049380.985232:0:8465:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8cb8d6714400/0xf4f48ce5e1bbecd5 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf4f48ce5e1bbecce expref: 18 pid: 5845 timeout: 357 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789049380.985240:0:8465:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb8d0aaf100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8465:1875954110588672:0@lo:104: 00010000:00010000:2.0:1789049380.985266:0:8465:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8cb7c4c39200/0xf4f48ce5e1bbecc7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf4f48ce5e1bbecc0 expref: 18 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049380.985274:0:8465:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8cb7c4c39200/0xf4f48ce5e1bbecc7 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf4f48ce5e1bbecc0 expref: 18 pid: 5844 timeout: 357 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789049380.985281:0:8465:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb8d0aae680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8465:1875954110588800:0@lo:104: 00010000:00010000:2.0:1789049380.985316:0:8465:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8cb8c146c600/0xf4f48ce5e1bbecb9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf4f48ce5e1bbecb2 expref: 18 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049380.985324:0:8465:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8cb8c146c600/0xf4f48ce5e1bbecb9 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf4f48ce5e1bbecb2 expref: 18 pid: 5844 timeout: 357 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789049380.985332:0:8465:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb8d0aafb80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8465:1875954110588928:0@lo:104: 00010000:00010000:2.0:1789049380.985355:0:8465:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8cb8c146c200/0xf4f48ce5e1bbec8f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf4f48ce5e1bbec88 expref: 18 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049380.985362:0:8465:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8cb8c146c200/0xf4f48ce5e1bbec8f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf4f48ce5e1bbec88 expref: 18 pid: 5845 timeout: 357 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789049380.985369:0:8465:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb8d0aac380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8465:1875954110589056:0@lo:104: 00010000:00010000:2.0:1789049380.985389:0:8465:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8cb7c4c38e00/0xf4f48ce5e1bbec65 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf4f48ce5e1bbec5e expref: 18 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049380.985395:0:8465:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8cb7c4c38e00/0xf4f48ce5e1bbec65 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf4f48ce5e1bbec5e expref: 18 pid: 5845 timeout: 357 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789049380.985402:0:8465:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb8d0aae300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8465:1875954110589184:0@lo:104: 00000100:00100000:2.0:1789049380.985417:0:8465:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cb8d0a613c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789049380.985512:0:5834:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:3.0:1789049380.985545:0:5834:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789049380.985583:0:5834:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789049380.985591:0:5834:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789049380.985599:0:5834:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789049380.985609:0:5834:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789049380.985618:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954110588416 00000100:00100000:3.0:1789049380.985624:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954110588416 00000100:00100000:3.0:1789049380.985660:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954110588544 00000100:00100000:3.0:1789049380.985663:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954110588544 00000100:00100000:3.0:1789049380.985672:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954110588672 00000100:00100000:3.0:1789049380.985675:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954110588672 00000100:00100000:3.0:1789049380.985685:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954110588800 00000100:00100000:3.0:1789049380.985687:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954110588800 00000100:00100000:3.0:1789049380.985696:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954110588928 00000100:00100000:3.0:1789049380.985699:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954110588928 00000100:00100000:3.0:1789049380.985707:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954110589056 00000100:00100000:3.0:1789049380.985709:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954110589056 00000100:00100000:3.0:1789049380.985717:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954110589184 00000100:00100000:3.0:1789049380.985719:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954110589184 00000100:00100000:3.0:1789049380.985730:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1789049380.985738:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8d0aadf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:7ef694ec-1ea0-4f02-800c-d1279b4fdf12+9:8465:x1875954110588416:12345-0@lo:104: 00010000:00010000:3.0:1789049380.985751:0:5834:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.126@tcp lock: ffff8cb8d6714c00/0xf4f48ce5e1bbed14 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xf4f48ce5e1bbed1b expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049380.985812:0:5834:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1789049380.985818:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8d0aadf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:7ef694ec-1ea0-4f02-800c-d1279b4fdf12+9:8465:x1875954110588416:12345-0@lo:104: Request processed in 81us (835us total) trans 0 rc 0/0 00000100:00100000:3.0:1789049380.985825:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1789049380.985864:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1789049380.985871:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8fcedfc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:7ef694ec-1ea0-4f02-800c-d1279b4fdf12+8:8465:x1875954110588544:12345-0@lo:104: 00010000:00010000:3.0:1789049380.985879:0:5834:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.126@tcp lock: ffff8cb7c4c38000/0xf4f48ce5e1bbecea lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xf4f48ce5e1bbecf1 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049380.985927:0:5834:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1789049380.985933:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8fcedfc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:7ef694ec-1ea0-4f02-800c-d1279b4fdf12+8:8465:x1875954110588544:12345-0@lo:104: Request processed in 63us (738us total) trans 0 rc 0/0 00000100:00100000:3.0:1789049380.985939:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1789049380.985978:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1789049380.985985:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8fce95c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:7ef694ec-1ea0-4f02-800c-d1279b4fdf12+7:8465:x1875954110588672:12345-0@lo:104: 00010000:00010000:3.0:1789049380.985993:0:5834:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.126@tcp lock: ffff8cb7c4c38800/0xf4f48ce5e1bbecce lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xf4f48ce5e1bbecd5 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049380.986211:0:5834:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:3.0:1789049380.986217:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8fce95c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:7ef694ec-1ea0-4f02-800c-d1279b4fdf12+7:8465:x1875954110588672:12345-0@lo:104: Request processed in 233us (672us total) trans 0 rc 0/0 00000100:00100000:3.0:1789049380.986223:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1789049380.986240:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1789049380.986247:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8fce94a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:7ef694ec-1ea0-4f02-800c-d1279b4fdf12+6:8465:x1875954110588800:12345-0@lo:104: 00010000:00010000:3.0:1789049380.986254:0:5834:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.126@tcp lock: ffff8cb8d776f400/0xf4f48ce5e1bbecc0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xf4f48ce5e1bbecc7 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049380.986288:0:5834:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:3.0:1789049380.986293:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8fce94a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:7ef694ec-1ea0-4f02-800c-d1279b4fdf12+6:8465:x1875954110588800:12345-0@lo:104: Request processed in 48us (711us total) trans 0 rc 0/0 00000100:00100000:3.0:1789049380.986298:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1789049380.986312:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1789049380.986317:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8fce94e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:7ef694ec-1ea0-4f02-800c-d1279b4fdf12+5:8465:x1875954110588928:12345-0@lo:104: 00010000:00010000:3.0:1789049380.986324:0:5834:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.126@tcp lock: ffff8cb8c146dc00/0xf4f48ce5e1bbecb2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xf4f48ce5e1bbecb9 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049380.986348:0:5834:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to priority blp list, 5 blwis in pool 00000100:00100000:3.0:1789049380.986352:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8fce94e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:7ef694ec-1ea0-4f02-800c-d1279b4fdf12+5:8465:x1875954110588928:12345-0@lo:104: Request processed in 36us (760us total) trans 0 rc 0/0 00000100:00100000:3.0:1789049380.986357:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1789049380.986368:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1789049380.986373:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8fce94700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:7ef694ec-1ea0-4f02-800c-d1279b4fdf12+4:8465:x1875954110589056:12345-0@lo:104: 00010000:00010000:3.0:1789049380.986380:0:5834:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.126@tcp lock: ffff8cb7c4c38c00/0xf4f48ce5e1bbec88 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xf4f48ce5e1bbec8f expref: -99 pid: 7645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049380.986405:0:5834:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/6 locks to priority blp list, 6 blwis in pool 00000100:00100000:3.0:1789049380.986410:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8fce94700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:7ef694ec-1ea0-4f02-800c-d1279b4fdf12+4:8465:x1875954110589056:12345-0@lo:104: Request processed in 38us (810us total) trans 0 rc 0/0 00000100:00100000:3.0:1789049380.986415:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1789049380.986426:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1789049380.986432:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8fce95500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:7ef694ec-1ea0-4f02-800c-d1279b4fdf12+3:8465:x1875954110589184:12345-0@lo:104: 00010000:00010000:3.0:1789049380.986438:0:5834:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.126@tcp lock: ffff8cb8c146d200/0xf4f48ce5e1bbec5e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xf4f48ce5e1bbec65 expref: -99 pid: 7645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049380.986469:0:5834:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/7 locks to priority blp list, 7 blwis in pool 00000100:00100000:3.0:1789049380.986475:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8fce95500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:7ef694ec-1ea0-4f02-800c-d1279b4fdf12+3:8465:x1875954110589184:12345-0@lo:104: Request processed in 43us (865us total) trans 0 rc 0/0 00000100:00100000:3.0:1789049380.986481:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00010000:00010000:3.0:1789049380.986499:0:5838:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 6 total in blp. (6 blwis in pool) 00010000:00010000:3.0:1789049380.986504:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.126@tcp lock: ffff8cb8d6714c00/0xf4f48ce5e1bbed14 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xf4f48ce5e1bbed1b expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049380.986511:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cb8d6714c00 already unused, calling callback (ffffffffc1ca3c20) 10000000:00010000:3.0:1789049380.986527:0:5838:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.126@tcp lock: ffff8cb8d6714c00/0xf4f48ce5e1bbed14 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400400000000 nid: local remote: 0xf4f48ce5e1bbed1b expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049380.986536:0:5838:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.126@tcp lock: ffff8cb8d6714c00/0xf4f48ce5e1bbed14 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1408400000000 nid: local remote: 0xf4f48ce5e1bbed1b expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789049380.986543:0:5838:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.126@tcp lock: ffff8cb8d6714c00/0xf4f48ce5e1bbed14 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1409400000000 nid: local remote: 0xf4f48ce5e1bbed1b expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789049380.986548:0:5838:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1789049380.986589:0:5838:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.126@tcp lock: ffff8cb8d6714c00/0xf4f48ce5e1bbed14 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf4f48ce5e1bbed1b expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049380.986596:0:5838:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789049380.986613:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.126@tcp lock: ffff8cb8d6714c00/0xf4f48ce5e1bbed14 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf4f48ce5e1bbed1b expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049380.986620:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.126@tcp lock: ffff8cb8d6714c00/0xf4f48ce5e1bbed14 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf4f48ce5e1bbed1b expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049380.986643:0:5838:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 5 total in blp. (5 blwis in pool) 00010000:00010000:3.0:1789049380.986647:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.126@tcp lock: ffff8cb7c4c38000/0xf4f48ce5e1bbecea lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0xf4f48ce5e1bbecf1 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049380.986653:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cb7c4c38000 already unused, calling callback (ffffffffc1ca3c20) 10000000:00010000:3.0:1789049380.986656:0:5838:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.126@tcp lock: ffff8cb7c4c38000/0xf4f48ce5e1bbecea lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400400000000 nid: local remote: 0xf4f48ce5e1bbecf1 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049380.986663:0:5838:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.126@tcp lock: ffff8cb7c4c38000/0xf4f48ce5e1bbecea lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1408400000000 nid: local remote: 0xf4f48ce5e1bbecf1 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789049380.986669:0:5838:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.126@tcp lock: ffff8cb7c4c38000/0xf4f48ce5e1bbecea lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1409400000000 nid: local remote: 0xf4f48ce5e1bbecf1 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789049380.986673:0:5838:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1789049380.986686:0:5838:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.126@tcp lock: ffff8cb7c4c38000/0xf4f48ce5e1bbecea lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf4f48ce5e1bbecf1 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049380.986691:0:5838:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789049380.986696:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.126@tcp lock: ffff8cb7c4c38000/0xf4f48ce5e1bbecea lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf4f48ce5e1bbecf1 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049380.986703:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.126@tcp lock: ffff8cb7c4c38000/0xf4f48ce5e1bbecea lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf4f48ce5e1bbecf1 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049380.986711:0:5838:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:3.0:1789049380.986713:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.126@tcp lock: ffff8cb7c4c38800/0xf4f48ce5e1bbecce lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xf4f48ce5e1bbecd5 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049380.986727:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cb7c4c38800 already unused, calling callback (ffffffffc1ca3c20) 10000000:00010000:3.0:1789049380.986730:0:5838:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.126@tcp lock: ffff8cb7c4c38800/0xf4f48ce5e1bbecce lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0xf4f48ce5e1bbecd5 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049380.986737:0:5838:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.126@tcp lock: ffff8cb7c4c38800/0xf4f48ce5e1bbecce lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0xf4f48ce5e1bbecd5 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789049380.986743:0:5838:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.126@tcp lock: ffff8cb7c4c38800/0xf4f48ce5e1bbecce lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0xf4f48ce5e1bbecd5 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789049380.986748:0:5838:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1789049380.986759:0:5838:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.126@tcp lock: ffff8cb7c4c38800/0xf4f48ce5e1bbecce lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf4f48ce5e1bbecd5 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049380.986764:0:5838:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789049380.986777:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.126@tcp lock: ffff8cb7c4c38800/0xf4f48ce5e1bbecce lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf4f48ce5e1bbecd5 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049380.986784:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.126@tcp lock: ffff8cb7c4c38800/0xf4f48ce5e1bbecce lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf4f48ce5e1bbecd5 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049380.986793:0:5838:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:3.0:1789049380.986795:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.126@tcp lock: ffff8cb8d776f400/0xf4f48ce5e1bbecc0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xf4f48ce5e1bbecc7 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049380.986800:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cb8d776f400 already unused, calling callback (ffffffffc1ca3c20) 10000000:00010000:3.0:1789049380.986802:0:5838:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.126@tcp lock: ffff8cb8d776f400/0xf4f48ce5e1bbecc0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0xf4f48ce5e1bbecc7 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049380.986819:0:5838:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.126@tcp lock: ffff8cb8d776f400/0xf4f48ce5e1bbecc0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0xf4f48ce5e1bbecc7 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789049380.986825:0:5838:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.126@tcp lock: ffff8cb8d776f400/0xf4f48ce5e1bbecc0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0xf4f48ce5e1bbecc7 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789049380.986830:0:5838:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1789049380.986863:0:5838:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.126@tcp lock: ffff8cb8d776f400/0xf4f48ce5e1bbecc0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf4f48ce5e1bbecc7 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049380.986869:0:5838:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789049380.986875:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.126@tcp lock: ffff8cb8d776f400/0xf4f48ce5e1bbecc0 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf4f48ce5e1bbecc7 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049380.986880:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.126@tcp lock: ffff8cb8d776f400/0xf4f48ce5e1bbecc0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf4f48ce5e1bbecc7 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049380.986890:0:5838:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1789049380.986893:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.126@tcp lock: ffff8cb8c146dc00/0xf4f48ce5e1bbecb2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xf4f48ce5e1bbecb9 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789049380.987090:0:8465:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb8d0aaed80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8465:1875954110588416:0@lo:104: 00000100:00100000:2.0:1789049380.987101:0:8465:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb8d0aad880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8465:1875954110588544:0@lo:104: 00000100:00100000:2.0:1789049380.987108:0:8465:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb8d0aaf100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8465:1875954110588672:0@lo:104: 00000100:00100000:2.0:1789049380.987114:0:8465:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb8d0aae680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8465:1875954110588800:0@lo:104: 00000100:00100000:2.0:1789049380.987120:0:8465:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb8d0aafb80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8465:1875954110588928:0@lo:104: 00000100:00100000:2.0:1789049380.987126:0:8465:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb8d0aac380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8465:1875954110589056:0@lo:104: 00000100:00100000:2.0:1789049380.987141:0:8465:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb8d0aae300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8465:1875954110589184:0@lo:104: 00010000:00010000:3.0:1789049380.987230:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cb8c146dc00 already unused, calling callback (ffffffffc1ca3c20) 10000000:00010000:3.0:1789049380.987235:0:5838:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.126@tcp lock: ffff8cb8c146dc00/0xf4f48ce5e1bbecb2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xf4f48ce5e1bbecb9 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049380.987244:0:5838:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.126@tcp lock: ffff8cb8c146dc00/0xf4f48ce5e1bbecb2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xf4f48ce5e1bbecb9 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789049380.987249:0:5838:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.126@tcp lock: ffff8cb8c146dc00/0xf4f48ce5e1bbecb2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xf4f48ce5e1bbecb9 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789049380.987260:0:5838:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1789049380.987276:0:5838:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.126@tcp lock: ffff8cb8c146dc00/0xf4f48ce5e1bbecb2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf4f48ce5e1bbecb9 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049380.987282:0:5838:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789049380.987286:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.126@tcp lock: ffff8cb8c146dc00/0xf4f48ce5e1bbecb2 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf4f48ce5e1bbecb9 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049380.987291:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.126@tcp lock: ffff8cb8c146dc00/0xf4f48ce5e1bbecb2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf4f48ce5e1bbecb9 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049380.987301:0:5838:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1789049380.987304:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.126@tcp lock: ffff8cb7c4c38c00/0xf4f48ce5e1bbec88 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xf4f48ce5e1bbec8f expref: -99 pid: 7645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049380.987309:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cb7c4c38c00 already unused, calling callback (ffffffffc1ca3c20) 10000000:00010000:3.0:1789049380.987312:0:5838:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.126@tcp lock: ffff8cb7c4c38c00/0xf4f48ce5e1bbec88 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xf4f48ce5e1bbec8f expref: -99 pid: 7645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049380.987318:0:5838:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.126@tcp lock: ffff8cb7c4c38c00/0xf4f48ce5e1bbec88 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xf4f48ce5e1bbec8f expref: -99 pid: 7645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789049380.987324:0:5838:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.126@tcp lock: ffff8cb7c4c38c00/0xf4f48ce5e1bbec88 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xf4f48ce5e1bbec8f expref: -99 pid: 7645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789049380.987329:0:5838:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1789049380.987340:0:5838:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.126@tcp lock: ffff8cb7c4c38c00/0xf4f48ce5e1bbec88 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf4f48ce5e1bbec8f expref: -99 pid: 7645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049380.987345:0:5838:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789049380.987356:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.126@tcp lock: ffff8cb7c4c38c00/0xf4f48ce5e1bbec88 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf4f48ce5e1bbec8f expref: -99 pid: 7645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049380.987362:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.126@tcp lock: ffff8cb7c4c38c00/0xf4f48ce5e1bbec88 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf4f48ce5e1bbec8f expref: -99 pid: 7645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049380.987371:0:5838:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789049380.987374:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.126@tcp lock: ffff8cb8c146d200/0xf4f48ce5e1bbec5e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xf4f48ce5e1bbec65 expref: -99 pid: 7645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049380.987380:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cb8c146d200 already unused, calling callback (ffffffffc1ca3c20) 10000000:00010000:3.0:1789049380.987383:0:5838:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.126@tcp lock: ffff8cb8c146d200/0xf4f48ce5e1bbec5e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xf4f48ce5e1bbec65 expref: -99 pid: 7645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049380.987389:0:5838:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.126@tcp lock: ffff8cb8c146d200/0xf4f48ce5e1bbec5e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xf4f48ce5e1bbec65 expref: -99 pid: 7645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789049380.987394:0:5838:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.126@tcp lock: ffff8cb8c146d200/0xf4f48ce5e1bbec5e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xf4f48ce5e1bbec65 expref: -99 pid: 7645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789049380.987399:0:5838:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1789049380.987411:0:5838:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.126@tcp lock: ffff8cb8c146d200/0xf4f48ce5e1bbec5e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf4f48ce5e1bbec65 expref: -99 pid: 7645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049380.987416:0:5838:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789049380.987420:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.126@tcp lock: ffff8cb8c146d200/0xf4f48ce5e1bbec5e lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf4f48ce5e1bbec65 expref: -99 pid: 7645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049380.987426:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.126@tcp lock: ffff8cb8c146d200/0xf4f48ce5e1bbec5e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf4f48ce5e1bbec65 expref: -99 pid: 7645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049380.987438:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789049380.987445:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789049380.987447:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789049380.987455:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789049380.987461:0:6719:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789049380.987481:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb8fce95180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7ef694ec-1ea0-4f02-800c-d1279b4fdf12:3308:1875954110589312:0@lo:103: 00000100:00100000:3.0:1789049380.987601:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789049380.987645:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb8fce95f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7ef694ec-1ea0-4f02-800c-d1279b4fdf12:3308:1875954110589824:0@lo:103: 00000100:00100000:3.0:1789049380.987664:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789049380.987686:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1789049380.987692:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb8fce97800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7ef694ec-1ea0-4f02-800c-d1279b4fdf12:3308:1875954110589440:0@lo:103: 00000100:00100000:3.0:1789049380.987712:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789049380.987727:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb8fce95880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7ef694ec-1ea0-4f02-800c-d1279b4fdf12:3308:1875954110589952:0@lo:103: 00000100:00100000:3.0:1789049380.987742:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789049380.987768:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb8fce96d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:7ef694ec-1ea0-4f02-800c-d1279b4fdf12:3311:1875954110589696:0@lo:103: 00000100:00100000:3.0:1789049380.987799:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789049380.987813:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:3.0:1789049380.987819:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb8fce94000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:7ef694ec-1ea0-4f02-800c-d1279b4fdf12:3311:1875954110589568:0@lo:103: 00000100:00100000:3.0:1789049380.987839:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789049380.987874:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb8fce97100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:7ef694ec-1ea0-4f02-800c-d1279b4fdf12:3311:1875954110590080:0@lo:103: 00000100:00100000:3.0:1789049380.987897:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789049380.988569:0:6720:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954110589312 00000100:00100000:2.0:1789049380.988579:0:6720:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954110589312 00010000:00010000:2.0:1789049380.988611:0:6720:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8cb8d776f600/0xf4f48ce5e1bbed1b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf4f48ce5e1bbed14 expref: 19 pid: 5845 timeout: 357 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789049380.988631:0:6720:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954110589824 00000100:00100000:2.0:1789049380.988635:0:6720:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954110589824 00010000:00010000:2.0:1789049380.988648:0:6720:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8cb8c146c600/0xf4f48ce5e1bbecb9 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf4f48ce5e1bbecb2 expref: 20 pid: 5844 timeout: 357 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789049380.988659:0:6720:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954110589440 00000100:00100000:2.0:1789049380.988661:0:6720:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954110589440 00010000:00010000:2.0:1789049380.988671:0:6720:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8cb8d6715c00/0xf4f48ce5e1bbecf1 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf4f48ce5e1bbecea expref: 21 pid: 5845 timeout: 357 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789049380.988680:0:6720:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954110589952 00000100:00100000:2.0:1789049380.988683:0:6720:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954110589952 00010000:00010000:2.0:1789049380.988692:0:6720:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8cb8c146c200/0xf4f48ce5e1bbec8f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf4f48ce5e1bbec88 expref: 22 pid: 5845 timeout: 357 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789049380.988700:0:6720:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954110589696 00000100:00100000:2.0:1789049380.988702:0:6720:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954110589696 00010000:00010000:2.0:1789049380.988712:0:6720:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8cb7c4c39200/0xf4f48ce5e1bbecc7 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf4f48ce5e1bbecc0 expref: 23 pid: 5844 timeout: 357 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789049380.988721:0:6720:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954110589568 00000100:00100000:2.0:1789049380.988723:0:6720:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954110589568 00010000:00010000:2.0:1789049380.988733:0:6720:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8cb8d6714400/0xf4f48ce5e1bbecd5 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf4f48ce5e1bbecce expref: 24 pid: 5845 timeout: 357 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789049380.988741:0:6720:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954110590080 00000100:00100000:2.0:1789049380.988752:0:6720:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954110590080 00010000:00010000:2.0:1789049380.988766:0:6720:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8cb7c4c38e00/0xf4f48ce5e1bbec65 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf4f48ce5e1bbec5e expref: 25 pid: 5845 timeout: 357 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789049380.988781:0:6720:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1789049380.988789:0:6720:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8fce96680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7ef694ec-1ea0-4f02-800c-d1279b4fdf12+25:3308:x1875954110589312:12345-0@lo:103: 00010000:00010000:2.0:1789049380.988801:0:6720:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789049380.988805:0:6720:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8cb8d776f600/0xf4f48ce5e1bbed1b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf4f48ce5e1bbed14 expref: 25 pid: 5845 timeout: 357 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049380.988815:0:6720:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8cb8d776f600/0xf4f48ce5e1bbed1b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf4f48ce5e1bbed14 expref: 25 pid: 5845 timeout: 357 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049380.988829:0:6720:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cb8d776f600/0xf4f48ce5e1bbed1b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf4f48ce5e1bbed14 expref: 25 pid: 5845 timeout: 357 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049380.988863:0:6720:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789049380.992237:0:6720:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8fce96680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7ef694ec-1ea0-4f02-800c-d1279b4fdf12+24:3308:x1875954110589312:12345-0@lo:103: Request processed in 3439us (4627us total) trans 0 rc 0/0 00000100:00100000:2.0:1789049380.992250:0:6720:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1789049380.992287:0:6720:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1789049380.992299:0:6720:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8fce97b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7ef694ec-1ea0-4f02-800c-d1279b4fdf12+23:3308:x1875954110589824:12345-0@lo:103: 00010000:00010000:2.0:1789049380.992316:0:6720:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789049380.992325:0:6720:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8cb8c146c600/0xf4f48ce5e1bbecb9 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf4f48ce5e1bbecb2 expref: 23 pid: 5844 timeout: 357 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049380.992338:0:6720:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8cb8c146c600/0xf4f48ce5e1bbecb9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf4f48ce5e1bbecb2 expref: 23 pid: 5844 timeout: 357 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049380.992355:0:6720:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cb8c146c600/0xf4f48ce5e1bbecb9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf4f48ce5e1bbecb2 expref: 23 pid: 5844 timeout: 357 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049380.992384:0:6720:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789049380.992416:0:6720:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8fce97b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7ef694ec-1ea0-4f02-800c-d1279b4fdf12+22:3308:x1875954110589824:12345-0@lo:103: Request processed in 122us (4750us total) trans 0 rc 0/0 00000100:00100000:2.0:1789049380.992422:0:6720:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1789049380.992436:0:6720:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1789049380.992443:0:6720:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8fce94380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7ef694ec-1ea0-4f02-800c-d1279b4fdf12+21:3308:x1875954110589440:12345-0@lo:103: 00010000:00010000:2.0:1789049380.992450:0:6720:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789049380.992454:0:6720:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8cb8d6715c00/0xf4f48ce5e1bbecf1 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf4f48ce5e1bbecea expref: 21 pid: 5845 timeout: 357 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049380.992463:0:6720:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8cb8d6715c00/0xf4f48ce5e1bbecf1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf4f48ce5e1bbecea expref: 21 pid: 5845 timeout: 357 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049380.992474:0:6720:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cb8d6715c00/0xf4f48ce5e1bbecf1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf4f48ce5e1bbecea expref: 21 pid: 5845 timeout: 357 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049380.992482:0:6720:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789049380.992503:0:6720:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8fce94380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7ef694ec-1ea0-4f02-800c-d1279b4fdf12+20:3308:x1875954110589440:12345-0@lo:103: Request processed in 61us (4790us total) trans 0 rc 0/0 00000100:00100000:2.0:1789049380.992509:0:6720:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1789049380.992536:0:6720:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1789049380.992543:0:6720:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8fce96300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7ef694ec-1ea0-4f02-800c-d1279b4fdf12+19:3308:x1875954110589952:12345-0@lo:103: 00010000:00010000:2.0:1789049380.992550:0:6720:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789049380.992566:0:6720:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8cb8c146c200/0xf4f48ce5e1bbec8f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf4f48ce5e1bbec88 expref: 19 pid: 5845 timeout: 357 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049380.992575:0:6720:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8cb8c146c200/0xf4f48ce5e1bbec8f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf4f48ce5e1bbec88 expref: 19 pid: 5845 timeout: 357 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049380.992594:0:6720:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cb8c146c200/0xf4f48ce5e1bbec8f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf4f48ce5e1bbec88 expref: 19 pid: 5845 timeout: 357 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049380.992603:0:6720:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789049380.992626:0:6720:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8fce96300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7ef694ec-1ea0-4f02-800c-d1279b4fdf12+18:3308:x1875954110589952:12345-0@lo:103: Request processed in 84us (4882us total) trans 0 rc 0/0 00000100:00100000:2.0:1789049380.992632:0:6720:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1789049380.992645:0:6720:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1789049380.992651:0:6720:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8df284a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7ef694ec-1ea0-4f02-800c-d1279b4fdf12+17:3311:x1875954110589696:12345-0@lo:103: 00010000:00010000:2.0:1789049380.992659:0:6720:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789049380.992664:0:6720:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8cb7c4c39200/0xf4f48ce5e1bbecc7 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf4f48ce5e1bbecc0 expref: 17 pid: 5844 timeout: 357 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049380.992670:0:6720:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8cb7c4c39200/0xf4f48ce5e1bbecc7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf4f48ce5e1bbecc0 expref: 17 pid: 5844 timeout: 357 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049380.992679:0:6720:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cb7c4c39200/0xf4f48ce5e1bbecc7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf4f48ce5e1bbecc0 expref: 17 pid: 5844 timeout: 357 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049380.992686:0:6720:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789049380.992708:0:6720:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8df284a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7ef694ec-1ea0-4f02-800c-d1279b4fdf12+16:3311:x1875954110589696:12345-0@lo:103: Request processed in 57us (4908us total) trans 0 rc 0/0 00000100:00100000:2.0:1789049380.992714:0:6720:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1789049380.992727:0:6720:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1789049380.992733:0:6720:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8df284e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7ef694ec-1ea0-4f02-800c-d1279b4fdf12+15:3311:x1875954110589568:12345-0@lo:103: 00010000:00010000:2.0:1789049380.992739:0:6720:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789049380.992744:0:6720:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8cb8d6714400/0xf4f48ce5e1bbecd5 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf4f48ce5e1bbecce expref: 15 pid: 5845 timeout: 357 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049380.992756:0:6720:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8cb8d6714400/0xf4f48ce5e1bbecd5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf4f48ce5e1bbecce expref: 15 pid: 5845 timeout: 357 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049380.992766:0:6720:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cb8d6714400/0xf4f48ce5e1bbecd5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf4f48ce5e1bbecce expref: 15 pid: 5845 timeout: 357 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049380.992774:0:6720:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789049380.992797:0:6720:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8df284e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7ef694ec-1ea0-4f02-800c-d1279b4fdf12+14:3311:x1875954110589568:12345-0@lo:103: Request processed in 65us (4957us total) trans 0 rc 0/0 00000100:00100000:2.0:1789049380.992803:0:6720:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1789049380.992815:0:6720:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1789049380.992821:0:6720:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8c7ded450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7ef694ec-1ea0-4f02-800c-d1279b4fdf12+13:3311:x1875954110590080:12345-0@lo:103: 00010000:00010000:2.0:1789049380.992828:0:6720:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789049380.992831:0:6720:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8cb7c4c38e00/0xf4f48ce5e1bbec65 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf4f48ce5e1bbec5e expref: 13 pid: 5845 timeout: 357 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049380.992839:0:6720:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8cb7c4c38e00/0xf4f48ce5e1bbec65 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf4f48ce5e1bbec5e expref: 13 pid: 5845 timeout: 357 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049380.992876:0:6720:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cb7c4c38e00/0xf4f48ce5e1bbec65 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf4f48ce5e1bbec5e expref: 13 pid: 5845 timeout: 357 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049380.992884:0:6720:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789049380.993417:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb8fce97800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7ef694ec-1ea0-4f02-800c-d1279b4fdf12:3308:1875954110589440:0@lo:103: 00000100:00100000:1.0:1789049380.993428:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb8fce95880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7ef694ec-1ea0-4f02-800c-d1279b4fdf12:3308:1875954110589952:0@lo:103: 00000100:00100000:1.0:1789049380.993436:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb8fce95180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7ef694ec-1ea0-4f02-800c-d1279b4fdf12:3308:1875954110589312:0@lo:103: 00000100:00100000:1.0:1789049380.993444:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb8fce95f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7ef694ec-1ea0-4f02-800c-d1279b4fdf12:3308:1875954110589824:0@lo:103: 00000100:00100000:2.0:1789049380.993729:0:6720:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8c7ded450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7ef694ec-1ea0-4f02-800c-d1279b4fdf12+12:3311:x1875954110590080:12345-0@lo:103: Request processed in 906us (5829us total) trans 0 rc 0/0 00000100:00100000:2.0:1789049380.993737:0:6720:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1789049380.996000:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb8fce97100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:7ef694ec-1ea0-4f02-800c-d1279b4fdf12:3311:1875954110590080:0@lo:103: 00000100:00100000:3.0:1789049380.996015:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb8fce96d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:7ef694ec-1ea0-4f02-800c-d1279b4fdf12:3311:1875954110589696:0@lo:103: 00000100:00100000:3.0:1789049380.996050:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb8fce94000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:7ef694ec-1ea0-4f02-800c-d1279b4fdf12:3311:1875954110589568:0@lo:103: 00000100:00100000:0.0:1789049381.013505:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.26@tcp (source: 12345-192.168.206.26@tcp) 00000100:00100000:0.0:1789049381.013537:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.26@tcp (source: 12345-192.168.206.26@tcp) 00000100:00100000:1.0:1789049381.013607:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954089594880 00000100:00100000:1.0:1789049381.013615:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954089594880 00010000:00010000:1.0:1789049381.013652:0:5836:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8cb8d776f200/0xf4f48ce5e1bbed30 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a3241 expref: 10 pid: 5845 timeout: 307 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789049381.013689:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954089595008 00000100:00100000:1.0:1789049381.013693:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954089595008 00010000:00010000:1.0:1789049381.013721:0:5836:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8cb7c4c39e00/0xf4f48ce5e1bbed29 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a323a expref: 11 pid: 5843 timeout: 307 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789049381.013745:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.26@tcp, seq: 19 00000100:00100000:1.0:1789049381.013754:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8c633f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:de93d576-ed8d-4d27-ab00-9189a62cea33+11:2357:x1875954089594880:12345-192.168.206.26@tcp:103: 00010000:00010000:1.0:1789049381.013767:0:5836:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789049381.013772:0:5836:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8cb8d776f200/0xf4f48ce5e1bbed30 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a3241 expref: 11 pid: 5845 timeout: 307 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049381.013784:0:5836:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8cb8d776f200/0xf4f48ce5e1bbed30 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a3241 expref: 11 pid: 5845 timeout: 307 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049381.013801:0:5836:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789049381.013868:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8c633f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:de93d576-ed8d-4d27-ab00-9189a62cea33+11:2357:x1875954089594880:12345-192.168.206.26@tcp:103: Request processed in 115us (370us total) trans 0 rc 0/0 00000100:00100000:1.0:1789049381.013876:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.26@tcp, seq: 19 00000100:00100000:1.0:1789049381.013893:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.26@tcp, seq: 20 00000100:00100000:1.0:1789049381.013900:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8c633c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:de93d576-ed8d-4d27-ab00-9189a62cea33+10:2357:x1875954089595008:12345-192.168.206.26@tcp:103: 00010000:00010000:1.0:1789049381.013908:0:5836:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789049381.013913:0:5836:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8cb7c4c39e00/0xf4f48ce5e1bbed29 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a323a expref: 10 pid: 5843 timeout: 307 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049381.013922:0:5836:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8cb7c4c39e00/0xf4f48ce5e1bbed29 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a323a expref: 10 pid: 5843 timeout: 307 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049381.013935:0:5836:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8cb8d6715a00/0xf4f48ce5e1bbed68 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 8465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049381.013944:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cb8d6715a00/0xf4f48ce5e1bbed68 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 8465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049381.013967:0:5836:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8cb8d6715a00/0xf4f48ce5e1bbed68 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049381.013975:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8cb8d6715a00/0xf4f48ce5e1bbed68 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049381.013982:0:5836:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8cb8d6715a00/0xf4f48ce5e1bbed68 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049381.013990:0:5836:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8cb8d6715a00/0xf4f48ce5e1bbed68 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049381.013996:0:5836:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cb8d6715a00 already unused, calling callback (ffffffffc166a8f0) 00010000:00010000:1.0:1789049381.014001:0:5836:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8cb8d6715a00/0xf4f48ce5e1bbed68 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049381.014010:0:5836:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8cb8d6715a00/0xf4f48ce5e1bbed68 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 8465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049381.014019:0:5836:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8cb8d6715a00/0xf4f48ce5e1bbed68 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049381.014030:0:5836:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789049381.014051:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8c633c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:de93d576-ed8d-4d27-ab00-9189a62cea33+10:2357:x1875954089595008:12345-192.168.206.26@tcp:103: Request processed in 151us (513us total) trans 0 rc 0/0 00000100:00100000:1.0:1789049381.014057:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.26@tcp, seq: 20 00010000:00010000:3.0:1789049381.015089:0:8465:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cb8d776f200/0xf4f48ce5e1bbed30 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a3241 expref: 9 pid: 5845 timeout: 307 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789049381.015120:0:8465:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb8c59cad80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8465:1875954110588160:192.168.206.26@tcp:104: 00010000:00010000:3.0:1789049381.015136:0:8465:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cb7c4c39e00/0xf4f48ce5e1bbed29 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a323a expref: 8 pid: 5843 timeout: 307 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789049381.015145:0:8465:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb8c59cbb80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8465:1875954110588288:192.168.206.26@tcp:104: 00010000:00010000:3.0:1789049381.015188:0:8465:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8cb8d6715a00/0xf4f48ce5e1bbed68 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049381.015196:0:8465:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8cb8d6715a00/0xf4f48ce5e1bbed68 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049381.015201:0:8465:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8cb8d6715a00/0xf4f48ce5e1bbed68 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049381.015206:0:8465:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cb8d6715a00/0xf4f48ce5e1bbed68 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789049381.176111:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.26@tcp (source: 12345-192.168.206.26@tcp) 00000100:00100000:3.0:1789049381.177438:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954089595136 00000100:00100000:3.0:1789049381.177448:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954089595136 00000100:00100000:3.0:1789049381.177506:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.26@tcp, seq: 130 00000100:00100000:3.0:1789049381.177516:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8c6b80050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:de93d576-ed8d-4d27-ab00-9189a62cea33+8:5598:x1875954089595136:12345-192.168.206.26@tcp:101: 00010000:00010000:3.0:1789049381.177532:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789049381.178066:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cb8d776f200/0xf4f48ce5e1bbed6f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x7fc5e358805a32a3 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049381.178101:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cb8d776f200/0xf4f48ce5e1bbed6f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a32a3 expref: 9 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049381.178420:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cb8d776f200/0xf4f48ce5e1bbed6f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a32a3 expref: 9 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049381.178429:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cb8d776f200, rc 0) 00000100:00100000:3.0:1789049381.178495:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8c6b80050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:de93d576-ed8d-4d27-ab00-9189a62cea33+9:5598:x1875954089595136:12345-192.168.206.26@tcp:101: Request processed in 979us (2392us total) trans 0 rc 0/0 00000100:00100000:3.0:1789049381.178502:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.26@tcp, seq: 130 00000100:00100000:3.0:1789049381.184421:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.26@tcp (source: 12345-192.168.206.26@tcp) 00000100:00100000:0.0:1789049381.184499:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954089595264 00000100:00100000:0.0:1789049381.184508:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954089595264 00000100:00100000:0.0:1789049381.184594:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.26@tcp, seq: 131 00000100:00100000:0.0:1789049381.184604:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8c6b80c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:de93d576-ed8d-4d27-ab00-9189a62cea33+9:5598:x1875954089595264:12345-192.168.206.26@tcp:501: 00000100:00100000:0.0:1789049381.184928:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8c6b80c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:de93d576-ed8d-4d27-ab00-9189a62cea33+9:5598:x1875954089595264:12345-192.168.206.26@tcp:501: Request processed in 324us (514us total) trans 0 rc 0/0 00000100:00100000:0.0:1789049381.184935:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.26@tcp, seq: 131 00000100:00100000:0.0:1789049381.195496:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.26@tcp (source: 12345-192.168.206.26@tcp) 00000100:00100000:3.0:1789049381.196068:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954089595392 00000100:00100000:3.0:1789049381.196080:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954089595392 00000100:00100000:3.0:1789049381.196149:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.26@tcp, seq: 132 00000100:00100000:3.0:1789049381.196159:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8c6b82450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:de93d576-ed8d-4d27-ab00-9189a62cea33+9:5598:x1875954089595392:12345-192.168.206.26@tcp:503: 00000100:00100000:3.0:1789049381.196525:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8c6b82450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:de93d576-ed8d-4d27-ab00-9189a62cea33+9:5598:x1875954089595392:12345-192.168.206.26@tcp:503: Request processed in 365us (1033us total) trans 0 rc 0/0 00000100:00100000:3.0:1789049381.196534:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.26@tcp, seq: 132 00000100:00100000:1.0:1789049381.217826:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.26@tcp (source: 12345-192.168.206.26@tcp) 00000100:00100000:3.0:1789049381.218099:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954089595520 00000100:00100000:3.0:1789049381.218110:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954089595520 00000100:00100000:3.0:1789049381.218182:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.26@tcp, seq: 133 00000100:00100000:3.0:1789049381.218192:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8c624b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:de93d576-ed8d-4d27-ab00-9189a62cea33+9:6064:x1875954089595520:12345-192.168.206.26@tcp:502: 00000100:00100000:3.0:1789049381.218614:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8c624b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:de93d576-ed8d-4d27-ab00-9189a62cea33+9:6064:x1875954089595520:12345-192.168.206.26@tcp:502: Request processed in 422us (795us total) trans 0 rc 0/0 00000100:00100000:3.0:1789049381.218623:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.26@tcp, seq: 133 00000100:00100000:3.0:1789049381.220996:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.26@tcp (source: 12345-192.168.206.26@tcp) 00000100:00100000:3.0:1789049381.221044:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954089595648 00000100:00100000:3.0:1789049381.221056:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954089595648 00000100:00100000:3.0:1789049381.221120:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.26@tcp, seq: 134 00000100:00100000:3.0:1789049381.221130:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8c6248050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:de93d576-ed8d-4d27-ab00-9189a62cea33+9:6064:x1875954089595648:12345-192.168.206.26@tcp:502:llog_process_th.0 00000100:00100000:3.0:1789049381.221355:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8c6248050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:de93d576-ed8d-4d27-ab00-9189a62cea33+9:6064:x1875954089595648:12345-192.168.206.26@tcp:502:llog_process_th.0 Request processed in 225us (390us total) trans 0 rc 0/0 00000100:00100000:3.0:1789049381.221364:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.26@tcp, seq: 134 00000100:00100000:3.0:1789049381.227564:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.26@tcp (source: 12345-192.168.206.26@tcp) 00000100:00100000:3.0:1789049381.227602:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954089595776 00000100:00100000:3.0:1789049381.227611:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954089595776 00000100:00100000:3.0:1789049381.227662:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.26@tcp, seq: 135 00000100:00100000:3.0:1789049381.227671:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8c6248c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:de93d576-ed8d-4d27-ab00-9189a62cea33+9:5598:x1875954089595776:12345-192.168.206.26@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789049381.227686:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789049381.227702:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cb8d776f400/0xf4f48ce5e1bbed76 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x7fc5e358805a32aa expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049381.227728:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cb8d776f400/0xf4f48ce5e1bbed76 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a32aa expref: 10 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049381.227739:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cb8d776f400/0xf4f48ce5e1bbed76 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a32aa expref: 10 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049381.227748:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cb8d776f400, rc 0) 00000100:00100000:3.0:1789049381.227793:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8c6248c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:de93d576-ed8d-4d27-ab00-9189a62cea33+10:5598:x1875954089595776:12345-192.168.206.26@tcp:101:ll_cfg_requeue.0 Request processed in 123us (248us total) trans 0 rc 0/0 00000100:00100000:3.0:1789049381.227799:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.26@tcp, seq: 135 00000100:00100000:1.0:1789049381.232803:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.26@tcp (source: 12345-192.168.206.26@tcp) 00000100:00100000:3.0:1789049381.232943:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954089595904 00000100:00100000:3.0:1789049381.232954:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954089595904 00000100:00100000:3.0:1789049381.233011:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.26@tcp, seq: 136 00000100:00100000:3.0:1789049381.233132:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8c624a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:de93d576-ed8d-4d27-ab00-9189a62cea33+10:5598:x1875954089595904:12345-192.168.206.26@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789049381.233466:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8c624a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:de93d576-ed8d-4d27-ab00-9189a62cea33+10:5598:x1875954089595904:12345-192.168.206.26@tcp:501:ll_cfg_requeue.0 Request processed in 445us (671us total) trans 0 rc -2/-2 00000100:00100000:3.0:1789049381.233476:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.26@tcp, seq: 136 00010000:00010000:3.0:1789049381.595001:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1789049382.171115:0:5848:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1789049382.171123:0:5848:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8cb8c631b800 from 39 10000000:01000000:3.0:1789049382.171129:0:5848:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1789049382.171178:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.126@tcp lock: ffff8cb8d776fc00/0xf4f48ce5e1bbed7d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049382.171190:0:5848:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.126@tcp lock: ffff8cb8d776fc00/0xf4f48ce5e1bbed7d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049382.171201:0:5848:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.126@tcp lock: ffff8cb8d776fc00/0xf4f48ce5e1bbed7d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789049382.171223:0:5848:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb8df284700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7ef694ec-1ea0-4f02-800c-d1279b4fdf12:5848:1875954110590208:0@lo:101: 00000100:00100000:3.0:1789049382.171302:0:5848:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789049382.171371:0:5848:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cb900e24d80 going to sleep for 11 seconds 00000100:00100000:1.0:1789049382.172490:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954110590208 00000100:00100000:1.0:1789049382.172501:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954110590208 00000100:00100000:1.0:1789049382.172585:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:1.0:1789049382.172594:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8c624b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7ef694ec-1ea0-4f02-800c-d1279b4fdf12+12:5848:x1875954110590208:12345-0@lo:101: 00010000:00010000:1.0:1789049382.172609:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789049382.172623:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cb8c146d400/0xf4f48ce5e1bbed84 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xf4f48ce5e1bbed7d expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049382.172649:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cb8c146d400/0xf4f48ce5e1bbed84 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf4f48ce5e1bbed7d expref: 13 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049382.172659:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cb8c146d400/0xf4f48ce5e1bbed84 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf4f48ce5e1bbed7d expref: 13 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049382.172669:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cb8c146d400, rc 0) 00000100:00100000:1.0:1789049382.172738:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8c624b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7ef694ec-1ea0-4f02-800c-d1279b4fdf12+13:5848:x1875954110590208:12345-0@lo:101: Request processed in 145us (1448us total) trans 0 rc 0/0 00000100:00100000:1.0:1789049382.172745:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00100000:0.0:1789049382.172887:0:5848:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb8df284700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7ef694ec-1ea0-4f02-800c-d1279b4fdf12:5848:1875954110590208:0@lo:101: 00010000:00010000:0.0:1789049382.172915:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.126@tcp lock: ffff8cb8d776fc00/0xf4f48ce5e1bbed7d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf4f48ce5e1bbed84 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049382.172924:0:5848:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.126@tcp lock: ffff8cb8d776fc00/0xf4f48ce5e1bbed7d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xf4f48ce5e1bbed84 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789049382.173002:0:5848:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb8c633ed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7ef694ec-1ea0-4f02-800c-d1279b4fdf12:5848:1875954110590336:0@lo:501: 00000100:00100000:0.0:1789049382.173034:0:5848:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789049382.173068:0:5848:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cb8c79f89c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789049382.173188:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954110590336 00000100:00100000:2.0:1789049382.173193:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954110590336 00000100:00100000:2.0:1789049382.173233:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:2.0:1789049382.173240:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8c624bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7ef694ec-1ea0-4f02-800c-d1279b4fdf12+13:5848:x1875954110590336:12345-0@lo:501: 00000100:00100000:2.0:1789049382.173481:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8c624bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7ef694ec-1ea0-4f02-800c-d1279b4fdf12+13:5848:x1875954110590336:12345-0@lo:501: Request processed in 240us (445us total) trans 0 rc 0/0 00000100:00100000:2.0:1789049382.173487:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00100000:0.0:1789049382.174424:0:5848:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb8c633ed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7ef694ec-1ea0-4f02-800c-d1279b4fdf12:5848:1875954110590336:0@lo:501: 00000100:00100000:0.0:1789049382.174475:0:5848:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb8c633ed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7ef694ec-1ea0-4f02-800c-d1279b4fdf12:5848:1875954110590464:0@lo:503: 00000100:00100000:0.0:1789049382.174529:0:5848:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789049382.174655:0:5848:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cb8c79f89c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789049382.175493:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954110590464 00000100:00100000:2.0:1789049382.175502:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954110590464 00000100:00100000:2.0:1789049382.175567:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:2.0:1789049382.175576:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8c6249850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7ef694ec-1ea0-4f02-800c-d1279b4fdf12+13:5848:x1875954110590464:12345-0@lo:503: 00000100:00100000:2.0:1789049382.175779:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8c6249850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7ef694ec-1ea0-4f02-800c-d1279b4fdf12+13:5848:x1875954110590464:12345-0@lo:503: Request processed in 203us (1248us total) trans 0 rc 0/0 00000100:00100000:2.0:1789049382.175786:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00100000:0.0:1789049382.175922:0:5848:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb8c633ed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7ef694ec-1ea0-4f02-800c-d1279b4fdf12:5848:1875954110590464:0@lo:503: 00000100:00100000:0.0:1789049382.176109:0:8484:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb8c633ed80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7ef694ec-1ea0-4f02-800c-d1279b4fdf12:8484:1875954110590592:0@lo:502: 00000100:00100000:0.0:1789049382.176150:0:8484:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789049382.176169:0:8484:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cb8c79f8180 going to sleep for 11 seconds 00000100:00100000:2.0:1789049382.176298:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954110590592 00000100:00100000:2.0:1789049382.176303:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954110590592 00000100:00100000:2.0:1789049382.176321:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:2.0:1789049382.176327:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8c6249050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7ef694ec-1ea0-4f02-800c-d1279b4fdf12+13:8484:x1875954110590592:12345-0@lo:502: 00000100:00100000:2.0:1789049382.176570:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8c6249050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7ef694ec-1ea0-4f02-800c-d1279b4fdf12+13:8484:x1875954110590592:12345-0@lo:502: Request processed in 241us (419us total) trans 0 rc 0/0 00000100:00100000:2.0:1789049382.176576:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:0.0:1789049382.177732:0:8484:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb8c633ed80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7ef694ec-1ea0-4f02-800c-d1279b4fdf12:8484:1875954110590592:0@lo:502: 00000100:00100000:0.0:1789049382.177794:0:8484:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb8c633ed80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7ef694ec-1ea0-4f02-800c-d1279b4fdf12:8484:1875954110590720:0@lo:502: 00000100:00100000:0.0:1789049382.177880:0:8484:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789049382.177925:0:8484:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cb8c79f8180 going to sleep for 11 seconds 00000100:00100000:3.0:1789049382.178087:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954110590720 00000100:00100000:3.0:1789049382.178093:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954110590720 00000100:00100000:3.0:1789049382.178138:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:3.0:1789049382.178146:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8c624b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7ef694ec-1ea0-4f02-800c-d1279b4fdf12+13:8484:x1875954110590720:12345-0@lo:502: 00000100:00100000:3.0:1789049382.178349:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8c624b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7ef694ec-1ea0-4f02-800c-d1279b4fdf12+13:8484:x1875954110590720:12345-0@lo:502: Request processed in 203us (468us total) trans 0 rc 0/0 00000100:00100000:3.0:1789049382.178428:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:0.0:1789049382.179887:0:8484:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb8c633ed80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7ef694ec-1ea0-4f02-800c-d1279b4fdf12:8484:1875954110590720:0@lo:502: 00000040:00080000:0.0:1789049382.179940:0:8484:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:2.0:1789049382.180156:0:5848:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-41 (rc=0) 10000000:01000000:2.0:1789049382.180174:0:5848:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.126@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1789049382.180184:0:5848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.126@tcp lock: ffff8cb8d776fc00/0xf4f48ce5e1bbed7d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf4f48ce5e1bbed84 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049382.180195:0:5848:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.126@tcp lock: ffff8cb8d776fc00/0xf4f48ce5e1bbed7d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf4f48ce5e1bbed84 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789049382.180205:0:5848:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0001 10000000:01000000:2.0:1789049382.180221:0:5848:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 8 10000000:01000000:2.0:1789049382.180223:0:5848:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:2.0:1789049382.180255:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.126@tcp lock: ffff8cb8d6715400/0xf4f48ce5e1bbed8b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049382.180263:0:5848:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.126@tcp lock: ffff8cb8d6715400/0xf4f48ce5e1bbed8b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049382.180273:0:5848:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.126@tcp lock: ffff8cb8d6715400/0xf4f48ce5e1bbed8b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789049382.180290:0:5848:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb8d0aaea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7ef694ec-1ea0-4f02-800c-d1279b4fdf12:5848:1875954110590848:0@lo:101: 00000100:00100000:2.0:1789049382.180339:0:5848:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789049382.180387:0:5848:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cb8d0a61f00 going to sleep for 11 seconds 00000100:00100000:3.0:1789049382.180775:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954110590848 00000100:00100000:3.0:1789049382.180782:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954110590848 00000100:00100000:3.0:1789049382.180874:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:3.0:1789049382.180884:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8c6248850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7ef694ec-1ea0-4f02-800c-d1279b4fdf12+13:5848:x1875954110590848:12345-0@lo:101: 00010000:00010000:3.0:1789049382.180906:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789049382.180919:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cb8d776f000/0xf4f48ce5e1bbed92 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xf4f48ce5e1bbed8b expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049382.180941:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cb8d776f000/0xf4f48ce5e1bbed92 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf4f48ce5e1bbed8b expref: 14 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049382.180956:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cb8d776f000/0xf4f48ce5e1bbed92 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf4f48ce5e1bbed8b expref: 14 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049382.180964:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cb8d776f000, rc 0) 00000100:00100000:3.0:1789049382.181000:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8c6248850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7ef694ec-1ea0-4f02-800c-d1279b4fdf12+14:5848:x1875954110590848:12345-0@lo:101: Request processed in 118us (661us total) trans 0 rc 0/0 00000100:00100000:3.0:1789049382.181006:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00100000:2.0:1789049382.181138:0:5848:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb8d0aaea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7ef694ec-1ea0-4f02-800c-d1279b4fdf12:5848:1875954110590848:0@lo:101: 00010000:00010000:2.0:1789049382.181151:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.126@tcp lock: ffff8cb8d6715400/0xf4f48ce5e1bbed8b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf4f48ce5e1bbed92 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049382.181160:0:5848:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.126@tcp lock: ffff8cb8d6715400/0xf4f48ce5e1bbed8b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xf4f48ce5e1bbed92 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789049382.181208:0:5848:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb8d0aaea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7ef694ec-1ea0-4f02-800c-d1279b4fdf12:5848:1875954110590976:0@lo:501: 00000100:00100000:2.0:1789049382.181235:0:5848:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789049382.181263:0:5848:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cb8d0a61f00 going to sleep for 11 seconds 00000100:00100000:3.0:1789049382.181380:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954110590976 00000100:00100000:3.0:1789049382.181385:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954110590976 00000100:00100000:3.0:1789049382.181415:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:3.0:1789049382.181422:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8c6249c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7ef694ec-1ea0-4f02-800c-d1279b4fdf12+14:5848:x1875954110590976:12345-0@lo:501: 00000100:00100000:3.0:1789049382.181689:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8c6249c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7ef694ec-1ea0-4f02-800c-d1279b4fdf12+14:5848:x1875954110590976:12345-0@lo:501: Request processed in 267us (453us total) trans 0 rc 0/0 00000100:00100000:3.0:1789049382.181696:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:2.0:1789049382.181868:0:5848:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb8d0aaea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7ef694ec-1ea0-4f02-800c-d1279b4fdf12:5848:1875954110590976:0@lo:501: 00000100:00100000:2.0:1789049382.181908:0:5848:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb8d0aaea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7ef694ec-1ea0-4f02-800c-d1279b4fdf12:5848:1875954110591104:0@lo:503: 00000100:00100000:2.0:1789049382.181947:0:5848:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789049382.181978:0:5848:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cb8d0a61f00 going to sleep for 11 seconds 00000100:00100000:0.0:1789049382.181989:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954110591104 00000100:00100000:0.0:1789049382.181994:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954110591104 00000100:00100000:0.0:1789049382.182019:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:0.0:1789049382.182025:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8c624ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7ef694ec-1ea0-4f02-800c-d1279b4fdf12+14:5848:x1875954110591104:12345-0@lo:503: 00000100:00100000:0.0:1789049382.182184:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8c624ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7ef694ec-1ea0-4f02-800c-d1279b4fdf12+14:5848:x1875954110591104:12345-0@lo:503: Request processed in 159us (237us total) trans 0 rc 0/0 00000100:00100000:0.0:1789049382.182199:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:2.0:1789049382.182352:0:5848:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb8d0aaea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7ef694ec-1ea0-4f02-800c-d1279b4fdf12:5848:1875954110591104:0@lo:503: 00000100:00100000:1.0:1789049382.182705:0:8485:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb8d0ab5500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7ef694ec-1ea0-4f02-800c-d1279b4fdf12:8485:1875954110591232:0@lo:502: 00000100:00100000:1.0:1789049382.182737:0:8485:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789049382.182758:0:8485:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cb8c79e0540 going to sleep for 11 seconds 00000100:00100000:2.0:1789049382.182810:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954110591232 00000100:00100000:2.0:1789049382.182814:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954110591232 00000100:00100000:2.0:1789049382.183027:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:2.0:1789049382.183034:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8c6248450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7ef694ec-1ea0-4f02-800c-d1279b4fdf12+14:8485:x1875954110591232:12345-0@lo:502: 00000100:00100000:2.0:1789049382.183172:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8c6248450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7ef694ec-1ea0-4f02-800c-d1279b4fdf12+14:8485:x1875954110591232:12345-0@lo:502: Request processed in 139us (434us total) trans 0 rc 0/0 00000100:00100000:2.0:1789049382.183179:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:1.0:1789049382.183245:0:8485:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb8d0ab5500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7ef694ec-1ea0-4f02-800c-d1279b4fdf12:8485:1875954110591232:0@lo:502: 00000020:01000000:1.0:1789049382.183269:0:8485:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789049382.183277:0:8485:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789049382.183279:0:8485:0:(obd_config.c:1563:class_process_config()) marker 26 (0x1) lustre sys.jobid_var 00000020:00000080:1.0:1789049382.183284:0:8485:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:1.0:1789049382.183306:0:8485:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb8d0ab5500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7ef694ec-1ea0-4f02-800c-d1279b4fdf12:8485:1875954110591360:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789049382.183339:0:8485:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789049382.191599:0:8485:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cb8c79e0540 going to sleep for 11 seconds 00000100:00100000:0.0:1789049382.192002:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954110591360 00000100:00100000:0.0:1789049382.192013:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954110591360 00000100:00100000:0.0:1789049382.192064:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:0.0:1789049382.192074:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8c6249450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7ef694ec-1ea0-4f02-800c-d1279b4fdf12+14:8485:x1875954110591360:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789049382.192334:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8c6249450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7ef694ec-1ea0-4f02-800c-d1279b4fdf12+14:8485:x1875954110591360:12345-0@lo:502:llog_process_th.0 Request processed in 260us (8993us total) trans 0 rc 0/0 00000100:00100000:0.0:1789049382.192342:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:1.0:1789049382.192519:0:8485:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb8d0ab5500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7ef694ec-1ea0-4f02-800c-d1279b4fdf12:8485:1875954110591360:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1789049382.192577:0:8485:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789049382.192585:0:8485:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789049382.192587:0:8485:0:(obd_config.c:1563:class_process_config()) marker 26 (0x2) lustre sys.jobid_var 00000040:00080000:1.0:1789049382.192592:0:8485:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 11 count 11 00000020:01000000:0.0:1789049382.192797:0:5848:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 8-10 (rc=0) 10000000:01000000:0.0:1789049382.192824:0:5848:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.126@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:0.0:1789049382.192833:0:5848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.126@tcp lock: ffff8cb8d6715400/0xf4f48ce5e1bbed8b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf4f48ce5e1bbed92 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049382.192875:0:5848:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.126@tcp lock: ffff8cb8d6715400/0xf4f48ce5e1bbed8b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf4f48ce5e1bbed92 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789049382.192886:0:5848:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1789049382.192889:0:5848:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8cb8d1c83000 from 39 10000000:01000000:0.0:1789049382.192892:0:5848:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1789049382.192931:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.126@tcp lock: ffff8cb7c4c39c00/0xf4f48ce5e1bbed99 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049382.192940:0:5848:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.126@tcp lock: ffff8cb7c4c39c00/0xf4f48ce5e1bbed99 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049382.192950:0:5848:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.126@tcp lock: ffff8cb7c4c39c00/0xf4f48ce5e1bbed99 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789049382.192971:0:5848:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb8c633ed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7ef694ec-1ea0-4f02-800c-d1279b4fdf12:5848:1875954110591488:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1789049382.193031:0:5848:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789049382.193056:0:5848:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cb8c79f80c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789049382.193363:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954110591488 00000100:00100000:1.0:1789049382.193369:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954110591488 00000100:00100000:1.0:1789049382.193396:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:1.0:1789049382.193403:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8c624a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7ef694ec-1ea0-4f02-800c-d1279b4fdf12+14:5848:x1875954110591488:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789049382.193413:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789049382.193424:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cb8c146d600/0xf4f48ce5e1bbeda0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xf4f48ce5e1bbed99 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049382.193445:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cb8c146d600/0xf4f48ce5e1bbeda0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf4f48ce5e1bbed99 expref: 15 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049382.193455:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cb8c146d600/0xf4f48ce5e1bbeda0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf4f48ce5e1bbed99 expref: 15 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049382.193464:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cb8c146d600, rc 0) 00000100:00100000:1.0:1789049382.193504:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8c624a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7ef694ec-1ea0-4f02-800c-d1279b4fdf12+15:5848:x1875954110591488:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 101us (474us total) trans 0 rc 0/0 00000100:00100000:1.0:1789049382.193511:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:0.0:1789049382.196295:0:5848:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb8c633ed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7ef694ec-1ea0-4f02-800c-d1279b4fdf12:5848:1875954110591488:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789049382.196322:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.126@tcp lock: ffff8cb7c4c39c00/0xf4f48ce5e1bbed99 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf4f48ce5e1bbeda0 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049382.196334:0:5848:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.126@tcp lock: ffff8cb7c4c39c00/0xf4f48ce5e1bbed99 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xf4f48ce5e1bbeda0 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789049382.196425:0:5848:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb8c633ed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7ef694ec-1ea0-4f02-800c-d1279b4fdf12:5848:1875954110591616:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789049382.196482:0:5848:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789049382.196526:0:5848:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cb8c79f80c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789049382.196673:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954110591616 00000100:00100000:1.0:1789049382.196680:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954110591616 00000100:00100000:1.0:1789049382.196716:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:1.0:1789049382.196724:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8c624a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7ef694ec-1ea0-4f02-800c-d1279b4fdf12+15:5848:x1875954110591616:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789049382.197009:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8c624a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7ef694ec-1ea0-4f02-800c-d1279b4fdf12+15:5848:x1875954110591616:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 285us (526us total) trans 0 rc 0/0 00000100:00100000:1.0:1789049382.197027:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:0.0:1789049382.197211:0:5848:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb8c633ed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7ef694ec-1ea0-4f02-800c-d1279b4fdf12:5848:1875954110591616:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789049382.197244:0:5848:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb8c633ed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7ef694ec-1ea0-4f02-800c-d1279b4fdf12:5848:1875954110591744:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789049382.197281:0:5848:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789049382.197310:0:5848:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cb8c79f80c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789049382.197385:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954110591744 00000100:00100000:2.0:1789049382.197390:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954110591744 00000100:00100000:2.0:1789049382.197414:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:2.0:1789049382.197421:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8c6297050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7ef694ec-1ea0-4f02-800c-d1279b4fdf12+15:5848:x1875954110591744:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789049382.197681:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8c6297050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7ef694ec-1ea0-4f02-800c-d1279b4fdf12+15:5848:x1875954110591744:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 260us (399us total) trans 0 rc 0/0 00000100:00100000:2.0:1789049382.197688:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:0.0:1789049382.197877:0:5848:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb8c633ed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7ef694ec-1ea0-4f02-800c-d1279b4fdf12:5848:1875954110591744:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789049382.198329:0:8486:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb8c633ed80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7ef694ec-1ea0-4f02-800c-d1279b4fdf12:8486:1875954110591872:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789049382.198440:0:8486:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789049382.198469:0:8486:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cb8c79f8cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1789049382.198513:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954110591872 00000100:00100000:2.0:1789049382.198519:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954110591872 00000100:00100000:2.0:1789049382.198543:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:2.0:1789049382.198626:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8c6294050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7ef694ec-1ea0-4f02-800c-d1279b4fdf12+15:8486:x1875954110591872:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789049382.198974:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8c6294050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7ef694ec-1ea0-4f02-800c-d1279b4fdf12+15:8486:x1875954110591872:12345-0@lo:502:llog_process_th.0 Request processed in 184us (366us total) trans 0 rc 0/0 00000100:00100000:2.0:1789049382.198983:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:0.0:1789049382.199784:0:8486:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb8c633ed80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7ef694ec-1ea0-4f02-800c-d1279b4fdf12:8486:1875954110591872:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789049382.200759:0:8486:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb8c633ed80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7ef694ec-1ea0-4f02-800c-d1279b4fdf12:8486:1875954110592000:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789049382.200838:0:8486:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789049382.201028:0:8486:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cb8c79f89c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789049382.201159:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954110592000 00000100:00100000:2.0:1789049382.201167:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954110592000 00000100:00100000:2.0:1789049382.201206:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:2.0:1789049382.201214:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8c6294c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7ef694ec-1ea0-4f02-800c-d1279b4fdf12+15:8486:x1875954110592000:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789049382.201453:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8c6294c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7ef694ec-1ea0-4f02-800c-d1279b4fdf12+15:8486:x1875954110592000:12345-0@lo:502:llog_process_th.0 Request processed in 238us (614us total) trans 0 rc 0/0 00000100:00100000:2.0:1789049382.201461:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:0.0:1789049382.201709:0:8486:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb8c633ed80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7ef694ec-1ea0-4f02-800c-d1279b4fdf12:8486:1875954110592000:0@lo:502:llog_process_th.0 00000040:00080000:0.0:1789049382.201734:0:8486:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:2.0:1789049382.202023:0:5848:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-41 (rc=0) 10000000:01000000:2.0:1789049382.202040:0:5848:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.126@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1789049382.202049:0:5848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.126@tcp lock: ffff8cb7c4c39c00/0xf4f48ce5e1bbed99 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf4f48ce5e1bbeda0 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049382.202059:0:5848:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.126@tcp lock: ffff8cb7c4c39c00/0xf4f48ce5e1bbed99 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf4f48ce5e1bbeda0 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789049382.202068:0:5848:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:2.0:1789049382.202071:0:5848:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 11 10000000:01000000:2.0:1789049382.202073:0:5848:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:2.0:1789049382.202099:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.126@tcp lock: ffff8cb8d6714600/0xf4f48ce5e1bbeda7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049382.202107:0:5848:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.126@tcp lock: ffff8cb8d6714600/0xf4f48ce5e1bbeda7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049382.202115:0:5848:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.126@tcp lock: ffff8cb8d6714600/0xf4f48ce5e1bbeda7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789049382.202130:0:5848:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb8d0aaea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7ef694ec-1ea0-4f02-800c-d1279b4fdf12:5848:1875954110592128:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1789049382.202164:0:5848:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789049382.202194:0:5848:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cb8d0a61180 going to sleep for 11 seconds 00000100:00100000:3.0:1789049382.202253:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954110592128 00000100:00100000:3.0:1789049382.202258:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954110592128 00000100:00100000:3.0:1789049382.202330:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:3.0:1789049382.202339:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8c6296450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7ef694ec-1ea0-4f02-800c-d1279b4fdf12+15:5848:x1875954110592128:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789049382.202348:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789049382.202376:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cb8d776f600/0xf4f48ce5e1bbedae lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xf4f48ce5e1bbeda7 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049382.202396:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cb8d776f600/0xf4f48ce5e1bbedae lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf4f48ce5e1bbeda7 expref: 16 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049382.202406:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cb8d776f600/0xf4f48ce5e1bbedae lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf4f48ce5e1bbeda7 expref: 16 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049382.202414:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cb8d776f600, rc 0) 00000100:00100000:3.0:1789049382.202452:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8c6296450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7ef694ec-1ea0-4f02-800c-d1279b4fdf12+16:5848:x1875954110592128:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 115us (288us total) trans 0 rc 0/0 00000100:00100000:3.0:1789049382.202458:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:0.0:1789049382.202509:0:5848:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb8d0aaea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7ef694ec-1ea0-4f02-800c-d1279b4fdf12:5848:1875954110592128:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789049382.202521:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.126@tcp lock: ffff8cb8d6714600/0xf4f48ce5e1bbeda7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xf4f48ce5e1bbedae expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049382.202530:0:5848:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.126@tcp lock: ffff8cb8d6714600/0xf4f48ce5e1bbeda7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xf4f48ce5e1bbedae expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789049382.202586:0:5848:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb8c633ed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7ef694ec-1ea0-4f02-800c-d1279b4fdf12:5848:1875954110592256:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789049382.202610:0:5848:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789049382.207582:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954110592256 00000100:00100000:1.0:1789049382.207596:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954110592256 00000100:00100000:1.0:1789049382.207655:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:1.0:1789049382.207665:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8c6297450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7ef694ec-1ea0-4f02-800c-d1279b4fdf12+16:5848:x1875954110592256:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789049382.207985:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8c6297450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7ef694ec-1ea0-4f02-800c-d1279b4fdf12+16:5848:x1875954110592256:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 321us (5373us total) trans 0 rc 0/0 00000100:00100000:1.0:1789049382.207993:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:0.0:1789049382.212632:0:5848:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cb8c79f89c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789049382.212669:0:5848:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb8c633ed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7ef694ec-1ea0-4f02-800c-d1279b4fdf12:5848:1875954110592256:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789049382.212727:0:5848:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb8c633ed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7ef694ec-1ea0-4f02-800c-d1279b4fdf12:5848:1875954110592384:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789049382.212802:0:5848:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789049382.213508:0:5848:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cb8c79f89c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789049382.217994:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954110592384 00000100:00100000:1.0:1789049382.218010:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954110592384 00000100:00100000:1.0:1789049382.218095:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:1.0:1789049382.218106:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8c6297c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7ef694ec-1ea0-4f02-800c-d1279b4fdf12+16:5848:x1875954110592384:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789049382.219086:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8c6297c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7ef694ec-1ea0-4f02-800c-d1279b4fdf12+16:5848:x1875954110592384:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 977us (6278us total) trans 0 rc 0/0 00000100:00100000:1.0:1789049382.219097:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:2.0:1789049382.221034:0:5848:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb8c633ed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7ef694ec-1ea0-4f02-800c-d1279b4fdf12:5848:1875954110592384:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789049382.223128:0:8487:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb8d0aaf480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7ef694ec-1ea0-4f02-800c-d1279b4fdf12:8487:1875954110592512:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789049382.223214:0:8487:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789049382.223262:0:8487:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cb8d0a61180 going to sleep for 11 seconds 00000100:00100000:1.0:1789049382.223327:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954110592512 00000100:00100000:1.0:1789049382.223335:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954110592512 00000100:00100000:1.0:1789049382.223388:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:1.0:1789049382.223407:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8c6295850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7ef694ec-1ea0-4f02-800c-d1279b4fdf12+16:8487:x1875954110592512:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789049382.223659:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8c6295850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7ef694ec-1ea0-4f02-800c-d1279b4fdf12+16:8487:x1875954110592512:12345-0@lo:502:llog_process_th.0 Request processed in 253us (444us total) trans 0 rc 0/0 00000100:00100000:1.0:1789049382.223668:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:2.0:1789049382.223694:0:8487:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb8d0aaf480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7ef694ec-1ea0-4f02-800c-d1279b4fdf12:8487:1875954110592512:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1789049382.223723:0:8487:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789049382.223734:0:8487:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789049382.223736:0:8487:0:(obd_config.c:1563:class_process_config()) marker 25 (0x1) lustre sys.jobid_var 00000020:00000080:2.0:1789049382.223742:0:8487:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:2.0:1789049382.223764:0:8487:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb8d0aaf480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7ef694ec-1ea0-4f02-800c-d1279b4fdf12:8487:1875954110592640:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789049382.223796:0:8487:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789049382.224491:0:8487:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cb8d0a61180 going to sleep for 11 seconds 00000100:00100000:3.0:1789049382.224576:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954110592640 00000100:00100000:3.0:1789049382.224583:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954110592640 00000100:00100000:3.0:1789049382.224630:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:3.0:1789049382.224639:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8c6295050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7ef694ec-1ea0-4f02-800c-d1279b4fdf12+16:8487:x1875954110592640:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789049382.224861:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8c6295050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7ef694ec-1ea0-4f02-800c-d1279b4fdf12+16:8487:x1875954110592640:12345-0@lo:502:llog_process_th.0 Request processed in 202us (1043us total) trans 0 rc 0/0 00000100:00100000:3.0:1789049382.224870:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:2.0:1789049382.224987:0:8487:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb8d0aaf480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7ef694ec-1ea0-4f02-800c-d1279b4fdf12:8487:1875954110592640:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1789049382.225013:0:8487:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789049382.225019:0:8487:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789049382.225021:0:8487:0:(obd_config.c:1563:class_process_config()) marker 25 (0x2) lustre sys.jobid_var 00000040:00080000:2.0:1789049382.225025:0:8487:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 14 count 14 00000020:01000000:0.0:1789049382.225186:0:5848:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 11-13 (rc=0) 10000000:01000000:0.0:1789049382.225204:0:5848:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.126@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:0.0:1789049382.225213:0:5848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.126@tcp lock: ffff8cb8d6714600/0xf4f48ce5e1bbeda7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xf4f48ce5e1bbedae expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049382.225224:0:5848:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.126@tcp lock: ffff8cb8d6714600/0xf4f48ce5e1bbeda7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xf4f48ce5e1bbedae expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789049382.225233:0:5848:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1789049382.225236:0:5848:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8cb8e01c3000 from 39 10000000:01000000:0.0:1789049382.225239:0:5848:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1789049382.225271:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.126@tcp lock: ffff8cb7c4c38200/0xf4f48ce5e1bbedb5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049382.225279:0:5848:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.126@tcp lock: ffff8cb7c4c38200/0xf4f48ce5e1bbedb5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049382.225288:0:5848:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.126@tcp lock: ffff8cb7c4c38200/0xf4f48ce5e1bbedb5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789049382.225305:0:5848:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb8c633df80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7ef694ec-1ea0-4f02-800c-d1279b4fdf12:5848:1875954110592768:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1789049382.225338:0:5848:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789049382.225738:0:5848:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cb8c79f80c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789049382.227776:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954110592768 00000100:00100000:1.0:1789049382.227790:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954110592768 00000100:00100000:1.0:1789049382.228674:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:1.0:1789049382.228688:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8c6297850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7ef694ec-1ea0-4f02-800c-d1279b4fdf12+16:5848:x1875954110592768:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789049382.228722:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789049382.228740:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cb8c146c600/0xf4f48ce5e1bbedbc lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0xf4f48ce5e1bbedb5 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049382.228769:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cb8c146c600/0xf4f48ce5e1bbedbc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf4f48ce5e1bbedb5 expref: 17 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049382.228778:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cb8c146c600/0xf4f48ce5e1bbedbc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf4f48ce5e1bbedb5 expref: 17 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049382.228785:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cb8c146c600, rc 0) 00000100:00100000:1.0:1789049382.229106:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8c6297850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7ef694ec-1ea0-4f02-800c-d1279b4fdf12+17:5848:x1875954110592768:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 422us (3766us total) trans 0 rc 0/0 00000100:00100000:1.0:1789049382.229113:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:0.0:1789049382.229297:0:5848:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb8c633df80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7ef694ec-1ea0-4f02-800c-d1279b4fdf12:5848:1875954110592768:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789049382.229315:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.126@tcp lock: ffff8cb7c4c38200/0xf4f48ce5e1bbedb5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xf4f48ce5e1bbedbc expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049382.229325:0:5848:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.126@tcp lock: ffff8cb7c4c38200/0xf4f48ce5e1bbedb5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xf4f48ce5e1bbedbc expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789049382.229397:0:5848:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb8c633df80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7ef694ec-1ea0-4f02-800c-d1279b4fdf12:5848:1875954110592896:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789049382.229431:0:5848:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789049382.229470:0:5848:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cb8c79f80c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789049382.229536:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954110592896 00000100:00100000:3.0:1789049382.229543:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954110592896 00000100:00100000:3.0:1789049382.229591:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:3.0:1789049382.229598:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8c6294850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7ef694ec-1ea0-4f02-800c-d1279b4fdf12+17:5848:x1875954110592896:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789049382.229875:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8c6294850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7ef694ec-1ea0-4f02-800c-d1279b4fdf12+17:5848:x1875954110592896:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 276us (443us total) trans 0 rc 0/0 00000100:00100000:3.0:1789049382.229882:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:0.0:1789049382.230624:0:5848:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb8c633df80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7ef694ec-1ea0-4f02-800c-d1279b4fdf12:5848:1875954110592896:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789049382.230665:0:5848:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb8c633df80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7ef694ec-1ea0-4f02-800c-d1279b4fdf12:5848:1875954110593024:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789049382.230712:0:5848:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789049382.230750:0:5848:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cb8c79f80c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789049382.235956:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954110593024 00000100:00100000:1.0:1789049382.235971:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954110593024 00000100:00100000:1.0:1789049382.236041:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:1.0:1789049382.236051:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8c6295c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7ef694ec-1ea0-4f02-800c-d1279b4fdf12+17:5848:x1875954110593024:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789049382.236288:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8c6295c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7ef694ec-1ea0-4f02-800c-d1279b4fdf12+17:5848:x1875954110593024:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 238us (5574us total) trans 0 rc 0/0 00000100:00100000:1.0:1789049382.236296:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:0.0:1789049382.236415:0:5848:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb8c633df80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7ef694ec-1ea0-4f02-800c-d1279b4fdf12:5848:1875954110593024:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789049382.237727:0:8488:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb8c633df80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7ef694ec-1ea0-4f02-800c-d1279b4fdf12:8488:1875954110593152:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789049382.237799:0:8488:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789049382.237885:0:8488:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cb8c79f8a80 going to sleep for 11 seconds 00000100:00100000:2.0:1789049382.238281:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954110593152 00000100:00100000:2.0:1789049382.238289:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954110593152 00000100:00100000:2.0:1789049382.238328:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:2.0:1789049382.238336:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8c6296c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7ef694ec-1ea0-4f02-800c-d1279b4fdf12+17:8488:x1875954110593152:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789049382.238586:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8c6296c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7ef694ec-1ea0-4f02-800c-d1279b4fdf12+17:8488:x1875954110593152:12345-0@lo:502:llog_process_th.0 Request processed in 250us (787us total) trans 0 rc 0/0 00000100:00100000:2.0:1789049382.238595:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:0.0:1789049382.238746:0:8488:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb8c633df80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7ef694ec-1ea0-4f02-800c-d1279b4fdf12:8488:1875954110593152:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789049382.238797:0:8488:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb8c633df80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7ef694ec-1ea0-4f02-800c-d1279b4fdf12:8488:1875954110593280:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789049382.238833:0:8488:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789049382.238882:0:8488:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cb8c79f8a80 going to sleep for 11 seconds 00000100:00100000:3.0:1789049382.240029:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954110593280 00000100:00100000:3.0:1789049382.240050:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954110593280 00000100:00100000:2.0:1789049382.240194:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:2.0:1789049382.240207:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8c6294450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7ef694ec-1ea0-4f02-800c-d1279b4fdf12+17:8488:x1875954110593280:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789049382.240483:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8c6294450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7ef694ec-1ea0-4f02-800c-d1279b4fdf12+17:8488:x1875954110593280:12345-0@lo:502:llog_process_th.0 Request processed in 278us (1647us total) trans 0 rc 0/0 00000100:00100000:2.0:1789049382.240500:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00100000:1.0:1789049382.240658:0:8488:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb8c633df80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7ef694ec-1ea0-4f02-800c-d1279b4fdf12:8488:1875954110593280:0@lo:502:llog_process_th.0 00000040:00080000:1.0:1789049382.240693:0:8488:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:2.0:1789049382.246445:0:5848:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-41 (rc=0) 10000000:01000000:2.0:1789049382.246475:0:5848:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.126@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1789049382.246487:0:5848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.126@tcp lock: ffff8cb7c4c38200/0xf4f48ce5e1bbedb5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xf4f48ce5e1bbedbc expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049382.246498:0:5848:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.126@tcp lock: ffff8cb7c4c38200/0xf4f48ce5e1bbedb5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xf4f48ce5e1bbedbc expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789049382.246508:0:5848:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:2.0:1789049382.246511:0:5848:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 34 10000000:01000000:2.0:1789049382.246514:0:5848:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:2.0:1789049382.246566:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.126@tcp lock: ffff8cb8d6715600/0xf4f48ce5e1bbedc3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049382.246574:0:5848:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.126@tcp lock: ffff8cb8d6715600/0xf4f48ce5e1bbedc3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049382.246586:0:5848:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.126@tcp lock: ffff8cb8d6715600/0xf4f48ce5e1bbedc3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789049382.246615:0:5848:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb8d0aaf480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7ef694ec-1ea0-4f02-800c-d1279b4fdf12:5848:1875954110593408:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1789049382.246677:0:5848:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789049382.246724:0:5848:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cb8d0a61840 going to sleep for 11 seconds 00000100:00100000:3.0:1789049382.247244:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954110593408 00000100:00100000:3.0:1789049382.247252:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954110593408 00000100:00100000:3.0:1789049382.247306:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:3.0:1789049382.247315:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8c6295450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7ef694ec-1ea0-4f02-800c-d1279b4fdf12+17:5848:x1875954110593408:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789049382.247329:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789049382.247363:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cb8c6b34600/0xf4f48ce5e1bbedca lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0xf4f48ce5e1bbedc3 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049382.247389:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cb8c6b34600/0xf4f48ce5e1bbedca lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf4f48ce5e1bbedc3 expref: 18 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049382.247400:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cb8c6b34600/0xf4f48ce5e1bbedca lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf4f48ce5e1bbedc3 expref: 18 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049382.247408:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cb8c6b34600, rc 0) 00000100:00100000:3.0:1789049382.247467:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8c6295450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7ef694ec-1ea0-4f02-800c-d1279b4fdf12+18:5848:x1875954110593408:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 152us (788us total) trans 0 rc 0/0 00000100:00100000:3.0:1789049382.247474:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00100000:0.0:1789049382.247503:0:5848:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb8d0aaf480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7ef694ec-1ea0-4f02-800c-d1279b4fdf12:5848:1875954110593408:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789049382.247522:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.126@tcp lock: ffff8cb8d6715600/0xf4f48ce5e1bbedc3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xf4f48ce5e1bbedca expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049382.247532:0:5848:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.126@tcp lock: ffff8cb8d6715600/0xf4f48ce5e1bbedc3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0xf4f48ce5e1bbedca expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789049382.247597:0:5848:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb8c633d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7ef694ec-1ea0-4f02-800c-d1279b4fdf12:5848:1875954110593536:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789049382.247626:0:5848:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789049382.247652:0:5848:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cb8c79f8a80 going to sleep for 11 seconds 00000100:00100000:1.0:1789049382.249983:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954110593536 00000100:00100000:1.0:1789049382.249997:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954110593536 00000100:00100000:1.0:1789049382.250068:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:1.0:1789049382.250077:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8c6296850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7ef694ec-1ea0-4f02-800c-d1279b4fdf12+18:5848:x1875954110593536:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789049382.250393:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8c6296850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7ef694ec-1ea0-4f02-800c-d1279b4fdf12+18:5848:x1875954110593536:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 316us (2765us total) trans 0 rc 0/0 00000100:00100000:1.0:1789049382.250401:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00100000:0.0:1789049382.250609:0:5848:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb8c633d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7ef694ec-1ea0-4f02-800c-d1279b4fdf12:5848:1875954110593536:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789049382.250655:0:5848:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb8c633d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7ef694ec-1ea0-4f02-800c-d1279b4fdf12:5848:1875954110593664:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789049382.250698:0:5848:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789049382.250735:0:5848:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cb8c79f8a80 going to sleep for 11 seconds 00000100:00100000:3.0:1789049382.251642:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954110593664 00000100:00100000:3.0:1789049382.251651:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954110593664 00000100:00100000:3.0:1789049382.251695:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 164 00000100:00100000:3.0:1789049382.251704:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8c6296050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7ef694ec-1ea0-4f02-800c-d1279b4fdf12+18:5848:x1875954110593664:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789049382.251918:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8c6296050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7ef694ec-1ea0-4f02-800c-d1279b4fdf12+18:5848:x1875954110593664:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 214us (1219us total) trans 0 rc 0/0 00000100:00100000:3.0:1789049382.251925:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 164 00000100:00100000:0.0:1789049382.252022:0:5848:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb8c633d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7ef694ec-1ea0-4f02-800c-d1279b4fdf12:5848:1875954110593664:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789049382.252491:0:8489:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb8c633d880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7ef694ec-1ea0-4f02-800c-d1279b4fdf12:8489:1875954110593792:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789049382.252539:0:8489:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789049382.252579:0:8489:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cb8c79f8e40 going to sleep for 11 seconds 00000100:00100000:3.0:1789049382.252629:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954110593792 00000100:00100000:3.0:1789049382.252635:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954110593792 00000100:00100000:3.0:1789049382.252668:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 165 00000100:00100000:3.0:1789049382.252681:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8c6befc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7ef694ec-1ea0-4f02-800c-d1279b4fdf12+18:8489:x1875954110593792:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789049382.252867:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8c6befc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7ef694ec-1ea0-4f02-800c-d1279b4fdf12+18:8489:x1875954110593792:12345-0@lo:502:llog_process_th.0 Request processed in 185us (327us total) trans 0 rc 0/0 00000100:00100000:3.0:1789049382.252874:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 165 00000100:00100000:0.0:1789049382.252953:0:8489:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb8c633d880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7ef694ec-1ea0-4f02-800c-d1279b4fdf12:8489:1875954110593792:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1789049382.252975:0:8489:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789049382.252983:0:8489:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789049382.252985:0:8489:0:(obd_config.c:1563:class_process_config()) marker 27 (0x1) lustre sys.jobid_var 00000020:00000080:0.0:1789049382.252990:0:8489:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:0.0:1789049382.253008:0:8489:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb8c633d880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7ef694ec-1ea0-4f02-800c-d1279b4fdf12:8489:1875954110593920:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789049382.253042:0:8489:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789049382.253067:0:8489:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cb8c79f8e40 going to sleep for 11 seconds 00000100:00100000:3.0:1789049382.253112:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954110593920 00000100:00100000:3.0:1789049382.253116:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954110593920 00000100:00100000:3.0:1789049382.253141:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 166 00000100:00100000:3.0:1789049382.253147:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8c6bed850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7ef694ec-1ea0-4f02-800c-d1279b4fdf12+18:8489:x1875954110593920:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789049382.253273:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8c6bed850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7ef694ec-1ea0-4f02-800c-d1279b4fdf12+18:8489:x1875954110593920:12345-0@lo:502:llog_process_th.0 Request processed in 125us (229us total) trans 0 rc 0/0 00000100:00100000:3.0:1789049382.253280:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 166 00000100:00100000:0.0:1789049382.253344:0:8489:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb8c633d880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7ef694ec-1ea0-4f02-800c-d1279b4fdf12:8489:1875954110593920:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1789049382.253373:0:8489:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789049382.253377:0:8489:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789049382.253379:0:8489:0:(obd_config.c:1563:class_process_config()) marker 27 (0x2) lustre sys.jobid_var 00000040:00080000:0.0:1789049382.253382:0:8489:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 37 count 37 00000020:01000000:3.0:1789049382.254020:0:5848:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 34-36 (rc=0) 10000000:01000000:3.0:1789049382.254038:0:5848:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.126@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:3.0:1789049382.254048:0:5848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.126@tcp lock: ffff8cb8d6715600/0xf4f48ce5e1bbedc3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xf4f48ce5e1bbedca expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049382.254059:0:5848:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.126@tcp lock: ffff8cb8d6715600/0xf4f48ce5e1bbedc3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xf4f48ce5e1bbedca expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789049382.254068:0:5848:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:3.0:1789049382.254071:0:5848:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff8cb8c59599c0 from 1 10000000:01000000:3.0:1789049382.254074:0:5848:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:3.0:1789049382.254098:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.126@tcp lock: ffff8cb8c6b34800/0xf4f48ce5e1bbedd1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049382.254107:0:5848:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.126@tcp lock: ffff8cb8c6b34800/0xf4f48ce5e1bbedd1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049382.254116:0:5848:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.126@tcp lock: ffff8cb8c6b34800/0xf4f48ce5e1bbedd1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789049382.254140:0:5848:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb8df285500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7ef694ec-1ea0-4f02-800c-d1279b4fdf12:5848:1875954110594048:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1789049382.254177:0:5848:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789049382.254204:0:5848:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cb8d00dacc0 going to sleep for 11 seconds 00000100:00100000:0.0:1789049382.254284:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954110594048 00000100:00100000:0.0:1789049382.254290:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954110594048 00000100:00100000:0.0:1789049382.254315:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 167 00000100:00100000:0.0:1789049382.254321:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8c6bed050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7ef694ec-1ea0-4f02-800c-d1279b4fdf12+18:5848:x1875954110594048:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789049382.254330:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789049382.254341:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cb7c4c39800/0xf4f48ce5e1bbedd8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0xf4f48ce5e1bbedd1 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049382.254372:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cb7c4c39800/0xf4f48ce5e1bbedd8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf4f48ce5e1bbedd1 expref: 19 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049382.254382:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cb7c4c39800/0xf4f48ce5e1bbedd8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf4f48ce5e1bbedd1 expref: 19 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049382.254401:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cb7c4c39800, rc 0) 00000100:00100000:0.0:1789049382.254433:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8c6bed050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7ef694ec-1ea0-4f02-800c-d1279b4fdf12+19:5848:x1875954110594048:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 111us (255us total) trans 0 rc 0/0 00000100:00100000:0.0:1789049382.254440:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 167 00000100:00100000:3.0:1789049382.255926:0:5848:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb8df285500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7ef694ec-1ea0-4f02-800c-d1279b4fdf12:5848:1875954110594048:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789049382.255949:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.126@tcp lock: ffff8cb8c6b34800/0xf4f48ce5e1bbedd1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xf4f48ce5e1bbedd8 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049382.255961:0:5848:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.126@tcp lock: ffff8cb8c6b34800/0xf4f48ce5e1bbedd1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xf4f48ce5e1bbedd8 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789049382.256033:0:5848:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb8df285500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7ef694ec-1ea0-4f02-800c-d1279b4fdf12:5848:1875954110594176:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789049382.256075:0:5848:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789049382.256107:0:5848:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cb8d00dacc0 going to sleep for 11 seconds 00000100:00100000:0.0:1789049382.256230:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954110594176 00000100:00100000:0.0:1789049382.256236:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954110594176 00000100:00100000:0.0:1789049382.256277:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 168 00000100:00100000:0.0:1789049382.256285:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8c6bef850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7ef694ec-1ea0-4f02-800c-d1279b4fdf12+19:5848:x1875954110594176:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789049382.256573:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8c6bef850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7ef694ec-1ea0-4f02-800c-d1279b4fdf12+19:5848:x1875954110594176:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 287us (496us total) trans 0 rc -2/-2 00000100:00100000:0.0:1789049382.256581:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 168 00000100:00100000:3.0:1789049382.258009:0:5848:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb8df285500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7ef694ec-1ea0-4f02-800c-d1279b4fdf12:5848:1875954110594176:0@lo:501:ll_cfg_requeue.0 10000000:01000000:3.0:1789049382.258053:0:5848:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.126@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:3.0:1789049382.258063:0:5848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.126@tcp lock: ffff8cb8c6b34800/0xf4f48ce5e1bbedd1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xf4f48ce5e1bbedd8 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049382.258073:0:5848:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.126@tcp lock: ffff8cb8c6b34800/0xf4f48ce5e1bbedd1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xf4f48ce5e1bbedd8 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049382.619985:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789049382.736522:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.26@tcp (source: 12345-192.168.206.26@tcp) 00000100:00100000:1.0:1789049382.736579:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.26@tcp (source: 12345-192.168.206.26@tcp) 00000100:00100000:0.0:1789049382.736599:0:6841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954089596160 00000100:00100000:1.0:1789049382.736603:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.26@tcp (source: 12345-192.168.206.26@tcp) 00000100:00100000:0.0:1789049382.736607:0:6841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954089596160 00000100:00100000:1.0:1789049382.736628:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.26@tcp (source: 12345-192.168.206.26@tcp) 00000100:00100000:1.0:1789049382.736643:0:6703:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954089596416 00000100:00100000:1.0:1789049382.736647:0:6703:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954089596416 00000100:00100000:0.0:1789049382.736665:0:6841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.26@tcp, seq: 26 00000100:00100000:0.0:1789049382.736675:0:6841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8d0ab5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e823b53a-3591-475c-8624-c682227e5c13+6:2356:x1875954089596160:12345-192.168.206.26@tcp:400:kworker.0 00000100:00100000:1.0:1789049382.736682:0:6703:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954089596288 00000100:00100000:1.0:1789049382.736684:0:6703:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954089596288 00000100:00100000:1.0:1789049382.736699:0:6703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.26@tcp, seq: 11 00000100:00100000:1.0:1789049382.736707:0:6703:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8d0ab7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e823b53a-3591-475c-8624-c682227e5c13+5:2356:x1875954089596416:12345-192.168.206.26@tcp:400:kworker.0 00000100:00100000:1.0:1789049382.736760:0:6703:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8d0ab7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e823b53a-3591-475c-8624-c682227e5c13+5:2356:x1875954089596416:12345-192.168.206.26@tcp:400:kworker.0 Request processed in 53us (154us total) trans 0 rc 0/0 00000100:00100000:1.0:1789049382.736767:0:6703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.26@tcp, seq: 11 00000100:00100000:1.0:1789049382.736783:0:6703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.26@tcp, seq: 12 00000100:00100000:0.0:1789049382.736787:0:6841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8d0ab5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e823b53a-3591-475c-8624-c682227e5c13+6:2356:x1875954089596160:12345-192.168.206.26@tcp:400:kworker.0 Request processed in 115us (275us total) trans 0 rc 0/0 00000100:00100000:1.0:1789049382.736789:0:6703:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8d0ab6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e823b53a-3591-475c-8624-c682227e5c13+5:2355:x1875954089596288:12345-192.168.206.26@tcp:400:kworker.0 00000100:00100000:0.0:1789049382.736794:0:6841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.26@tcp, seq: 26 00000100:00100000:1.0:1789049382.736810:0:6703:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8d0ab6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e823b53a-3591-475c-8624-c682227e5c13+5:2355:x1875954089596288:12345-192.168.206.26@tcp:400:kworker.0 Request processed in 22us (182us total) trans 0 rc 0/0 00000100:00080000:0.0:1789049382.736814:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789049382.736816:0:6703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.26@tcp, seq: 12 00000100:00080000:0.0:1789049382.736818:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789049382.736820:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789049382.737242:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954089596032 00000100:00100000:2.0:1789049382.737248:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954089596032 00000100:00100000:2.0:1789049382.737284:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.26@tcp, seq: 169 00000100:00100000:2.0:1789049382.737292:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8c6bec850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:de93d576-ed8d-4d27-ab00-9189a62cea33+10:2355:x1875954089596032:12345-192.168.206.26@tcp:400:kworker.0 00000100:00100000:2.0:1789049382.737348:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8c6bec850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:de93d576-ed8d-4d27-ab00-9189a62cea33+10:2355:x1875954089596032:12345-192.168.206.26@tcp:400:kworker.0 Request processed in 56us (768us total) trans 0 rc 0/0 00000100:00100000:2.0:1789049382.737355:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.26@tcp, seq: 169 00000020:00000080:3.0:1789049383.114085:0:8526:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffc5be059b0 20000000:00000080:3.0:1789049383.114103:0:8526:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff8cb900ecd000 uarg=0000000000000000 20000000:01000000:3.0:1789049383.114141:0:8526:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:3.0:1789049383.114147:0:8526:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:3.0:1789049383.114161:0:8526:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:2.0:1789049383.115511:0:8527:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 20000000:02000000:3.0:1789049383.115763:0:8526:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter general.lod.*.mdt_hash=crush in log params 00000040:00080000:3.0:1789049383.121463:0:8526:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8976 00000040:00080000:3.0:1789049383.121506:0:8526:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 112 off9088 00000040:00080000:3.0:1789049383.121564:0:8526:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 224 off9312 10000000:01000000:3.0:1789049383.121596:0:8526:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:3.0:1789049383.121615:0:8526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8cb8c6b35200/0xf4f48ce5e1bbeddf lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049383.121633:0:8526:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8cb8c146ca00/0xf4f48ce5e1bbeb54 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf4f48ce5e1bbeb4d expref: 18 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049383.121641:0:8526:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8cb8c146d800/0xf4f48ce5e1bbebb6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf4f48ce5e1bbebaf expref: 18 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049383.121648:0:8526:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8cb8d776fa00/0xf4f48ce5e1bbec81 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf4f48ce5e1bbec7a expref: 18 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049383.121658:0:8526:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8cb8d776e200/0xf4f48ce5e1bbed3e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a3272 expref: 9 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049383.121665:0:8526:0:(ldlm_resource.c:1751:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8cb8c6b35200/0xf4f48ce5e1bbeddf lrc: 7/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 8526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049383.121698:0:8526:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8cb8d776e200/0xf4f48ce5e1bbed3e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a3272 expref: 9 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049383.121710:0:8526:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8cb8d776e200/0xf4f48ce5e1bbed3e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a3272 expref: 9 pid: 5843 timeout: 309 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789049383.121723:0:8526:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb8df285500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8526:1875954110594304:192.168.206.26@tcp:104: 00010000:00010000:3.0:1789049383.121902:0:8526:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8cb8d776fa00/0xf4f48ce5e1bbec81 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf4f48ce5e1bbec7a expref: 18 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049383.121918:0:8526:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8cb8d776fa00/0xf4f48ce5e1bbec81 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf4f48ce5e1bbec7a expref: 18 pid: 5843 timeout: 359 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789049383.121928:0:8526:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb8df285180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8526:1875954110594432:0@lo:104: 00000100:00100000:3.0:1789049383.121963:0:8526:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1789049383.121992:0:8526:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8cb8c146d800/0xf4f48ce5e1bbebb6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf4f48ce5e1bbebaf expref: 18 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049383.122000:0:8526:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8cb8c146d800/0xf4f48ce5e1bbebb6 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf4f48ce5e1bbebaf expref: 18 pid: 5844 timeout: 359 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789049383.122008:0:8526:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb8df284000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8526:1875954110594560:0@lo:104: 00000100:00100000:3.0:1789049383.122027:0:8526:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1789049383.122042:0:8526:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8cb8c146ca00/0xf4f48ce5e1bbeb54 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf4f48ce5e1bbeb4d expref: 18 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049383.122050:0:8526:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8cb8c146ca00/0xf4f48ce5e1bbeb54 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf4f48ce5e1bbeb4d expref: 18 pid: 5844 timeout: 359 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789049383.122057:0:8526:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb8df286d80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8526:1875954110594688:0@lo:104: 00000100:00100000:3.0:1789049383.122070:0:8526:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cb900da9780 going to sleep for 11 seconds 00000100:00100000:2.0:1789049383.122293:0:5834:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:2.0:1789049383.122309:0:5834:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789049383.122333:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954110594432 00000100:00100000:2.0:1789049383.122339:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954110594432 00000100:00100000:2.0:1789049383.122370:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954110594560 00000100:00100000:2.0:1789049383.122372:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954110594560 00000100:00100000:2.0:1789049383.122380:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954110594688 00000100:00100000:2.0:1789049383.122381:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954110594688 00000100:00100000:2.0:1789049383.122391:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1789049383.122398:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8df287800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:7ef694ec-1ea0-4f02-800c-d1279b4fdf12+5:8526:x1875954110594432:12345-0@lo:104: 00010000:00010000:2.0:1789049383.122409:0:5834:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.126@tcp lock: ffff8cb8c146c000/0xf4f48ce5e1bbec7a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xf4f48ce5e1bbec81 expref: -99 pid: 7645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049383.122451:0:5834:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1789049383.122456:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8df287800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:7ef694ec-1ea0-4f02-800c-d1279b4fdf12+5:8526:x1875954110594432:12345-0@lo:104: Request processed in 58us (493us total) trans 0 rc 0/0 00000100:00100000:2.0:1789049383.122462:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1789049383.122475:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1789049383.122480:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb900ecc850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:7ef694ec-1ea0-4f02-800c-d1279b4fdf12+4:8526:x1875954110594560:12345-0@lo:104: 00010000:00010000:2.0:1789049383.122486:0:5834:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.126@tcp lock: ffff8cb7c4c39600/0xf4f48ce5e1bbebaf lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xf4f48ce5e1bbebb6 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049383.122510:0:5834:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1789049383.122514:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb900ecc850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:7ef694ec-1ea0-4f02-800c-d1279b4fdf12+4:8526:x1875954110594560:12345-0@lo:104: Request processed in 35us (487us total) trans 0 rc 0/0 00000100:00100000:2.0:1789049383.122525:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1789049383.122562:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1789049383.122576:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8d0aadc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:7ef694ec-1ea0-4f02-800c-d1279b4fdf12+3:8526:x1875954110594688:12345-0@lo:104: 00010000:00010000:2.0:1789049383.122584:0:5834:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.126@tcp lock: ffff8cb8c0031800/0xf4f48ce5e1bbeb4d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xf4f48ce5e1bbeb54 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049383.122614:0:5834:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:2.0:1789049383.122618:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8d0aadc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:7ef694ec-1ea0-4f02-800c-d1279b4fdf12+3:8526:x1875954110594688:12345-0@lo:104: Request processed in 51us (309us total) trans 0 rc 0/0 00000100:00100000:2.0:1789049383.122624:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00010000:00010000:2.0:1789049383.122640:0:6719:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1789049383.122645:0:6719:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.126@tcp lock: ffff8cb8c146c000/0xf4f48ce5e1bbec7a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xf4f48ce5e1bbec81 expref: -99 pid: 7645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049383.122651:0:6719:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cb8c146c000 already unused, calling callback (ffffffffc1ca3c20) 10000000:00010000:2.0:1789049383.122655:0:6719:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.126@tcp lock: ffff8cb8c146c000/0xf4f48ce5e1bbec7a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xf4f48ce5e1bbec81 expref: -99 pid: 7645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049383.122664:0:6719:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.126@tcp lock: ffff8cb8c146c000/0xf4f48ce5e1bbec7a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xf4f48ce5e1bbec81 expref: -99 pid: 7645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789049383.122671:0:6719:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.126@tcp lock: ffff8cb8c146c000/0xf4f48ce5e1bbec7a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xf4f48ce5e1bbec81 expref: -99 pid: 7645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789049383.122676:0:6719:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1789049383.122702:0:6719:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.126@tcp lock: ffff8cb8c146c000/0xf4f48ce5e1bbec7a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf4f48ce5e1bbec81 expref: -99 pid: 7645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049383.122708:0:6719:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789049383.122733:0:6719:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.126@tcp lock: ffff8cb8c146c000/0xf4f48ce5e1bbec7a lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf4f48ce5e1bbec81 expref: -99 pid: 7645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049383.122740:0:6719:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.126@tcp lock: ffff8cb8c146c000/0xf4f48ce5e1bbec7a lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf4f48ce5e1bbec81 expref: -99 pid: 7645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049383.122763:0:6719:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1789049383.122767:0:6719:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.126@tcp lock: ffff8cb7c4c39600/0xf4f48ce5e1bbebaf lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xf4f48ce5e1bbebb6 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049383.122772:0:6719:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cb7c4c39600 already unused, calling callback (ffffffffc1ca3c20) 10000000:00010000:2.0:1789049383.122775:0:6719:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.126@tcp lock: ffff8cb7c4c39600/0xf4f48ce5e1bbebaf lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xf4f48ce5e1bbebb6 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049383.122781:0:6719:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.126@tcp lock: ffff8cb7c4c39600/0xf4f48ce5e1bbebaf lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xf4f48ce5e1bbebb6 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789049383.122787:0:6719:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.126@tcp lock: ffff8cb7c4c39600/0xf4f48ce5e1bbebaf lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xf4f48ce5e1bbebb6 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789049383.122792:0:6719:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1789049383.122805:0:6719:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.126@tcp lock: ffff8cb7c4c39600/0xf4f48ce5e1bbebaf lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf4f48ce5e1bbebb6 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049383.122810:0:6719:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789049383.122824:0:6719:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.126@tcp lock: ffff8cb7c4c39600/0xf4f48ce5e1bbebaf lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf4f48ce5e1bbebb6 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049383.122830:0:6719:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.126@tcp lock: ffff8cb7c4c39600/0xf4f48ce5e1bbebaf lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf4f48ce5e1bbebb6 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049383.122838:0:6719:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789049383.122869:0:6719:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.126@tcp lock: ffff8cb8c0031800/0xf4f48ce5e1bbeb4d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xf4f48ce5e1bbeb54 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049383.122875:0:6719:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cb8c0031800 already unused, calling callback (ffffffffc1ca3c20) 10000000:00010000:2.0:1789049383.122878:0:6719:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.126@tcp lock: ffff8cb8c0031800/0xf4f48ce5e1bbeb4d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xf4f48ce5e1bbeb54 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049383.122884:0:6719:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.126@tcp lock: ffff8cb8c0031800/0xf4f48ce5e1bbeb4d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xf4f48ce5e1bbeb54 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789049383.122899:0:6719:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.126@tcp lock: ffff8cb8c0031800/0xf4f48ce5e1bbeb4d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xf4f48ce5e1bbeb54 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789049383.122904:0:6719:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1789049383.122916:0:6719:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.126@tcp lock: ffff8cb8c0031800/0xf4f48ce5e1bbeb4d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf4f48ce5e1bbeb54 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049383.122921:0:6719:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789049383.122927:0:6719:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.126@tcp lock: ffff8cb8c0031800/0xf4f48ce5e1bbeb4d lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf4f48ce5e1bbeb54 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049383.122932:0:6719:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.126@tcp lock: ffff8cb8c0031800/0xf4f48ce5e1bbeb4d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf4f48ce5e1bbeb54 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049383.122945:0:6719:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789049383.122947:0:6719:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789049383.122948:0:6719:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789049383.122954:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789049383.122959:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789049383.122977:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb8d0aaca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:7ef694ec-1ea0-4f02-800c-d1279b4fdf12:3311:1875954110594816:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789049383.123006:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789049383.123044:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb8d0aac700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:7ef694ec-1ea0-4f02-800c-d1279b4fdf12:3309:1875954110595072:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789049383.123071:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789049383.123086:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1789049383.123091:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb8d0aace00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:7ef694ec-1ea0-4f02-800c-d1279b4fdf12:3309:1875954110594944:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789049383.123107:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789049383.124976:0:8526:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb8df285180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8526:1875954110594432:0@lo:104: 00000100:00100000:3.0:1789049383.124990:0:8526:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb8df284000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8526:1875954110594560:0@lo:104: 00000100:00100000:3.0:1789049383.124999:0:8526:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb8df286d80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8526:1875954110594688:0@lo:104: 00000100:00100000:1.0:1789049383.126127:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954110594816 00000100:00100000:1.0:1789049383.126136:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954110594816 00010000:00010000:1.0:1789049383.126170:0:5836:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8cb8d776fa00/0xf4f48ce5e1bbec81 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf4f48ce5e1bbec7a expref: 19 pid: 5843 timeout: 359 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789049383.126201:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954110595072 00000100:00100000:1.0:1789049383.126215:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954110595072 00010000:00010000:1.0:1789049383.126226:0:5836:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8cb8c146ca00/0xf4f48ce5e1bbeb54 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf4f48ce5e1bbeb4d expref: 20 pid: 5844 timeout: 359 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789049383.126236:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954110594944 00000100:00100000:1.0:1789049383.126238:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954110594944 00010000:00010000:1.0:1789049383.126246:0:5836:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8cb8c146d800/0xf4f48ce5e1bbebb6 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf4f48ce5e1bbebaf expref: 21 pid: 5844 timeout: 359 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789049383.126257:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1789049383.126263:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8d0aad500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7ef694ec-1ea0-4f02-800c-d1279b4fdf12+21:3311:x1875954110594816:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789049383.126274:0:5836:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789049383.126279:0:5836:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8cb8d776fa00/0xf4f48ce5e1bbec81 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf4f48ce5e1bbec7a expref: 21 pid: 5843 timeout: 359 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049383.126288:0:5836:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8cb8d776fa00/0xf4f48ce5e1bbec81 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf4f48ce5e1bbec7a expref: 21 pid: 5843 timeout: 359 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049383.126303:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cb8d776fa00/0xf4f48ce5e1bbec81 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf4f48ce5e1bbec7a expref: 21 pid: 5843 timeout: 359 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049383.126317:0:5836:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789049383.126407:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8d0aad500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7ef694ec-1ea0-4f02-800c-d1279b4fdf12+20:3311:x1875954110594816:12345-0@lo:103:ldlm_bl.0 Request processed in 142us (3399us total) trans 0 rc 0/0 00000100:00100000:1.0:1789049383.126414:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1789049383.126432:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1789049383.126439:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8d0aad180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7ef694ec-1ea0-4f02-800c-d1279b4fdf12+19:3309:x1875954110595072:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789049383.126446:0:5836:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789049383.126450:0:5836:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8cb8c146ca00/0xf4f48ce5e1bbeb54 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf4f48ce5e1bbeb4d expref: 19 pid: 5844 timeout: 359 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049383.126468:0:5836:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8cb8c146ca00/0xf4f48ce5e1bbeb54 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf4f48ce5e1bbeb4d expref: 19 pid: 5844 timeout: 359 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049383.126479:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cb8c146ca00/0xf4f48ce5e1bbeb54 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf4f48ce5e1bbeb4d expref: 19 pid: 5844 timeout: 359 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049383.126487:0:5836:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789049383.126519:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8d0aad180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7ef694ec-1ea0-4f02-800c-d1279b4fdf12+18:3309:x1875954110595072:12345-0@lo:103:ldlm_bl.0 Request processed in 82us (3448us total) trans 0 rc 0/0 00000100:00100000:1.0:1789049383.126525:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1789049383.126537:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1789049383.126554:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8d0aaf800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7ef694ec-1ea0-4f02-800c-d1279b4fdf12+17:3309:x1875954110594944:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789049383.126561:0:5836:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789049383.126565:0:5836:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8cb8c146d800/0xf4f48ce5e1bbebb6 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf4f48ce5e1bbebaf expref: 17 pid: 5844 timeout: 359 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049383.126583:0:5836:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8cb8c146d800/0xf4f48ce5e1bbebb6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf4f48ce5e1bbebaf expref: 17 pid: 5844 timeout: 359 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049383.126593:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cb8c146d800/0xf4f48ce5e1bbebb6 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf4f48ce5e1bbebaf expref: 17 pid: 5844 timeout: 359 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049383.126601:0:5836:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789049383.126623:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8d0aaf800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7ef694ec-1ea0-4f02-800c-d1279b4fdf12+16:3309:x1875954110594944:12345-0@lo:103:ldlm_bl.0 Request processed in 81us (3515us total) trans 0 rc 0/0 00000100:00100000:1.0:1789049383.126629:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1789049383.126667:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb8d0aace00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:7ef694ec-1ea0-4f02-800c-d1279b4fdf12:3309:1875954110594944:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789049383.126677:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb8d0aac700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:7ef694ec-1ea0-4f02-800c-d1279b4fdf12:3309:1875954110595072:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789049383.128183:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb8d0aaca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:7ef694ec-1ea0-4f02-800c-d1279b4fdf12:3311:1875954110594816:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789049383.133182:0:8526:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb8df285500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8526:1875954110594304:192.168.206.26@tcp:104: 00010000:00010000:3.0:1789049383.133217:0:8526:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8cb8c6b35200/0xf4f48ce5e1bbeddf lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789049383.135791:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.26@tcp (source: 12345-192.168.206.26@tcp) 00000100:00100000:2.0:1789049383.135925:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954089596544 00000100:00100000:2.0:1789049383.135936:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954089596544 00010000:00010000:2.0:1789049383.135982:0:5836:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8cb8d776e200/0xf4f48ce5e1bbed3e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a3272 expref: 10 pid: 5843 timeout: 309 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789049383.136027:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.26@tcp, seq: 24 00000100:00100000:2.0:1789049383.136037:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8d0ab7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:de93d576-ed8d-4d27-ab00-9189a62cea33+10:2357:x1875954089596544:12345-192.168.206.26@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789049383.136052:0:5836:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789049383.136058:0:5836:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8cb8d776e200/0xf4f48ce5e1bbed3e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a3272 expref: 10 pid: 5843 timeout: 309 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049383.136071:0:5836:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8cb8d776e200/0xf4f48ce5e1bbed3e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a3272 expref: 10 pid: 5843 timeout: 309 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049383.136089:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cb8d776e200/0xf4f48ce5e1bbed3e lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a3272 expref: 10 pid: 5843 timeout: 309 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049383.136105:0:5836:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8cb8c6b35200/0xf4f48ce5e1bbeddf lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 8526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049383.136114:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cb8c6b35200/0xf4f48ce5e1bbeddf lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 8526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049383.136147:0:5836:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8cb8c6b35200/0xf4f48ce5e1bbeddf lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049383.136155:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8cb8c6b35200/0xf4f48ce5e1bbeddf lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049383.136163:0:5836:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8cb8c6b35200/0xf4f48ce5e1bbeddf lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049383.136170:0:5836:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8cb8c6b35200/0xf4f48ce5e1bbeddf lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049383.136177:0:5836:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cb8c6b35200 already unused, calling callback (ffffffffc166a8f0) 00010000:00010000:2.0:1789049383.136181:0:5836:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8cb8c6b35200/0xf4f48ce5e1bbeddf lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049383.136190:0:5836:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8cb8c6b35200/0xf4f48ce5e1bbeddf lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 8526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049383.136205:0:5836:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8cb8c6b35200/0xf4f48ce5e1bbeddf lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049383.136216:0:5836:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789049383.136277:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8d0ab7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:de93d576-ed8d-4d27-ab00-9189a62cea33+9:2357:x1875954089596544:12345-192.168.206.26@tcp:103:ldlm_bl.0 Request processed in 241us (495us total) trans 0 rc 0/0 00000100:00100000:2.0:1789049383.136286:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.26@tcp, seq: 24 00010000:00010000:3.0:1789049383.136832:0:8526:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8cb8c6b35200/0xf4f48ce5e1bbeddf lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049383.136873:0:8526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8cb8c6b35200/0xf4f48ce5e1bbeddf lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049383.136881:0:8526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cb8c6b35200/0xf4f48ce5e1bbeddf lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789049383.325664:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1789049383.325691:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb8c633d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3311:1875954110595200:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789049383.328076:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789049383.328171:0:6707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954110595200 00000100:00100000:2.0:1789049383.328180:0:6707:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954110595200 00000100:00100000:2.0:1789049383.328237:0:6707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1789049383.328247:0:6707:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8d0aaca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1875954110595200:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789049383.328872:0:6707:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789049383.328938:0:6707:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8d0aaca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1875954110595200:12345-0@lo:13:osp-pre-0-0.0 Request processed in 693us (865us total) trans 0 rc 0/0 00000100:00100000:2.0:1789049383.328945:0:6707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00080000:2.0:1789049383.329004:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1789049383.329038:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cb8c633d880 x1875954110595200/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789049399 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789049383.329059:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb8c633d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3311:1875954110595200:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1789049383.643062:0:6719:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1789049384.284994:0:5848:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1789049384.285001:0:5848:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8cb8c631b800 from 4 10000000:01000000:2.0:1789049384.285005:0:5848:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1789049384.285044:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.126@tcp lock: ffff8cb8d6715200/0xf4f48ce5e1bbede6 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049384.285056:0:5848:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.126@tcp lock: ffff8cb8d6715200/0xf4f48ce5e1bbede6 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049384.285066:0:5848:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.126@tcp lock: ffff8cb8d6715200/0xf4f48ce5e1bbede6 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789049384.285088:0:5848:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb8d0aac000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7ef694ec-1ea0-4f02-800c-d1279b4fdf12:5848:1875954110595328:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1789049384.285152:0:5848:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789049384.285198:0:5848:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cb8d0a61c00 going to sleep for 11 seconds 00000100:00100000:1.0:1789049384.285427:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954110595328 00000100:00100000:1.0:1789049384.285434:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954110595328 00000100:00100000:1.0:1789049384.285494:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 170 00000100:00100000:1.0:1789049384.285504:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8c6bedc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7ef694ec-1ea0-4f02-800c-d1279b4fdf12+16:5848:x1875954110595328:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789049384.285517:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789049384.285530:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cb8c146dc00/0xf4f48ce5e1bbeded lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xf4f48ce5e1bbede6 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049384.285563:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cb8c146dc00/0xf4f48ce5e1bbeded lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf4f48ce5e1bbede6 expref: 17 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049384.285574:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cb8c146dc00/0xf4f48ce5e1bbeded lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf4f48ce5e1bbede6 expref: 17 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049384.285583:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cb8c146dc00, rc 0) 00000100:00100000:1.0:1789049384.285629:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8c6bedc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7ef694ec-1ea0-4f02-800c-d1279b4fdf12+17:5848:x1875954110595328:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 126us (476us total) trans 0 rc 0/0 00000100:00100000:1.0:1789049384.285636:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 170 00000100:00100000:1.0:1789049384.285688:0:5848:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb8d0aac000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7ef694ec-1ea0-4f02-800c-d1279b4fdf12:5848:1875954110595328:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789049384.285704:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.126@tcp lock: ffff8cb8d6715200/0xf4f48ce5e1bbede6 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf4f48ce5e1bbeded expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049384.285714:0:5848:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.126@tcp lock: ffff8cb8d6715200/0xf4f48ce5e1bbede6 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xf4f48ce5e1bbeded expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789049384.285771:0:5848:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb8d0ab6300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7ef694ec-1ea0-4f02-800c-d1279b4fdf12:5848:1875954110595456:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789049384.285810:0:5848:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789049384.285827:0:5848:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cb900aa86c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789049384.285857:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954110595456 00000100:00100000:1.0:1789049384.285861:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954110595456 00000100:00100000:1.0:1789049384.285895:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 171 00000100:00100000:1.0:1789049384.285902:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8c6beec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7ef694ec-1ea0-4f02-800c-d1279b4fdf12+17:5848:x1875954110595456:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789049384.286138:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8c6beec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7ef694ec-1ea0-4f02-800c-d1279b4fdf12+17:5848:x1875954110595456:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 235us (325us total) trans 0 rc 0/0 00000100:00100000:1.0:1789049384.286144:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 171 00000100:00100000:1.0:1789049384.286175:0:5848:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb8d0ab6300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7ef694ec-1ea0-4f02-800c-d1279b4fdf12:5848:1875954110595456:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789049384.286204:0:5848:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb8d0ab6300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7ef694ec-1ea0-4f02-800c-d1279b4fdf12:5848:1875954110595584:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789049384.286242:0:5848:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789049384.286256:0:5848:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cb900aa86c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789049384.286266:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954110595584 00000100:00100000:1.0:1789049384.286270:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954110595584 00000100:00100000:1.0:1789049384.286290:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 172 00000100:00100000:1.0:1789049384.286297:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8c6bec450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7ef694ec-1ea0-4f02-800c-d1279b4fdf12+17:5848:x1875954110595584:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789049384.286423:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8c6bec450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7ef694ec-1ea0-4f02-800c-d1279b4fdf12+17:5848:x1875954110595584:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 126us (179us total) trans 0 rc 0/0 00000100:00100000:1.0:1789049384.286429:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 172 00000100:00100000:1.0:1789049384.286464:0:5848:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb8d0ab6300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7ef694ec-1ea0-4f02-800c-d1279b4fdf12:5848:1875954110595584:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789049384.286641:0:8561:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb8d0ab6300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7ef694ec-1ea0-4f02-800c-d1279b4fdf12:8561:1875954110595712:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789049384.286673:0:8561:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789049384.286689:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954110595712 00000100:00100000:1.0:1789049384.286699:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954110595712 00000100:00100000:1.0:1789049384.286721:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 173 00000100:00100000:1.0:1789049384.286727:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8c6bed450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7ef694ec-1ea0-4f02-800c-d1279b4fdf12+17:8561:x1875954110595712:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789049384.286865:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8c6bed450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7ef694ec-1ea0-4f02-800c-d1279b4fdf12+17:8561:x1875954110595712:12345-0@lo:502:llog_process_th.0 Request processed in 115us (168us total) trans 0 rc 0/0 00000100:00100000:1.0:1789049384.286873:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 173 00000100:00100000:1.0:1789049384.286903:0:8561:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cb900aa8f00 going to sleep for 11 seconds 00000100:00100000:1.0:1789049384.286915:0:8561:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb8d0ab6300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7ef694ec-1ea0-4f02-800c-d1279b4fdf12:8561:1875954110595712:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1789049384.286935:0:8561:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789049384.286944:0:8561:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789049384.286947:0:8561:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:1.0:1789049384.286954:0:8561:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8cb8c631b800 00000020:00000080:1.0:1789049384.286956:0:8561:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1789049384.287019:0:8561:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb8d0ab6300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7ef694ec-1ea0-4f02-800c-d1279b4fdf12:8561:1875954110595840:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789049384.287053:0:8561:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789049384.287073:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954110595840 00000100:00100000:1.0:1789049384.287077:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954110595840 00000100:00100000:1.0:1789049384.287098:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 174 00000100:00100000:1.0:1789049384.287104:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8c6bee850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7ef694ec-1ea0-4f02-800c-d1279b4fdf12+17:8561:x1875954110595840:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789049384.287206:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8c6bee850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7ef694ec-1ea0-4f02-800c-d1279b4fdf12+17:8561:x1875954110595840:12345-0@lo:502:llog_process_th.0 Request processed in 101us (151us total) trans 0 rc 0/0 00000100:00100000:1.0:1789049384.287213:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 174 00000100:00100000:1.0:1789049384.287241:0:8561:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cb900aa8f00 going to sleep for 11 seconds 00000100:00100000:1.0:1789049384.287253:0:8561:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb8d0ab6300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7ef694ec-1ea0-4f02-800c-d1279b4fdf12:8561:1875954110595840:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1789049384.287271:0:8561:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789049384.287275:0:8561:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789049384.287281:0:8561:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:1.0:1789049384.287285:0:8561:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:1.0:1789049384.287327:0:5848:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:1.0:1789049384.287344:0:5848:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.126@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1789049384.287352:0:5848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.126@tcp lock: ffff8cb8d6715200/0xf4f48ce5e1bbede6 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf4f48ce5e1bbeded expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049384.287362:0:5848:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.126@tcp lock: ffff8cb8d6715200/0xf4f48ce5e1bbede6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf4f48ce5e1bbeded expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789049384.287371:0:5848:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1789049384.287374:0:5848:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8cb8d1c83000 from 4 10000000:01000000:1.0:1789049384.287376:0:5848:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1789049384.287396:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.126@tcp lock: ffff8cb8c146c200/0xf4f48ce5e1bbedf4 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049384.287404:0:5848:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.126@tcp lock: ffff8cb8c146c200/0xf4f48ce5e1bbedf4 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049384.287412:0:5848:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.126@tcp lock: ffff8cb8c146c200/0xf4f48ce5e1bbedf4 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789049384.287425:0:5848:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb8d0ab6300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7ef694ec-1ea0-4f02-800c-d1279b4fdf12:5848:1875954110595968:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1789049384.287451:0:5848:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789049384.287464:0:5848:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cb900aa8f00 going to sleep for 11 seconds 00000100:00100000:1.0:1789049384.287475:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954110595968 00000100:00100000:1.0:1789049384.287478:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954110595968 00000100:00100000:1.0:1789049384.287506:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 175 00000100:00100000:1.0:1789049384.287512:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8c6bee050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7ef694ec-1ea0-4f02-800c-d1279b4fdf12+17:5848:x1875954110595968:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789049384.287519:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789049384.287548:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cb8c146d200/0xf4f48ce5e1bbedfb lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xf4f48ce5e1bbedf4 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049384.287573:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cb8c146d200/0xf4f48ce5e1bbedfb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf4f48ce5e1bbedf4 expref: 18 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049384.287582:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cb8c146d200/0xf4f48ce5e1bbedfb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf4f48ce5e1bbedf4 expref: 18 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049384.287590:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cb8c146d200, rc 0) 00000100:00100000:1.0:1789049384.287620:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8c6bee050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7ef694ec-1ea0-4f02-800c-d1279b4fdf12+18:5848:x1875954110595968:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 108us (168us total) trans 0 rc 0/0 00000100:00100000:1.0:1789049384.287626:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 175 00000100:00100000:1.0:1789049384.287651:0:5848:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb8d0ab6300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7ef694ec-1ea0-4f02-800c-d1279b4fdf12:5848:1875954110595968:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789049384.287661:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.126@tcp lock: ffff8cb8c146c200/0xf4f48ce5e1bbedf4 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf4f48ce5e1bbedfb expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049384.287670:0:5848:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.126@tcp lock: ffff8cb8c146c200/0xf4f48ce5e1bbedf4 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xf4f48ce5e1bbedfb expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789049384.287704:0:5848:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb8d0ab6300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7ef694ec-1ea0-4f02-800c-d1279b4fdf12:5848:1875954110596096:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789049384.287726:0:5848:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789049384.287738:0:5848:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cb900aa8f00 going to sleep for 11 seconds 00000100:00100000:1.0:1789049384.287749:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954110596096 00000100:00100000:1.0:1789049384.287752:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954110596096 00000100:00100000:1.0:1789049384.287770:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 176 00000100:00100000:1.0:1789049384.287776:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8c6bef050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7ef694ec-1ea0-4f02-800c-d1279b4fdf12+18:5848:x1875954110596096:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789049384.287965:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8c6bef050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7ef694ec-1ea0-4f02-800c-d1279b4fdf12+18:5848:x1875954110596096:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 188us (237us total) trans 0 rc 0/0 00000100:00100000:1.0:1789049384.287980:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 176 00000100:00100000:1.0:1789049384.288013:0:5848:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb8d0ab6300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7ef694ec-1ea0-4f02-800c-d1279b4fdf12:5848:1875954110596096:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789049384.288037:0:5848:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb8d0ab6300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7ef694ec-1ea0-4f02-800c-d1279b4fdf12:5848:1875954110596224:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789049384.288079:0:5848:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789049384.288094:0:5848:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cb900aa8f00 going to sleep for 11 seconds 00000100:00100000:1.0:1789049384.288106:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954110596224 00000100:00100000:1.0:1789049384.288110:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954110596224 00000100:00100000:1.0:1789049384.288134:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 177 00000100:00100000:1.0:1789049384.288140:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8c6bec050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7ef694ec-1ea0-4f02-800c-d1279b4fdf12+18:5848:x1875954110596224:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789049384.293972:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8c6bec050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7ef694ec-1ea0-4f02-800c-d1279b4fdf12+18:5848:x1875954110596224:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 5825us (5886us total) trans 0 rc 0/0 00000100:00100000:1.0:1789049384.293988:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 177 00000100:00100000:1.0:1789049384.294089:0:5848:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb8d0ab6300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7ef694ec-1ea0-4f02-800c-d1279b4fdf12:5848:1875954110596224:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789049384.297260:0:8563:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb8c633f100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7ef694ec-1ea0-4f02-800c-d1279b4fdf12:8563:1875954110596352:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789049384.297503:0:8563:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789049384.297625:0:8563:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cb8c79f89c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789049384.299001:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954110596352 00000100:00100000:3.0:1789049384.299087:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954110596352 00000100:00100000:3.0:1789049384.299139:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 178 00000100:00100000:3.0:1789049384.299149:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8c6becc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7ef694ec-1ea0-4f02-800c-d1279b4fdf12+18:8563:x1875954110596352:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789049384.299382:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8c6becc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7ef694ec-1ea0-4f02-800c-d1279b4fdf12+18:8563:x1875954110596352:12345-0@lo:502:llog_process_th.0 Request processed in 233us (1878us total) trans 0 rc 0/0 00000100:00100000:3.0:1789049384.299390:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 178 00000100:00100000:0.0:1789049384.300317:0:8563:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb8c633f100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7ef694ec-1ea0-4f02-800c-d1279b4fdf12:8563:1875954110596352:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1789049384.300364:0:8563:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789049384.300375:0:8563:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789049384.300378:0:8563:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:0.0:1789049384.300385:0:8563:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8cb8d1c83000 00000020:00000080:0.0:1789049384.300387:0:8563:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:0.0:1789049384.300481:0:8563:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb8c633f100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7ef694ec-1ea0-4f02-800c-d1279b4fdf12:8563:1875954110596480:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789049384.300550:0:8563:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789049384.300589:0:8563:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cb8c79f89c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789049384.301159:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954110596480 00000100:00100000:1.0:1789049384.301167:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954110596480 00000100:00100000:1.0:1789049384.301215:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 179 00000100:00100000:1.0:1789049384.301224:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8c6bee450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7ef694ec-1ea0-4f02-800c-d1279b4fdf12+18:8563:x1875954110596480:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789049384.301463:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8c6bee450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7ef694ec-1ea0-4f02-800c-d1279b4fdf12+18:8563:x1875954110596480:12345-0@lo:502:llog_process_th.0 Request processed in 240us (926us total) trans 0 rc 0/0 00000100:00100000:1.0:1789049384.301471:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 179 00000100:00100000:0.0:1789049384.301589:0:8563:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb8c633f100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7ef694ec-1ea0-4f02-800c-d1279b4fdf12:8563:1875954110596480:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1789049384.301625:0:8563:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789049384.301632:0:8563:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789049384.301634:0:8563:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:0.0:1789049384.301637:0:8563:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:1.0:1789049384.301695:0:5848:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:1.0:1789049384.301717:0:5848:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.126@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1789049384.301727:0:5848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.126@tcp lock: ffff8cb8c146c200/0xf4f48ce5e1bbedf4 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf4f48ce5e1bbedfb expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049384.301753:0:5848:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.126@tcp lock: ffff8cb8c146c200/0xf4f48ce5e1bbedf4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf4f48ce5e1bbedfb expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789049384.301766:0:5848:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1789049384.301769:0:5848:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8cb8e01c3000 from 4 10000000:01000000:1.0:1789049384.301773:0:5848:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1789049384.301801:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.126@tcp lock: ffff8cb8c146d800/0xf4f48ce5e1bbee02 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049384.301809:0:5848:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.126@tcp lock: ffff8cb8c146d800/0xf4f48ce5e1bbee02 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049384.301818:0:5848:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.126@tcp lock: ffff8cb8c146d800/0xf4f48ce5e1bbee02 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789049384.301835:0:5848:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb8d0ab6300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7ef694ec-1ea0-4f02-800c-d1279b4fdf12:5848:1875954110596608:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1789049384.301912:0:5848:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789049384.301938:0:5848:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cb900aa8f00 going to sleep for 11 seconds 00000100:00100000:0.0:1789049384.302027:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954110596608 00000100:00100000:0.0:1789049384.302033:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954110596608 00000100:00100000:0.0:1789049384.302071:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 180 00000100:00100000:0.0:1789049384.302079:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8c6bef450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7ef694ec-1ea0-4f02-800c-d1279b4fdf12+18:5848:x1875954110596608:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789049384.302088:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789049384.302111:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cb7c4c38c00/0xf4f48ce5e1bbee09 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xf4f48ce5e1bbee02 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049384.302238:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cb7c4c38c00/0xf4f48ce5e1bbee09 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf4f48ce5e1bbee02 expref: 19 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049384.302252:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cb7c4c38c00/0xf4f48ce5e1bbee09 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf4f48ce5e1bbee02 expref: 19 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049384.302260:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cb7c4c38c00, rc 0) 00000100:00100000:0.0:1789049384.302299:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8c6bef450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7ef694ec-1ea0-4f02-800c-d1279b4fdf12+19:5848:x1875954110596608:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 221us (386us total) trans 0 rc 0/0 00000100:00100000:0.0:1789049384.302316:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 180 00000100:00100000:1.0:1789049384.302819:0:5848:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb8d0ab6300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7ef694ec-1ea0-4f02-800c-d1279b4fdf12:5848:1875954110596608:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789049384.302834:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.126@tcp lock: ffff8cb8c146d800/0xf4f48ce5e1bbee02 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf4f48ce5e1bbee09 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049384.302866:0:5848:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.126@tcp lock: ffff8cb8c146d800/0xf4f48ce5e1bbee02 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xf4f48ce5e1bbee09 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789049384.302926:0:5848:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb8d0ab6300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7ef694ec-1ea0-4f02-800c-d1279b4fdf12:5848:1875954110596736:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789049384.302959:0:5848:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789049384.302994:0:5848:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cb900aa8f00 going to sleep for 11 seconds 00000100:00100000:0.0:1789049384.303039:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954110596736 00000100:00100000:0.0:1789049384.303045:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954110596736 00000100:00100000:0.0:1789049384.303086:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 181 00000100:00100000:0.0:1789049384.303093:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8d6af9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7ef694ec-1ea0-4f02-800c-d1279b4fdf12+19:5848:x1875954110596736:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789049384.303354:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8d6af9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7ef694ec-1ea0-4f02-800c-d1279b4fdf12+19:5848:x1875954110596736:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 261us (394us total) trans 0 rc 0/0 00000100:00100000:0.0:1789049384.303362:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 181 00000100:00100000:1.0:1789049384.303376:0:5848:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb8d0ab6300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7ef694ec-1ea0-4f02-800c-d1279b4fdf12:5848:1875954110596736:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789049384.303408:0:5848:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb8d0ab6300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7ef694ec-1ea0-4f02-800c-d1279b4fdf12:5848:1875954110596864:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789049384.303443:0:5848:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789049384.303463:0:5848:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cb900aa8f00 going to sleep for 11 seconds 00000100:00100000:0.0:1789049384.303481:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954110596864 00000100:00100000:0.0:1789049384.303486:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954110596864 00000100:00100000:0.0:1789049384.303515:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 182 00000100:00100000:0.0:1789049384.303521:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8d6afb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7ef694ec-1ea0-4f02-800c-d1279b4fdf12+19:5848:x1875954110596864:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789049384.303750:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8d6afb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7ef694ec-1ea0-4f02-800c-d1279b4fdf12+19:5848:x1875954110596864:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 227us (304us total) trans 0 rc 0/0 00000100:00100000:0.0:1789049384.303758:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 182 00000100:00100000:1.0:1789049384.303761:0:5848:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb8d0ab6300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7ef694ec-1ea0-4f02-800c-d1279b4fdf12:5848:1875954110596864:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789049384.304266:0:8566:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb8c633f100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7ef694ec-1ea0-4f02-800c-d1279b4fdf12:8566:1875954110596992:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789049384.304305:0:8566:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789049384.304330:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954110596992 00000100:00100000:0.0:1789049384.304335:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954110596992 00000100:00100000:0.0:1789049384.304364:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 183 00000100:00100000:0.0:1789049384.304373:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8d11e1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7ef694ec-1ea0-4f02-800c-d1279b4fdf12+19:8566:x1875954110596992:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789049384.304546:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8d11e1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7ef694ec-1ea0-4f02-800c-d1279b4fdf12+19:8566:x1875954110596992:12345-0@lo:502:llog_process_th.0 Request processed in 163us (229us total) trans 0 rc 0/0 00000100:00100000:0.0:1789049384.304554:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 183 00000100:00100000:0.0:1789049384.304590:0:8566:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cb8c79f8780 going to sleep for 11 seconds 00000100:00100000:0.0:1789049384.304678:0:8566:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb8c633f100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7ef694ec-1ea0-4f02-800c-d1279b4fdf12:8566:1875954110596992:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1789049384.304911:0:8566:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789049384.304921:0:8566:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789049384.304923:0:8566:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:0.0:1789049384.304930:0:8566:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8cb8e01c3000 00000020:00000080:0.0:1789049384.304933:0:8566:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:0.0:1789049384.304997:0:8566:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb8c633f100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7ef694ec-1ea0-4f02-800c-d1279b4fdf12:8566:1875954110597120:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789049384.305037:0:8566:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789049384.305079:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954110597120 00000100:00100000:0.0:1789049384.305083:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954110597120 00000100:00100000:0.0:1789049384.305125:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 184 00000100:00100000:0.0:1789049384.305133:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8d11e2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7ef694ec-1ea0-4f02-800c-d1279b4fdf12+19:8566:x1875954110597120:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789049384.305277:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8d11e2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7ef694ec-1ea0-4f02-800c-d1279b4fdf12+19:8566:x1875954110597120:12345-0@lo:502:llog_process_th.0 Request processed in 144us (239us total) trans 0 rc 0/0 00000100:00100000:0.0:1789049384.305284:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 184 00000100:00100000:0.0:1789049384.305336:0:8566:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cb8d00dacc0 going to sleep for 11 seconds 00000100:00100000:0.0:1789049384.305430:0:8566:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb8c633f100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7ef694ec-1ea0-4f02-800c-d1279b4fdf12:8566:1875954110597120:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1789049384.305458:0:8566:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789049384.305463:0:8566:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789049384.305465:0:8566:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:0.0:1789049384.305469:0:8566:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:1.0:1789049384.305947:0:5848:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:1.0:1789049384.305966:0:5848:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.126@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1789049384.305975:0:5848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.126@tcp lock: ffff8cb8c146d800/0xf4f48ce5e1bbee02 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf4f48ce5e1bbee09 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049384.305986:0:5848:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.126@tcp lock: ffff8cb8c146d800/0xf4f48ce5e1bbee02 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf4f48ce5e1bbee09 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789049384.348108:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789049384.348138:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb8d0aac000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1875954110597248:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789049384.348196:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789049384.348242:0:6707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954110597248 00000100:00100000:2.0:1789049384.348249:0:6707:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954110597248 00000100:00100000:2.0:1789049384.348309:0:6707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1789049384.348317:0:6707:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8d0aac700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1875954110597248:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1789049384.348350:0:6707:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789049384.348388:0:6707:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8d0aac700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1875954110597248:12345-0@lo:13:osp-pre-1-0.0 Request processed in 71us (191us total) trans 0 rc 0/0 00000100:00100000:2.0:1789049384.348395:0:6707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00080000:2.0:1789049384.348413:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:2.0:1789049384.348438:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cb8d0aac000 x1875954110597248/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789049400 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789049384.348456:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb8d0aac000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1875954110597248:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789049384.349111:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb8c633fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1875954110597632:0@lo:400:kworker.0 00000100:00100000:0.0:1789049384.349147:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789049384.349169:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789049384.349175:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb8c633c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3310:1875954110597760:0@lo:400:kworker.0 00000100:00100000:0.0:1789049384.349196:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789049384.349220:0:6705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954110597632 00000100:00100000:0.0:1789049384.349233:0:6705:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954110597632 00000100:00100000:0.0:1789049384.349265:0:6705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1789049384.349272:0:6705:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8c633e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3310:x1875954110597632:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789049384.349307:0:6705:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8c633e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3310:x1875954110597632:12345-0@lo:400:kworker.0 Request processed in 35us (159us total) trans 0 rc 0/0 00000100:00100000:0.0:1789049384.349313:0:6705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1789049384.349329:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954110597760 00000100:00100000:0.0:1789049384.349333:0:5851:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954110597760 00000100:00100000:0.0:1789049384.349359:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1789049384.349365:0:5851:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8c633ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1875954110597760:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789049384.349390:0:5851:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8c633ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1875954110597760:12345-0@lo:400:kworker.0 Request processed in 26us (193us total) trans 0 rc 0/0 00000100:00100000:0.0:1789049384.349396:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00080000:0.0:1789049384.349412:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789049384.349431:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb8c633c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3310:1875954110597760:0@lo:400:kworker.0 00010000:00080000:0.0:1789049384.349441:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cb8c633fb80 x1875954110597632/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789049400 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789049384.349450:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb8c633fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1875954110597632:0@lo:400:kworker.0 00000100:00100000:3.0:1789049384.349559:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb8c633e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3309:1875954110597504:0@lo:400:kworker.0 00000100:00100000:3.0:1789049384.349587:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789049384.349607:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789049384.349612:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb8c633f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3309:1875954110597376:0@lo:400:kworker.0 00000100:00100000:3.0:1789049384.349629:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789049384.349650:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954110597504 00000100:00100000:3.0:1789049384.349654:0:5850:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954110597504 00000100:00100000:3.0:1789049384.349682:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954110597376 00000100:00100000:3.0:1789049384.349685:0:5850:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954110597376 00000100:00100000:3.0:1789049384.349699:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1789049384.349705:0:5850:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8df285500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1875954110597504:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789049384.349746:0:5850:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8df285500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1875954110597504:12345-0@lo:400:kworker.0 Request processed in 41us (158us total) trans 0 rc 0/0 00000100:00100000:3.0:1789049384.349752:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1789049384.349765:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1789049384.349771:0:5850:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8df286d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1875954110597376:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789049384.349795:0:5850:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8df286d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1875954110597376:12345-0@lo:400:kworker.0 Request processed in 26us (165us total) trans 0 rc 0/0 00000100:00100000:3.0:1789049384.349801:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00080000:3.0:1789049384.349821:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789049384.349839:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb8c633f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3309:1875954110597376:0@lo:400:kworker.0 00000100:00100000:3.0:1789049384.349875:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb8c633e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3309:1875954110597504:0@lo:400:kworker.0 00000100:00100000:0.0:1789049384.455925:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.26@tcp (source: 12345-192.168.206.26@tcp) 00000100:00100000:0.0:1789049384.455963:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954089596672 00000100:00100000:0.0:1789049384.455972:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954089596672 00000100:00100000:0.0:1789049384.456024:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.26@tcp, seq: 185 00000100:00100000:0.0:1789049384.456034:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8d11e0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:de93d576-ed8d-4d27-ab00-9189a62cea33+9:5598:x1875954089596672:12345-192.168.206.26@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789049384.456052:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789049384.456070:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cb7c4c38800/0xf4f48ce5e1bbee10 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x7fc5e358805a32b1 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049384.456111:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cb7c4c38800/0xf4f48ce5e1bbee10 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a32b1 expref: 10 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049384.456122:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cb7c4c38800/0xf4f48ce5e1bbee10 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a32b1 expref: 10 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049384.456131:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cb7c4c38800, rc 0) 00000100:00100000:0.0:1789049384.456182:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8d11e0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:de93d576-ed8d-4d27-ab00-9189a62cea33+10:5598:x1875954089596672:12345-192.168.206.26@tcp:101:ll_cfg_requeue.0 Request processed in 150us (264us total) trans 0 rc 0/0 00000100:00100000:0.0:1789049384.456189:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.26@tcp, seq: 185 00000100:00100000:2.0:1789049384.471691:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.26@tcp (source: 12345-192.168.206.26@tcp) 00000100:00100000:3.0:1789049384.472133:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954089596800 00000100:00100000:3.0:1789049384.472143:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954089596800 00000100:00100000:2.0:1789049384.476860:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.26@tcp, seq: 186 00000100:00100000:2.0:1789049384.476875:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8d11e1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:de93d576-ed8d-4d27-ab00-9189a62cea33+10:5598:x1875954089596800:12345-192.168.206.26@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789049384.477839:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8d11e1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:de93d576-ed8d-4d27-ab00-9189a62cea33+10:5598:x1875954089596800:12345-192.168.206.26@tcp:501:ll_cfg_requeue.0 Request processed in 960us (6231us total) trans 0 rc 0/0 00000100:00100000:2.0:1789049384.477875:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.26@tcp, seq: 186 00000100:00100000:1.0:1789049384.491156:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.26@tcp (source: 12345-192.168.206.26@tcp) 00000100:00100000:2.0:1789049384.491239:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954089596928 00000100:00100000:2.0:1789049384.491251:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954089596928 00000100:00100000:2.0:1789049384.491322:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.26@tcp, seq: 187 00000100:00100000:2.0:1789049384.491333:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8d11e2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:de93d576-ed8d-4d27-ab00-9189a62cea33+10:5598:x1875954089596928:12345-192.168.206.26@tcp:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789049384.495074:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8d11e2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:de93d576-ed8d-4d27-ab00-9189a62cea33+10:5598:x1875954089596928:12345-192.168.206.26@tcp:503:ll_cfg_requeue.0 Request processed in 3733us (3916us total) trans 0 rc 0/0 00000100:00100000:2.0:1789049384.495100:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.26@tcp, seq: 187 00000100:00100000:1.0:1789049384.505817:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.26@tcp (source: 12345-192.168.206.26@tcp) 00000100:00100000:2.0:1789049384.505929:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954089597056 00000100:00100000:2.0:1789049384.505942:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954089597056 00000100:00100000:2.0:1789049384.506010:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.26@tcp, seq: 188 00000100:00100000:2.0:1789049384.506020:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8d11e2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:de93d576-ed8d-4d27-ab00-9189a62cea33+10:6123:x1875954089597056:12345-192.168.206.26@tcp:502:llog_process_th.0 00000100:00100000:2.0:1789049384.506261:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8d11e2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:de93d576-ed8d-4d27-ab00-9189a62cea33+10:6123:x1875954089597056:12345-192.168.206.26@tcp:502:llog_process_th.0 Request processed in 241us (452us total) trans 0 rc 0/0 00000100:00100000:2.0:1789049384.506278:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.26@tcp, seq: 188 00000100:00100000:2.0:1789049384.518895:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.26@tcp (source: 12345-192.168.206.26@tcp) 00000100:00100000:0.0:1789049384.519078:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954089597184 00000100:00100000:0.0:1789049384.519088:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954089597184 00000100:00100000:2.0:1789049384.519224:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.26@tcp, seq: 189 00000100:00100000:2.0:1789049384.519236:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8d11e3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:de93d576-ed8d-4d27-ab00-9189a62cea33+10:6123:x1875954089597184:12345-192.168.206.26@tcp:502:llog_process_th.0 00000100:00100000:2.0:1789049384.519469:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8d11e3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:de93d576-ed8d-4d27-ab00-9189a62cea33+10:6123:x1875954089597184:12345-192.168.206.26@tcp:502:llog_process_th.0 Request processed in 235us (583us total) trans 0 rc 0/0 00000100:00100000:2.0:1789049384.519478:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.26@tcp, seq: 189 00010000:00010000:2.0:1789049384.677426:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789049385.691251:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789049386.715554:0:6719:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789049387.740013:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789049387.845292:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.26@tcp (source: 12345-192.168.206.26@tcp) 00000100:00100000:1.0:1789049387.845608:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.26@tcp (source: 12345-192.168.206.26@tcp) 00000100:00100000:1.0:1789049387.845640:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.26@tcp (source: 12345-192.168.206.26@tcp) 00000100:00100000:1.0:1789049387.845678:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.26@tcp (source: 12345-192.168.206.26@tcp) 00000100:00100000:1.0:1789049387.845715:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954089597568 00000100:00100000:1.0:1789049387.845725:0:6704:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954089597568 00000100:00100000:1.0:1789049387.845801:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954089597696 00000100:00100000:1.0:1789049387.845805:0:6704:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954089597696 00000100:00100000:1.0:1789049387.845832:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.26@tcp, seq: 14 00000100:00100000:1.0:1789049387.845874:0:6704:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8d0ab6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e823b53a-3591-475c-8624-c682227e5c13+5:2358:x1875954089597568:12345-192.168.206.26@tcp:400:kworker.0 00000100:00100000:1.0:1789049387.845946:0:6704:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8d0ab6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e823b53a-3591-475c-8624-c682227e5c13+5:2358:x1875954089597568:12345-192.168.206.26@tcp:400:kworker.0 Request processed in 105us (340us total) trans 0 rc 0/0 00000100:00100000:1.0:1789049387.845964:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.26@tcp, seq: 14 00000100:00100000:1.0:1789049387.845981:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.26@tcp, seq: 15 00000100:00100000:1.0:1789049387.845988:0:6704:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8fce95c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e823b53a-3591-475c-8624-c682227e5c13+5:2358:x1875954089597696:12345-192.168.206.26@tcp:400:kworker.0 00000100:00100000:1.0:1789049387.846016:0:6704:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8fce95c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e823b53a-3591-475c-8624-c682227e5c13+5:2358:x1875954089597696:12345-192.168.206.26@tcp:400:kworker.0 Request processed in 29us (340us total) trans 0 rc 0/0 00000100:00100000:1.0:1789049387.846022:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.26@tcp, seq: 15 00000100:00100000:1.0:1789049387.846043:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954089597440 00000100:00100000:1.0:1789049387.846046:0:5850:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954089597440 00000100:00100000:1.0:1789049387.846079:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.26@tcp, seq: 30 00000100:00100000:1.0:1789049387.846086:0:5850:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8d0ab5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e823b53a-3591-475c-8624-c682227e5c13+6:2358:x1875954089597440:12345-192.168.206.26@tcp:400:kworker.0 00000100:00100000:1.0:1789049387.846114:0:5850:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8d0ab5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e823b53a-3591-475c-8624-c682227e5c13+6:2358:x1875954089597440:12345-192.168.206.26@tcp:400:kworker.0 Request processed in 29us (473us total) trans 0 rc 0/0 00000100:00100000:1.0:1789049387.846121:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.26@tcp, seq: 30 00000100:00080000:1.0:1789049387.846141:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789049387.846146:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789049387.846148:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789049387.847705:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954089597312 00000100:00100000:0.0:1789049387.847719:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954089597312 00000100:00100000:1.0:1789049387.852860:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.26@tcp, seq: 190 00000100:00100000:1.0:1789049387.852877:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8d11e0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:de93d576-ed8d-4d27-ab00-9189a62cea33+10:2358:x1875954089597312:12345-192.168.206.26@tcp:400:kworker.0 00000100:00100000:1.0:1789049387.855140:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8d11e0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:de93d576-ed8d-4d27-ab00-9189a62cea33+10:2358:x1875954089597312:12345-192.168.206.26@tcp:400:kworker.0 Request processed in 2256us (9844us total) trans 0 rc 0/0 00000100:00100000:1.0:1789049387.855153:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.26@tcp, seq: 190 00000100:00100000:3.0:1789049388.446071:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb8df284000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1875954110597888:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789049388.446138:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789049388.446216:0:6707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954110597888 00000100:00100000:3.0:1789049388.446224:0:6707:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954110597888 00000100:00100000:3.0:1789049388.446281:0:6707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1789049388.446290:0:6707:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8df285180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1875954110597888:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789049388.446325:0:6707:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789049388.446386:0:6707:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8df285180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1875954110597888:12345-0@lo:13:osp-pre-0-0.0 Request processed in 98us (250us total) trans 0 rc 0/0 00000100:00100000:3.0:1789049388.446393:0:6707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00080000:3.0:1789049388.446412:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1789049388.446441:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cb8df284000 x1875954110597888/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789049404 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789049388.446469:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb8df284000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1875954110597888:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1789049388.763767:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789049389.467059:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb8c633dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1875954110598400:0@lo:400:kworker.0 00000100:00100000:0.0:1789049389.467129:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789049389.467199:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1789049389.467205:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb8c633fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7ef694ec-1ea0-4f02-800c-d1279b4fdf12:3308:1875954110598016:0@lo:400:kworker.0 00000100:00100000:0.0:1789049389.467236:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789049389.467258:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb8c633ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3308:1875954110598528:0@lo:400:kworker.0 00000100:00100000:0.0:1789049389.467283:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789049389.467309:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb8c633c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3310:1875954110598144:0@lo:400:kworker.0 00000100:00100000:0.0:1789049389.467331:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789049389.467348:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb8c633ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1875954110598656:0@lo:400:kworker.0 00000100:00100000:0.0:1789049389.467367:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789049389.467398:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789049389.467404:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb8c633f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3310:1875954110598272:0@lo:400:kworker.0 00000100:00100000:0.0:1789049389.467426:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789049389.467459:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954110598400 00000100:00100000:0.0:1789049389.467468:0:6704:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954110598400 00000100:00100000:0.0:1789049389.467526:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954110598656 00000100:00100000:0.0:1789049389.467529:0:6704:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954110598656 00000100:00100000:0.0:1789049389.467558:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1789049389.467567:0:6704:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8c633c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3308:x1875954110598400:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789049389.467614:0:6704:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8c633c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3308:x1875954110598400:12345-0@lo:400:kworker.0 Request processed in 49us (486us total) trans 0 rc 0/0 00000100:00100000:0.0:1789049389.467622:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1789049389.467637:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1789049389.467644:0:6704:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8c633f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3310:x1875954110598656:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789049389.467675:0:6704:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8c633f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3310:x1875954110598656:12345-0@lo:400:kworker.0 Request processed in 32us (307us total) trans 0 rc 0/0 00000100:00100000:0.0:1789049389.467681:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1789049389.467698:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954110598016 00000100:00100000:0.0:1789049389.467702:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954110598016 00000100:00100000:0.0:1789049389.467727:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 191 00000100:00100000:0.0:1789049389.467733:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8d11e0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7ef694ec-1ea0-4f02-800c-d1279b4fdf12+19:3308:x1875954110598016:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789049389.467769:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8d11e0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7ef694ec-1ea0-4f02-800c-d1279b4fdf12+19:3308:x1875954110598016:12345-0@lo:400:kworker.0 Request processed in 36us (532us total) trans 0 rc 0/0 00000100:00100000:0.0:1789049389.467776:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 191 00000100:00100000:0.0:1789049389.467816:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954110598528 00000100:00100000:0.0:1789049389.467820:0:5852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954110598528 00000100:00100000:0.0:1789049389.467866:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954110598144 00000100:00100000:0.0:1789049389.467870:0:5852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954110598144 00000100:00100000:0.0:1789049389.467909:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954110598272 00000100:00100000:0.0:1789049389.467914:0:5852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954110598272 00000100:00100000:0.0:1789049389.467932:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1789049389.467937:0:5852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8c633d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1875954110598528:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789049389.467970:0:5852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8c633d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1875954110598528:12345-0@lo:400:kworker.0 Request processed in 33us (686us total) trans 0 rc 0/0 00000100:00100000:0.0:1789049389.467977:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1789049389.467995:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1789049389.468003:0:5852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8c633e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1875954110598144:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789049389.468041:0:5852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8c633e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1875954110598144:12345-0@lo:400:kworker.0 Request processed in 40us (708us total) trans 0 rc 0/0 00000100:00100000:0.0:1789049389.468049:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1789049389.468067:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1789049389.468076:0:5852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8c633d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1875954110598272:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789049389.468108:0:5852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8c633d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1875954110598272:12345-0@lo:400:kworker.0 Request processed in 34us (680us total) trans 0 rc 0/0 00000100:00100000:0.0:1789049389.468113:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00080000:0.0:1789049389.468143:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789049389.468147:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789049389.468178:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb8d0aac000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3311:1875954110598784:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789049389.468181:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb8c633f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3310:1875954110598272:0@lo:400:kworker.0 00000100:00100000:0.0:1789049389.468197:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb8c633c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3310:1875954110598144:0@lo:400:kworker.0 00010000:00080000:0.0:1789049389.468211:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cb8c633ce00 x1875954110598656/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789049405 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789049389.468223:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb8c633ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1875954110598656:0@lo:400:kworker.0 00000100:00100000:2.0:1789049389.468224:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789049389.468266:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb8c633fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7ef694ec-1ea0-4f02-800c-d1279b4fdf12:3308:1875954110598016:0@lo:400:kworker.0 00000100:00100000:2.0:1789049389.468272:0:6707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954110598784 00000100:00100000:2.0:1789049389.468278:0:6707:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954110598784 00000100:00100000:0.0:1789049389.468292:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb8c633ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3308:1875954110598528:0@lo:400:kworker.0 00010000:00080000:0.0:1789049389.468307:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cb8c633dc00 x1875954110598400/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789049405 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789049389.468318:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb8c633dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1875954110598400:0@lo:400:kworker.0 00000100:00100000:2.0:1789049389.468383:0:6707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1789049389.468394:0:6707:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8d0aace00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1875954110598784:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1789049389.468423:0:6707:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789049389.468475:0:6707:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8d0aace00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1875954110598784:12345-0@lo:13:osp-pre-1-0.0 Request processed in 83us (254us total) trans 0 rc 0/0 00000100:00100000:2.0:1789049389.468482:0:6707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00010000:00080000:0.0:1789049389.468547:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cb8d0aac000 x1875954110598784/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789049405 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789049389.468563:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb8d0aac000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3311:1875954110598784:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1789049389.786962:0:6719:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1789049390.021986:0:8826:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg626-server.virtnet: executing check_logdir /tmp/testlogs/ 00010000:00010000:2.0:1789049390.820808:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789049391.838021:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789049392.862182:0:6719:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789049392.963624:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.26@tcp (source: 12345-192.168.206.26@tcp) 00000100:00100000:0.0:1789049392.963668:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.26@tcp (source: 12345-192.168.206.26@tcp) 00000100:00100000:0.0:1789049392.963703:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.26@tcp (source: 12345-192.168.206.26@tcp) 00000100:00100000:0.0:1789049392.963734:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.26@tcp (source: 12345-192.168.206.26@tcp) 00000100:00100000:0.0:1789049392.963765:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954089597952 00000100:00100000:0.0:1789049392.963779:0:5852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954089597952 00000100:00100000:0.0:1789049392.963874:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.26@tcp, seq: 34 00000100:00100000:0.0:1789049392.963887:0:5852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8c633ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e823b53a-3591-475c-8624-c682227e5c13+6:2355:x1875954089597952:12345-192.168.206.26@tcp:400:kworker.0 00000100:00100000:3.0:1789049392.964019:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954089598080 00000100:00100000:3.0:1789049392.964024:0:6704:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954089598080 00000100:00100000:0.0:1789049392.964036:0:5852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8c633ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e823b53a-3591-475c-8624-c682227e5c13+6:2355:x1875954089597952:12345-192.168.206.26@tcp:400:kworker.0 Request processed in 153us (332us total) trans 0 rc 0/0 00000100:00100000:0.0:1789049392.964046:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.26@tcp, seq: 34 00000100:00100000:3.0:1789049392.964056:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954089598208 00000100:00100000:3.0:1789049392.964058:0:6704:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954089598208 00000100:00100000:0.0:1789049392.964073:0:6705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.26@tcp, seq: 18 00000100:00100000:0.0:1789049392.964080:0:6705:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8c633dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e823b53a-3591-475c-8624-c682227e5c13+5:2355:x1875954089598080:12345-192.168.206.26@tcp:400:kworker.0 00000100:00100000:0.0:1789049392.964109:0:6705:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8c633dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e823b53a-3591-475c-8624-c682227e5c13+5:2355:x1875954089598080:12345-192.168.206.26@tcp:400:kworker.0 Request processed in 29us (440us total) trans 0 rc 0/0 00000100:00100000:1.0:1789049392.964125:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954089597824 00000100:00100000:1.0:1789049392.964130:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954089597824 00000100:00100000:1.0:1789049392.964163:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.26@tcp, seq: 192 00000100:00100000:1.0:1789049392.964171:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8c6b82050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:de93d576-ed8d-4d27-ab00-9189a62cea33+10:2355:x1875954089597824:12345-192.168.206.26@tcp:400:kworker.0 00000100:00100000:1.0:1789049392.964208:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8c6b82050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:de93d576-ed8d-4d27-ab00-9189a62cea33+10:2355:x1875954089597824:12345-192.168.206.26@tcp:400:kworker.0 Request processed in 39us (600us total) trans 0 rc 0/0 00000100:00100000:1.0:1789049392.964215:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.26@tcp, seq: 192 00000100:00080000:1.0:1789049392.964402:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789049392.964407:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1789049392.964410:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789049392.967652:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.26@tcp, seq: 19 00000100:00100000:3.0:1789049392.967682:0:6704:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8c633fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e823b53a-3591-475c-8624-c682227e5c13+5:2355:x1875954089598208:12345-192.168.206.26@tcp:400:kworker.0 00000100:00100000:3.0:1789049392.967787:0:6704:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8c633fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e823b53a-3591-475c-8624-c682227e5c13+5:2355:x1875954089598208:12345-192.168.206.26@tcp:400:kworker.0 Request processed in 120us (4051us total) trans 0 rc 0/0 00000100:00100000:3.0:1789049392.967796:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.26@tcp, seq: 19 00000100:00100000:0.0:1789049392.970860:0:6705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.26@tcp, seq: 18 00000100:00100000:0.0:1789049393.576324:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb8c633ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1875954110598912:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789049393.576417:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789049393.576506:0:6707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954110598912 00000100:00100000:2.0:1789049393.576519:0:6707:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954110598912 00000100:00100000:2.0:1789049393.576605:0:6707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1789049393.576615:0:6707:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8c633c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1875954110598912:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789049393.576660:0:6707:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789049393.576730:0:6707:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8c633c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1875954110598912:12345-0@lo:13:osp-pre-0-0.0 Request processed in 116us (313us total) trans 0 rc 0/0 00000100:00100000:2.0:1789049393.576738:0:6707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00010000:00080000:2.0:1789049393.576789:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cb8c633ce00 x1875954110598912/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789049409 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789049393.576810:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb8c633ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1875954110598912:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1789049393.576999:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1789049393.885241:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789049394.587425:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789049394.587461:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb8c633f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1875954110599040:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789049394.587577:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789049394.587791:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb8fce94e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3311:1875954110599296:0@lo:400:kworker.0 00000100:00100000:1.0:1789049394.587828:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789049394.587895:0:6707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954110599040 00000100:00100000:0.0:1789049394.587897:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb8fce94a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7ef694ec-1ea0-4f02-800c-d1279b4fdf12:3310:1875954110599168:0@lo:400:kworker.0 00000100:00100000:2.0:1789049394.587907:0:6707:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954110599040 00000100:00100000:2.0:1789049394.587993:0:6707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1789049394.588007:0:6707:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8c633df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1875954110599040:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1789049394.588068:0:6707:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789049394.589546:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954110599296 00000100:00100000:1.0:1789049394.589561:0:5850:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954110599296 00000100:00100000:1.0:1789049394.589633:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1789049394.589645:0:5850:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8fce96d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1875954110599296:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789049394.589790:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789049394.589826:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb8fce94000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3310:1875954110599680:0@lo:400:kworker.0 00000100:00100000:0.0:1789049394.589873:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789049394.590026:0:6707:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8c633df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1875954110599040:12345-0@lo:13:osp-pre-1-0.0 Request processed in 2022us (2447us total) trans 0 rc 0/0 00000100:00100000:2.0:1789049394.590037:0:6707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00080000:2.0:1789049394.590067:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789049394.590361:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954110599168 00000100:00100000:0.0:1789049394.590367:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954110599168 00000100:00100000:0.0:1789049394.590404:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 193 00000100:00100000:0.0:1789049394.590411:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8c6b83050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7ef694ec-1ea0-4f02-800c-d1279b4fdf12+19:3310:x1875954110599168:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789049394.590453:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8c6b83050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7ef694ec-1ea0-4f02-800c-d1279b4fdf12+19:3310:x1875954110599168:12345-0@lo:400:kworker.0 Request processed in 43us (663us total) trans 0 rc 0/0 00000100:00100000:0.0:1789049394.590459:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 193 00000100:00100000:0.0:1789049394.590498:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954110599680 00000100:00100000:0.0:1789049394.590501:0:5852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954110599680 00000100:00100000:0.0:1789049394.590537:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1789049394.590543:0:5852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8c633ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1875954110599680:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789049394.590573:0:5852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8c633ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1875954110599680:12345-0@lo:400:kworker.0 Request processed in 30us (699us total) trans 0 rc 0/0 00000100:00100000:0.0:1789049394.590579:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00080000:0.0:1789049394.590592:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789049394.590618:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb8fce94a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7ef694ec-1ea0-4f02-800c-d1279b4fdf12:3310:1875954110599168:0@lo:400:kworker.0 00000100:00100000:0.0:1789049394.590645:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb8fce94000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3310:1875954110599680:0@lo:400:kworker.0 00000100:00100000:0.0:1789049394.590693:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb8fce95500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3309:1875954110599552:0@lo:400:kworker.0 00000100:00100000:0.0:1789049394.590723:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789049394.590745:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1789049394.590751:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb8fce94700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3309:1875954110599424:0@lo:400:kworker.0 00000100:00100000:0.0:1789049394.590772:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789049394.590796:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954110599552 00000100:00100000:0.0:1789049394.590800:0:6704:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954110599552 00000100:00100000:0.0:1789049394.590828:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1789049394.590835:0:6704:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8c633ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3309:x1875954110599552:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789049394.591413:0:5850:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8fce96d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1875954110599296:12345-0@lo:400:kworker.0 Request processed in 1766us (3580us total) trans 0 rc 0/0 00000100:00100000:1.0:1789049394.591423:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1789049394.591442:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954110599424 00000100:00100000:1.0:1789049394.591445:0:5850:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954110599424 00000100:00100000:1.0:1789049394.591495:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1789049394.591502:0:5850:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8f73c7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1875954110599424:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789049394.591536:0:5850:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8f73c7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1875954110599424:12345-0@lo:400:kworker.0 Request processed in 34us (763us total) trans 0 rc 0/0 00000100:00100000:1.0:1789049394.591542:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00080000:1.0:1789049394.591569:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789049394.591598:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb8fce94e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3311:1875954110599296:0@lo:400:kworker.0 00000100:00100000:0.0:1789049394.591885:0:6704:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8c633ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3309:x1875954110599552:12345-0@lo:400:kworker.0 Request processed in 1048us (1159us total) trans 0 rc 0/0 00000100:00100000:0.0:1789049394.591966:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1789049394.592018:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb8fce94700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3309:1875954110599424:0@lo:400:kworker.0 00010000:00080000:0.0:1789049394.592035:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cb8fce95500 x1875954110599552/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789049410 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789049394.592046:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb8fce95500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3309:1875954110599552:0@lo:400:kworker.0 00010000:00080000:0.0:1789049394.592079:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cb8c633f480 x1875954110599040/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789049410 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789049394.592099:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb8c633f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1875954110599040:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1789049394.908083:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1789049395.153297:0:9069:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg626-server.virtnet: executing yml_node 00010000:00010000:2.0:1789049395.936507:0:6719:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789049396.955205:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789049397.981521:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789049398.088510:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.26@tcp (source: 12345-192.168.206.26@tcp) 00000100:00100000:1.0:1789049398.088616:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954089598336 00000100:00100000:1.0:1789049398.088625:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954089598336 00000100:00100000:1.0:1789049398.088685:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.26@tcp, seq: 194 00000100:00100000:1.0:1789049398.088695:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8c6b80050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:de93d576-ed8d-4d27-ab00-9189a62cea33+10:2358:x1875954089598336:12345-192.168.206.26@tcp:400:kworker.0 00000100:00100000:1.0:1789049398.088770:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8c6b80050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:de93d576-ed8d-4d27-ab00-9189a62cea33+10:2358:x1875954089598336:12345-192.168.206.26@tcp:400:kworker.0 Request processed in 76us (268us total) trans 0 rc 0/0 00000100:00100000:1.0:1789049398.088777:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.26@tcp, seq: 194 00000100:00100000:3.0:1789049398.095190:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.26@tcp (source: 12345-192.168.206.26@tcp) 00000100:00100000:1.0:1789049398.095363:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954089598464 00000100:00100000:1.0:1789049398.095373:0:5850:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954089598464 00000100:00100000:1.0:1789049398.095471:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.26@tcp, seq: 38 00000100:00100000:1.0:1789049398.095483:0:5850:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8df284000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e823b53a-3591-475c-8624-c682227e5c13+6:2358:x1875954089598464:12345-192.168.206.26@tcp:400:kworker.0 00000100:00100000:1.0:1789049398.095566:0:5850:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8df284000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e823b53a-3591-475c-8624-c682227e5c13+6:2358:x1875954089598464:12345-192.168.206.26@tcp:400:kworker.0 Request processed in 85us (387us total) trans 0 rc 0/0 00000100:00100000:1.0:1789049398.095573:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.26@tcp, seq: 38 00000100:00080000:0.0:1789049398.095651:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789049398.107417:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.26@tcp (source: 12345-192.168.206.26@tcp) 00000100:00100000:2.0:1789049398.107468:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.26@tcp (source: 12345-192.168.206.26@tcp) 00000100:00100000:3.0:1789049398.107559:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954089598592 00000100:00100000:3.0:1789049398.107569:0:6704:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954089598592 00000100:00100000:3.0:1789049398.107638:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954089598720 00000100:00100000:3.0:1789049398.107642:0:6704:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954089598720 00000100:00100000:3.0:1789049398.107662:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.26@tcp, seq: 10 00000100:00100000:3.0:1789049398.107673:0:6704:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8d0aaf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e823b53a-3591-475c-8624-c682227e5c13+5:2354:x1875954089598592:12345-192.168.206.26@tcp:9:kworker.0 00000100:00080000:1.0:1789049398.107691:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789049398.107697:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000020:00000080:3.0:1789049398.107712:0:6704:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xf4f48ce5e1bbed4c 00000100:00080000:3.0:1789049398.107723:0:6704:0:(import.c:65:import_set_state_nolock()) ffff8cb8c6bc2800 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1789049398.107770:0:6704:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:3.0:1789049398.108116:0:6704:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8d0aaf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e823b53a-3591-475c-8624-c682227e5c13+2:2354:x1875954089598592:12345-192.168.206.26@tcp:9:kworker.0 Request processed in 445us (707us total) trans 0 rc 0/0 00000100:00100000:3.0:1789049398.108124:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.26@tcp, seq: 10 00000100:00100000:3.0:1789049398.108155:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.26@tcp, seq: 11 00000100:00100000:3.0:1789049398.108163:0:6704:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8d0aaea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e823b53a-3591-475c-8624-c682227e5c13+5:2354:x1875954089598720:12345-192.168.206.26@tcp:9:kworker.0 00000020:00000080:3.0:1789049398.108177:0:6704:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xf4f48ce5e1bbed53 00000100:00080000:3.0:1789049398.108184:0:6704:0:(import.c:65:import_set_state_nolock()) ffff8cb8c6bc0800 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1789049398.108204:0:6704:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:3.0:1789049398.108402:0:6704:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8d0aaea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e823b53a-3591-475c-8624-c682227e5c13+2:2354:x1875954089598720:12345-192.168.206.26@tcp:9:kworker.0 Request processed in 239us (943us total) trans 0 rc 0/0 00000100:00100000:3.0:1789049398.108409:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.26@tcp, seq: 11 00010000:00010000:1.0:1789049398.108885:0:6719:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789049398.108893:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789049398.688158:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789049398.688183:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb8df285f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1875954110599808:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789049398.688252:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789049398.688302:0:6707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954110599808 00000100:00100000:2.0:1789049398.688312:0:6707:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954110599808 00000100:00100000:2.0:1789049398.688369:0:6707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1789049398.688378:0:6707:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8f73c6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1875954110599808:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789049398.688414:0:6707:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789049398.688467:0:6707:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8f73c6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1875954110599808:12345-0@lo:13:osp-pre-0-0.0 Request processed in 78us (202us total) trans 0 rc 0/0 00000100:00100000:2.0:1789049398.688473:0:6707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00080000:1.0:1789049398.688561:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1789049398.688785:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cb8df285f80 x1875954110599808/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789049414 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789049398.689900:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb8df285f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1875954110599808:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1789049399.004471:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1789049399.026394:0:9262:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Client: 2.17.58.40 00000001:00100000:2.0:1789049399.259662:0:6732:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of e823b53a-3591-475c-8624-c682227e5c13 00000020:00000080:2.0:1789049399.259671:0:6732:0:(genops.c:885:class_export_put()) final put ffff8cb8c6bc2000/e823b53a-3591-475c-8624-c682227e5c13 00000020:00000080:0.0:1789049399.259793:0:494:0:(genops.c:844:class_export_destroy()) destroying export ffff8cb8c6bc2000/e823b53a-3591-475c-8624-c682227e5c13 for lustre-OST0000 00000020:00000080:0.0:1789049399.259876:0:494:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8cb8c6bc2800 for lustre-OST0000 00000100:00100000:1.0:1789049399.707269:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1789049399.707292:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb8f73c7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3309:1875954110599936:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789049399.707357:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789049399.707499:0:6707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954110599936 00000100:00100000:3.0:1789049399.707507:0:6707:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954110599936 00000100:00100000:3.0:1789049399.707575:0:6707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1789049399.707585:0:6707:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8fce94e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1875954110599936:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789049399.707620:0:6707:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789049399.707667:0:6707:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8fce94e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1875954110599936:12345-0@lo:13:osp-pre-1-0.0 Request processed in 84us (310us total) trans 0 rc 0/0 00000100:00100000:3.0:1789049399.707675:0:6707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00010000:00080000:3.0:1789049399.707712:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cb8f73c7b80 x1875954110599936/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789049415 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789049399.707729:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb8f73c7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3309:1875954110599936:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789049399.708087:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb8f73c4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:7ef694ec-1ea0-4f02-800c-d1279b4fdf12:3309:1875954110600064:0@lo:400:kworker.0 00000100:00100000:3.0:1789049399.708122:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789049399.708157:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954110600064 00000100:00100000:3.0:1789049399.708162:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954110600064 00000100:00100000:3.0:1789049399.708191:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 195 00000100:00100000:3.0:1789049399.708198:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8c6b80c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7ef694ec-1ea0-4f02-800c-d1279b4fdf12+19:3309:x1875954110600064:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789049399.708248:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8c6b80c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7ef694ec-1ea0-4f02-800c-d1279b4fdf12+19:3309:x1875954110600064:12345-0@lo:400:kworker.0 Request processed in 51us (125us total) trans 0 rc 0/0 00000100:00100000:3.0:1789049399.708255:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 195 00000100:00100000:3.0:1789049399.708289:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb8f73c4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:7ef694ec-1ea0-4f02-800c-d1279b4fdf12:3309:1875954110600064:0@lo:400:kworker.0 00000100:00100000:3.0:1789049399.708321:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb8f73c7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3310:1875954110600192:0@lo:400:kworker.0 00000100:00100000:3.0:1789049399.708345:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789049399.708372:0:6841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954110600192 00000100:00100000:3.0:1789049399.708376:0:6841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954110600192 00000100:00100000:3.0:1789049399.708402:0:6841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1789049399.708408:0:6841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8df285880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1875954110600192:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789049399.708439:0:6841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8df285880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1875954110600192:12345-0@lo:400:kworker.0 Request processed in 31us (93us total) trans 0 rc 0/0 00000100:00100000:3.0:1789049399.708445:0:6841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1789049399.708487:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb8f73c7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3310:1875954110600192:0@lo:400:kworker.0 00000100:00100000:3.0:1789049399.708684:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb8f73c6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3311:1875954110600320:0@lo:400:kworker.0 00000100:00100000:3.0:1789049399.708711:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789049399.708746:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb8f73c7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3309:1875954110600576:0@lo:400:kworker.0 00000100:00100000:3.0:1789049399.708767:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789049399.708784:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789049399.708789:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb8f73c6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3309:1875954110600448:0@lo:400:kworker.0 00000100:00100000:3.0:1789049399.708824:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789049399.708879:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954110600320 00000100:00100000:3.0:1789049399.708884:0:5850:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954110600320 00000100:00100000:3.0:1789049399.708908:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954110600576 00000100:00100000:3.0:1789049399.708911:0:5850:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954110600576 00000100:00100000:3.0:1789049399.708963:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1789049399.708970:0:5850:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8df287100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1875954110600320:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789049399.709009:0:5850:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8df287100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1875954110600320:12345-0@lo:400:kworker.0 Request processed in 40us (297us total) trans 0 rc 0/0 00000100:00100000:3.0:1789049399.709016:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1789049399.709029:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1789049399.709036:0:5850:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8df286680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1875954110600576:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789049399.709066:0:5850:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8df286680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1875954110600576:12345-0@lo:400:kworker.0 Request processed in 32us (298us total) trans 0 rc 0/0 00000100:00100000:3.0:1789049399.709071:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1789049399.709090:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954110600448 00000100:00100000:3.0:1789049399.709093:0:6704:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954110600448 00000100:00100000:3.0:1789049399.709118:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1789049399.709124:0:6704:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8df287b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3309:x1875954110600448:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789049399.709151:0:6704:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8df287b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3309:x1875954110600448:12345-0@lo:400:kworker.0 Request processed in 28us (327us total) trans 0 rc 0/0 00000100:00100000:3.0:1789049399.709157:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1789049399.709188:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb8f73c6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3311:1875954110600320:0@lo:400:kworker.0 00010000:00080000:3.0:1789049399.709212:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cb8f73c6300 x1875954110600448/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789049415 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789049399.709221:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb8f73c6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3309:1875954110600448:0@lo:400:kworker.0 00000100:00100000:3.0:1789049399.709230:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb8f73c7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3309:1875954110600576:0@lo:400:kworker.0 00000100:00080000:1.0:1789049399.709477:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789049399.709482:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:1.0:1789049400.028056:0:6719:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789049401.056276:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1789049401.622192:0:9360:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: MDS: 2.17.58.40 00010000:00010000:2.0:1789049402.076499:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1789049402.313214:0:7663:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of e823b53a-3591-475c-8624-c682227e5c13 00000020:00000080:0.0:1789049402.313224:0:7663:0:(genops.c:885:class_export_put()) final put ffff8cb8c6bc5800/e823b53a-3591-475c-8624-c682227e5c13 00000020:00000080:1.0:1789049402.313328:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8cb8c6bc5800/e823b53a-3591-475c-8624-c682227e5c13 for lustre-OST0001 00000020:00000080:1.0:1789049402.313385:0:36:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8cb8c6bc0800 for lustre-OST0001 00010000:00010000:1.0:1789049403.099113:0:6719:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789049403.208214:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.26@tcp (source: 12345-192.168.206.26@tcp) 00000100:00100000:2.0:1789049403.208252:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.26@tcp (source: 12345-192.168.206.26@tcp) 00000100:00100000:0.0:1789049403.208368:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954089598848 00000100:00100000:0.0:1789049403.208378:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954089598848 00000100:00100000:0.0:1789049403.208448:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.26@tcp, seq: 196 00000100:00100000:0.0:1789049403.208458:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8c6b82450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:de93d576-ed8d-4d27-ab00-9189a62cea33+10:2355:x1875954089598848:12345-192.168.206.26@tcp:400:kworker.0 00000100:00100000:0.0:1789049403.208529:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8c6b82450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:de93d576-ed8d-4d27-ab00-9189a62cea33+10:2355:x1875954089598848:12345-192.168.206.26@tcp:400:kworker.0 Request processed in 71us (326us total) trans 0 rc 0/0 00000100:00100000:0.0:1789049403.208536:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.26@tcp, seq: 196 00000100:00100000:3.0:1789049403.208735:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954089598976 00000100:00100000:3.0:1789049403.208740:0:5850:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954089598976 00000100:00100000:3.0:1789049403.208798:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.26@tcp, seq: 42 00000100:00100000:3.0:1789049403.208823:0:5850:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8d0aae300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e823b53a-3591-475c-8624-c682227e5c13+6:2355:x1875954089598976:12345-192.168.206.26@tcp:400:kworker.0 00000100:00100000:3.0:1789049403.208877:0:5850:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8d0aae300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e823b53a-3591-475c-8624-c682227e5c13+6:2355:x1875954089598976:12345-192.168.206.26@tcp:400:kworker.0 Request processed in 57us (623us total) trans 0 rc 0/0 00000100:00100000:3.0:1789049403.208883:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.26@tcp, seq: 42 00000100:00080000:1.0:1789049403.208952:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789049403.804985:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb8df284380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1875954110600704:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789049403.805054:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789049403.805122:0:6707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954110600704 00000100:00100000:3.0:1789049403.805130:0:6707:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954110600704 00000100:00100000:3.0:1789049403.805189:0:6707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1789049403.805197:0:6707:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8df286300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1875954110600704:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789049403.805230:0:6707:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789049403.805274:0:6707:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8df286300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1875954110600704:12345-0@lo:13:osp-pre-0-0.0 Request processed in 78us (221us total) trans 0 rc 0/0 00000100:00100000:3.0:1789049403.805281:0:6707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00010000:00080000:3.0:1789049403.805330:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cb8df284380 x1875954110600704/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789049419 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789049403.805348:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb8df284380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1875954110600704:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1789049403.805439:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1789049404.126679:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1789049404.137132:0:9460:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: OSS: 2.17.58.40 00000100:00100000:0.0:1789049404.827174:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789049404.827204:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb8f73c4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1875954110600832:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789049404.827264:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789049404.827328:0:6707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954110600832 00000100:00100000:2.0:1789049404.827338:0:6707:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954110600832 00000100:00100000:2.0:1789049404.827409:0:6707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1789049404.827420:0:6707:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8f73c7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1875954110600832:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1789049404.827467:0:6707:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789049404.827521:0:6707:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8f73c7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1875954110600832:12345-0@lo:13:osp-pre-1-0.0 Request processed in 97us (250us total) trans 0 rc 0/0 00000100:00100000:1.0:1789049404.827528:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb8fce97100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7ef694ec-1ea0-4f02-800c-d1279b4fdf12:3308:1875954110600960:0@lo:400:kworker.0 00000100:00100000:2.0:1789049404.827531:0:6707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1789049404.827572:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789049404.827579:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb8fce97b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3310:1875954110601216:0@lo:400:kworker.0 00000100:00100000:1.0:1789049404.827602:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb8fce96300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3308:1875954110601472:0@lo:400:kworker.0 00000100:00100000:2.0:1789049404.827619:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789049404.827636:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954110600960 00000100:00100000:1.0:1789049404.827641:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954110600960 00010000:00080000:2.0:1789049404.827676:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cb8f73c4380 x1875954110600832/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789049420 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789049404.827677:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 197 00000100:00100000:1.0:1789049404.827688:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8c624b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7ef694ec-1ea0-4f02-800c-d1279b4fdf12+19:3308:x1875954110600960:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789049404.827701:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb8f73c4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1875954110600832:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789049404.827724:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8c624b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7ef694ec-1ea0-4f02-800c-d1279b4fdf12+19:3308:x1875954110600960:12345-0@lo:400:kworker.0 Request processed in 37us (152us total) trans 0 rc 0/0 00000100:00100000:1.0:1789049404.827730:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 197 00000100:00100000:1.0:1789049404.827759:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789049404.827785:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb8fce97100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7ef694ec-1ea0-4f02-800c-d1279b4fdf12:3308:1875954110600960:0@lo:400:kworker.0 00000100:00100000:1.0:1789049404.827796:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789049404.827801:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb8fce96680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3308:1875954110601088:0@lo:400:kworker.0 00000100:00100000:1.0:1789049404.827821:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789049404.827879:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954110601216 00000100:00100000:1.0:1789049404.827884:0:5851:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954110601216 00000100:00100000:1.0:1789049404.827909:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954110601472 00000100:00100000:1.0:1789049404.827912:0:5851:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954110601472 00000100:00100000:1.0:1789049404.827924:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954110601088 00000100:00100000:1.0:1789049404.827926:0:5851:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954110601088 00000100:00100000:1.0:1789049404.827938:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1789049404.827944:0:5851:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8d0aac380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1875954110601216:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789049404.827985:0:5851:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8d0aac380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1875954110601216:12345-0@lo:400:kworker.0 Request processed in 40us (367us total) trans 0 rc 0/0 00000100:00100000:1.0:1789049404.827991:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1789049404.828004:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1789049404.828010:0:5851:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8fce95f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1875954110601472:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789049404.828046:0:5851:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8fce95f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1875954110601472:12345-0@lo:400:kworker.0 Request processed in 36us (286us total) trans 0 rc 0/0 00000100:00100000:1.0:1789049404.828051:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1789049404.828060:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1789049404.828065:0:5851:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8fce97100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1875954110601088:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789049404.828090:0:5851:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8fce97100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1875954110601088:12345-0@lo:400:kworker.0 Request processed in 21us (264us total) trans 0 rc 0/0 00000100:00100000:1.0:1789049404.828095:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00080000:0.0:1789049404.828121:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789049404.828127:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb8fce96680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3308:1875954110601088:0@lo:400:kworker.0 00000100:00080000:0.0:1789049404.828128:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789049404.828140:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb8fce96300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3308:1875954110601472:0@lo:400:kworker.0 00000100:00100000:2.0:1789049404.828262:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb8fce97b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3310:1875954110601216:0@lo:400:kworker.0 00000100:00100000:2.0:1789049404.828272:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789049404.828277:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb8fce94380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1875954110601344:0@lo:400:kworker.0 00000100:00100000:2.0:1789049404.828316:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789049404.836484:0:6705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954110601344 00000100:00100000:0.0:1789049404.836501:0:6705:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954110601344 00000100:00100000:0.0:1789049404.836575:0:6705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1789049404.836585:0:6705:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8d0aafb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3310:x1875954110601344:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789049404.836687:0:6705:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8d0aafb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3310:x1875954110601344:12345-0@lo:400:kworker.0 Request processed in 104us (8370us total) trans 0 rc 0/0 00000100:00100000:0.0:1789049404.836694:0:6705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00010000:00080000:2.0:1789049404.836944:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cb8fce94380 x1875954110601344/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789049420 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789049404.836959:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb8fce94380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1875954110601344:0@lo:400:kworker.0 00010000:00010000:1.0:1789049405.147546:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1789049405.815831:0:9508:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: -----============= acceptance-small: sanity-pcc ============----- Thu Sep 10 10:10:03 EDT 2026 00010000:00010000:1.0:1789049406.172205:0:6719:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789049407.196428:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789049408.219095:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789049408.322286:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.26@tcp (source: 12345-192.168.206.26@tcp) 00000100:00100000:0.0:1789049408.322334:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.26@tcp (source: 12345-192.168.206.26@tcp) 00000100:00100000:0.0:1789049408.322364:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954089599232 00000100:00100000:0.0:1789049408.322375:0:5851:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954089599232 00000100:00100000:0.0:1789049408.322452:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.26@tcp, seq: 46 00000100:00100000:0.0:1789049408.322463:0:5851:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8f73c4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e823b53a-3591-475c-8624-c682227e5c13+6:2358:x1875954089599232:12345-192.168.206.26@tcp:400:kworker.0 00000100:00100000:0.0:1789049408.322529:0:5851:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8f73c4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e823b53a-3591-475c-8624-c682227e5c13+6:2358:x1875954089599232:12345-192.168.206.26@tcp:400:kworker.0 Request processed in 69us (195us total) trans 0 rc 0/0 00000100:00100000:0.0:1789049408.322537:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.26@tcp, seq: 46 00000100:00080000:0.0:1789049408.322557:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789049408.323889:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954089599104 00000100:00100000:2.0:1789049408.323908:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954089599104 00000100:00100000:2.0:1789049408.323959:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.26@tcp, seq: 198 00000100:00100000:2.0:1789049408.323967:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8c6248050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:de93d576-ed8d-4d27-ab00-9189a62cea33+10:2358:x1875954089599104:12345-192.168.206.26@tcp:400:kworker.0 00000100:00100000:2.0:1789049408.324030:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8c6248050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:de93d576-ed8d-4d27-ab00-9189a62cea33+10:2358:x1875954089599104:12345-192.168.206.26@tcp:400:kworker.0 Request processed in 63us (1753us total) trans 0 rc 0/0 00000100:00100000:2.0:1789049408.324036:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.26@tcp, seq: 198 00000100:00100000:0.0:1789049408.923106:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb8df284380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3309:1875954110601600:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789049408.923180:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789049408.924871:0:6707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954110601600 00000100:00100000:2.0:1789049408.924882:0:6707:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954110601600 00000100:00100000:2.0:1789049408.924953:0:6707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1789049408.924962:0:6707:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8f73c7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1875954110601600:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789049408.924999:0:6707:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789049408.925083:0:6707:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8f73c7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1875954110601600:12345-0@lo:13:osp-pre-0-0.0 Request processed in 122us (1902us total) trans 0 rc 0/0 00000100:00100000:2.0:1789049408.925095:0:6707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00010000:00080000:1.0:1789049408.925253:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cb8df284380 x1875954110601600/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789049424 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789049408.925271:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb8df284380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3309:1875954110601600:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1789049408.925346:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1789049409.248484:0:6719:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789049409.948402:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb8d0aae680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7ef694ec-1ea0-4f02-800c-d1279b4fdf12:3310:1875954110601728:0@lo:400:kworker.0 00000100:00100000:2.0:1789049409.948471:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789049409.948517:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb8d0aadf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3310:1875954110602240:0@lo:400:kworker.0 00000100:00100000:2.0:1789049409.948563:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789049409.948593:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1789049409.948599:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb8d0aaf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3310:1875954110601856:0@lo:400:kworker.0 00000100:00100000:2.0:1789049409.948621:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789049409.948639:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb8d0aac000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1875954110602368:0@lo:400:kworker.0 00000100:00100000:2.0:1789049409.948659:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789049409.948689:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb8d0aad880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3308:1875954110601984:0@lo:400:kworker.0 00000100:00100000:2.0:1789049409.948711:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789049409.948730:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789049409.948736:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb8d0aaed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1875954110602112:0@lo:400:kworker.0 00000100:00100000:2.0:1789049409.948756:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789049409.948787:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954110601728 00000100:00100000:2.0:1789049409.948794:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954110601728 00000100:00100000:2.0:1789049409.948833:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 199 00000100:00100000:2.0:1789049409.948867:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8c6248c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7ef694ec-1ea0-4f02-800c-d1279b4fdf12+19:3310:x1875954110601728:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789049409.948916:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8c6248c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7ef694ec-1ea0-4f02-800c-d1279b4fdf12+19:3310:x1875954110601728:12345-0@lo:400:kworker.0 Request processed in 75us (445us total) trans 0 rc 0/0 00000100:00100000:2.0:1789049409.948923:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 199 00000100:00100000:2.0:1789049409.948953:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954110602240 00000100:00100000:2.0:1789049409.948956:0:5852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954110602240 00000100:00100000:2.0:1789049409.948985:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954110601856 00000100:00100000:2.0:1789049409.948987:0:5852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954110601856 00000100:00100000:2.0:1789049409.948997:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954110601984 00000100:00100000:2.0:1789049409.948999:0:5852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954110601984 00000100:00100000:2.0:1789049409.949025:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1789049409.949031:0:5852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8c5818000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1875954110602240:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789049409.949062:0:5852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8c5818000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1875954110602240:12345-0@lo:400:kworker.0 Request processed in 31us (499us total) trans 0 rc 0/0 00000100:00100000:2.0:1789049409.949067:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1789049409.949077:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1789049409.949082:0:5852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8c581ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1875954110601856:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789049409.949106:0:5852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8c581ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1875954110601856:12345-0@lo:400:kworker.0 Request processed in 25us (485us total) trans 0 rc 0/0 00000100:00100000:2.0:1789049409.949111:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1789049409.949121:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1789049409.949127:0:5852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8c5819880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1875954110601984:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789049409.949155:0:5852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8c5819880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1875954110601984:12345-0@lo:400:kworker.0 Request processed in 28us (444us total) trans 0 rc 0/0 00000100:00100000:2.0:1789049409.949160:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1789049409.949180:0:6703:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954110602368 00000100:00100000:2.0:1789049409.949183:0:6703:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954110602368 00000100:00100000:2.0:1789049409.949205:0:6703:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954110602112 00000100:00100000:2.0:1789049409.949208:0:6703:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954110602112 00000100:00100000:2.0:1789049409.949220:0:6703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1789049409.949225:0:6703:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8c5819f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3310:x1875954110602368:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789049409.949256:0:6703:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8c5819f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3310:x1875954110602368:12345-0@lo:400:kworker.0 Request processed in 31us (596us total) trans 0 rc 0/0 00000100:00100000:2.0:1789049409.949261:0:6703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1789049409.949271:0:6703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1789049409.949276:0:6703:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8c581b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3308:x1875954110602112:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789049409.949313:0:6703:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8c581b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3308:x1875954110602112:12345-0@lo:400:kworker.0 Request processed in 36us (556us total) trans 0 rc 0/0 00000100:00100000:2.0:1789049409.949319:0:6703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00080000:2.0:1789049409.949343:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789049409.949347:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:2.0:1789049409.949378:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cb8d0aaed80 x1875954110602112/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789049425 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789049409.949390:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb8d0aaed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1875954110602112:0@lo:400:kworker.0 00000100:00100000:2.0:1789049409.949414:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb8d0aad880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3308:1875954110601984:0@lo:400:kworker.0 00000100:00100000:2.0:1789049409.949444:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb8d0aaf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3310:1875954110601856:0@lo:400:kworker.0 00010000:00080000:2.0:1789049409.949453:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cb8d0aac000 x1875954110602368/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789049425 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789049409.949459:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb8d0aac000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1875954110602368:0@lo:400:kworker.0 00000100:00100000:2.0:1789049409.949466:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb8d0aae680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7ef694ec-1ea0-4f02-800c-d1279b4fdf12:3310:1875954110601728:0@lo:400:kworker.0 00000100:00100000:2.0:1789049409.949473:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb8d0aadf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3310:1875954110602240:0@lo:400:kworker.0 00000100:00100000:2.0:1789049409.954681:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb8f73c6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1875954110602496:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789049409.954759:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789049409.955243:0:6707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954110602496 00000100:00100000:0.0:1789049409.955251:0:6707:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954110602496 00000100:00100000:0.0:1789049409.955335:0:6707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1789049409.955344:0:6707:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8c581a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1875954110602496:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1789049409.955377:0:6707:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789049409.955442:0:6707:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8c581a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1875954110602496:12345-0@lo:13:osp-pre-1-0.0 Request processed in 99us (692us total) trans 0 rc 0/0 00000100:00100000:0.0:1789049409.955450:0:6707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00010000:00080000:2.0:1789049409.955533:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cb8f73c6300 x1875954110602496/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789049425 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789049409.955549:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb8f73c6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1875954110602496:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1789049410.268534:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789049411.291022:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789049412.323687:0:6719:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789049413.355336:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789049413.447792:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.26@tcp (source: 12345-192.168.206.26@tcp) 00000100:00100000:0.0:1789049413.447903:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.26@tcp (source: 12345-192.168.206.26@tcp) 00000100:00100000:0.0:1789049413.449047:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954089599360 00000100:00100000:0.0:1789049413.449057:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954089599360 00000100:00100000:0.0:1789049413.449108:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.26@tcp, seq: 200 00000100:00100000:0.0:1789049413.449117:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8c624a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:de93d576-ed8d-4d27-ab00-9189a62cea33+10:2356:x1875954089599360:12345-192.168.206.26@tcp:400:kworker.0 00000100:00100000:0.0:1789049413.449252:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8c624a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:de93d576-ed8d-4d27-ab00-9189a62cea33+10:2356:x1875954089599360:12345-192.168.206.26@tcp:400:kworker.0 Request processed in 135us (1347us total) trans 0 rc 0/0 00000100:00100000:0.0:1789049413.449260:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.26@tcp, seq: 200 00000100:00100000:1.0:1789049413.450831:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954089599488 00000100:00100000:1.0:1789049413.450979:0:5852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954089599488 00000100:00100000:1.0:1789049413.451083:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.26@tcp, seq: 50 00000100:00100000:1.0:1789049413.451102:0:5852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8f73c6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e823b53a-3591-475c-8624-c682227e5c13+6:2356:x1875954089599488:12345-192.168.206.26@tcp:400:kworker.0 00000100:00100000:1.0:1789049413.451183:0:5852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8f73c6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e823b53a-3591-475c-8624-c682227e5c13+6:2356:x1875954089599488:12345-192.168.206.26@tcp:400:kworker.0 Request processed in 83us (3400us total) trans 0 rc 0/0 00000100:00100000:1.0:1789049413.451190:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.26@tcp, seq: 50 00000100:00080000:2.0:1789049413.456509:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789049414.043141:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789049414.043173:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb8c581bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1875954110602624:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789049414.043240:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789049414.043302:0:6706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954110602624 00000100:00100000:2.0:1789049414.043310:0:6706:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954110602624 00000100:00100000:2.0:1789049414.043385:0:6706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1789049414.043394:0:6706:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8c5818380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1875954110602624:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789049414.043429:0:6706:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789049414.043469:0:6706:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8c5818380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1875954110602624:12345-0@lo:13:osp-pre-0-0.0 Request processed in 77us (229us total) trans 0 rc 0/0 00000100:00100000:2.0:1789049414.043477:0:6706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00080000:2.0:1789049414.043496:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1789049414.043525:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cb8c581bb80 x1875954110602624/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789049430 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789049414.043542:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb8c581bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1875954110602624:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1789049414.362988:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789049415.068257:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb8f73c6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3311:1875954110602880:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789049415.068322:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789049415.068382:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb8c5819c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3311:1875954110603392:0@lo:400:kworker.0 00000100:00100000:2.0:1789049415.068409:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789049415.068463:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb8c581bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7ef694ec-1ea0-4f02-800c-d1279b4fdf12:3310:1875954110602752:0@lo:400:kworker.0 00000100:00100000:3.0:1789049415.068497:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789049415.068521:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb8c581b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1875954110603264:0@lo:400:kworker.0 00000100:00100000:3.0:1789049415.068543:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789049415.070001:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb8c581a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3308:1875954110603008:0@lo:400:kworker.0 00000100:00100000:2.0:1789049415.070390:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789049415.070421:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb8c5818a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1875954110603520:0@lo:400:kworker.0 00000100:00100000:2.0:1789049415.070447:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789049415.070510:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789049415.070517:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb8c581aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3308:1875954110603136:0@lo:400:kworker.0 00000100:00100000:2.0:1789049415.070537:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789049415.070587:0:6706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954110602880 00000100:00100000:2.0:1789049415.070595:0:6706:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954110602880 00000100:00100000:2.0:1789049415.070644:0:6706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1789049415.070653:0:6706:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8c5818e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1875954110602880:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1789049415.070688:0:6706:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789049415.070730:0:6706:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8c5818e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1875954110602880:12345-0@lo:13:osp-pre-1-0.0 Request processed in 78us (2408us total) trans 0 rc 0/0 00000100:00100000:2.0:1789049415.070810:0:6706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1789049415.070834:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954110603392 00000100:00100000:2.0:1789049415.070839:0:5851:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954110603392 00000100:00100000:2.0:1789049415.070894:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954110603008 00000100:00100000:2.0:1789049415.070898:0:5851:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954110603008 00000100:00100000:2.0:1789049415.070910:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954110603136 00000100:00100000:2.0:1789049415.070913:0:5851:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954110603136 00000100:00100000:2.0:1789049415.070927:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1789049415.070933:0:5851:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8c5818700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1875954110603392:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789049415.070967:0:5851:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8c5818700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1875954110603392:12345-0@lo:400:kworker.0 Request processed in 34us (2557us total) trans 0 rc 0/0 00000100:00100000:2.0:1789049415.070973:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1789049415.070985:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1789049415.070990:0:5851:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8c5819500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1875954110603008:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789049415.071020:0:5851:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8c5819500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1875954110603008:12345-0@lo:400:kworker.0 Request processed in 30us (631us total) trans 0 rc 0/0 00000100:00100000:2.0:1789049415.071027:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1789049415.071038:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1789049415.071117:0:5851:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8c581b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1875954110603136:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789049415.071145:0:5851:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8c581b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1875954110603136:12345-0@lo:400:kworker.0 Request processed in 31us (607us total) trans 0 rc 0/0 00000100:00100000:2.0:1789049415.071158:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1789049415.071177:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954110602752 00000100:00100000:2.0:1789049415.071182:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954110602752 00000100:00100000:2.0:1789049415.071207:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 201 00000100:00100000:2.0:1789049415.071213:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8c624b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7ef694ec-1ea0-4f02-800c-d1279b4fdf12+19:3310:x1875954110602752:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789049415.071251:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8c624b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7ef694ec-1ea0-4f02-800c-d1279b4fdf12+19:3310:x1875954110602752:12345-0@lo:400:kworker.0 Request processed in 38us (2754us total) trans 0 rc 0/0 00000100:00100000:2.0:1789049415.071256:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 201 00000100:00100000:3.0:1789049415.071517:0:6705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954110603264 00000100:00100000:3.0:1789049415.071527:0:6705:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954110603264 00000100:00100000:3.0:1789049415.071566:0:6705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954110603520 00000100:00100000:3.0:1789049415.071570:0:6705:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954110603520 00000100:00100000:3.0:1789049415.071584:0:6705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1789049415.071590:0:6705:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8df286a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3310:x1875954110603264:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789049415.071627:0:6705:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8df286a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3310:x1875954110603264:12345-0@lo:400:kworker.0 Request processed in 37us (3083us total) trans 0 rc 0/0 00000100:00100000:3.0:1789049415.071633:0:6705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1789049415.071645:0:6705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1789049415.071651:0:6705:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8c5819180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3308:x1875954110603520:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789049415.071675:0:6705:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8c5819180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3308:x1875954110603520:12345-0@lo:400:kworker.0 Request processed in 25us (1229us total) trans 0 rc 0/0 00000100:00100000:3.0:1789049415.071681:0:6705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00010000:00080000:3.0:1789049415.071958:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cb8f73c6300 x1875954110602880/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789049431 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789049415.071978:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb8f73c6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3311:1875954110602880:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789049415.071992:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb8c5819c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3311:1875954110603392:0@lo:400:kworker.0 00000100:00080000:3.0:1789049415.072022:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789049415.072028:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789049415.072203:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb8c581aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3308:1875954110603136:0@lo:400:kworker.0 00000100:00100000:2.0:1789049415.072216:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb8c581a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3308:1875954110603008:0@lo:400:kworker.0 00010000:00080000:2.0:1789049415.072226:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cb8c5818a80 x1875954110603520/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789049431 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789049415.072234:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb8c5818a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1875954110603520:0@lo:400:kworker.0 00000100:00100000:2.0:1789049415.072266:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb8c581bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7ef694ec-1ea0-4f02-800c-d1279b4fdf12:3310:1875954110602752:0@lo:400:kworker.0 00010000:00080000:2.0:1789049415.072277:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cb8c581b480 x1875954110603264/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789049431 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789049415.072286:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb8c581b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1875954110603264:0@lo:400:kworker.0 00010000:00010000:1.0:1789049415.391833:0:6719:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789049416.411046:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789049417.435011:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789049418.459394:0:6719:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789049418.564280:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.26@tcp (source: 12345-192.168.206.26@tcp) 00000100:00100000:0.0:1789049418.564334:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.26@tcp (source: 12345-192.168.206.26@tcp) 00000100:00100000:2.0:1789049418.564435:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954089599616 00000100:00100000:2.0:1789049418.564444:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954089599616 00000100:00100000:2.0:1789049418.564498:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.26@tcp, seq: 202 00000100:00100000:2.0:1789049418.564508:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8c624bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:de93d576-ed8d-4d27-ab00-9189a62cea33+10:2358:x1875954089599616:12345-192.168.206.26@tcp:400:kworker.0 00000100:00100000:3.0:1789049418.564528:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954089599744 00000100:00100000:3.0:1789049418.564536:0:5851:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954089599744 00000100:00100000:2.0:1789049418.564589:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8c624bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:de93d576-ed8d-4d27-ab00-9189a62cea33+10:2358:x1875954089599616:12345-192.168.206.26@tcp:400:kworker.0 Request processed in 82us (317us total) trans 0 rc 0/0 00000100:00100000:3.0:1789049418.564595:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.26@tcp, seq: 54 00000100:00100000:3.0:1789049418.564605:0:5851:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8f73c6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e823b53a-3591-475c-8624-c682227e5c13+6:2358:x1875954089599744:12345-192.168.206.26@tcp:400:kworker.0 00000100:00100000:2.0:1789049418.564616:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.26@tcp, seq: 202 00000100:00100000:3.0:1789049418.564646:0:5851:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8f73c6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e823b53a-3591-475c-8624-c682227e5c13+6:2358:x1875954089599744:12345-192.168.206.26@tcp:400:kworker.0 Request processed in 43us (311us total) trans 0 rc 0/0 00000100:00100000:3.0:1789049418.564652:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.26@tcp, seq: 54 00000100:00080000:1.0:1789049418.564950:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789049419.165418:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb8c581b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3309:1875954110603648:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789049419.165483:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789049419.165659:0:6706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954110603648 00000100:00100000:2.0:1789049419.165668:0:6706:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954110603648 00000100:00100000:2.0:1789049419.165729:0:6706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1789049419.165739:0:6706:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8fce96300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1875954110603648:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789049419.165774:0:6706:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789049419.165828:0:6706:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8fce96300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1875954110603648:12345-0@lo:13:osp-pre-0-0.0 Request processed in 90us (344us total) trans 0 rc 0/0 00000100:00100000:2.0:1789049419.165835:0:6706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00010000:00080000:3.0:1789049419.165897:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cb8c581b480 x1875954110603648/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789049435 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789049419.165918:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb8c581b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3309:1875954110603648:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1789049419.165920:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1789049419.483268:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789049420.193350:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb8fce96680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1875954110603776:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789049420.193449:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789049420.194994:0:6707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954110603776 00000100:00100000:1.0:1789049420.195012:0:6707:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954110603776 00000100:00100000:1.0:1789049420.195102:0:6707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1789049420.195115:0:6707:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8c633f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1875954110603776:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789049420.195159:0:6707:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789049420.199133:0:6707:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8c633f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1875954110603776:12345-0@lo:13:osp-pre-1-0.0 Request processed in 4008us (5671us total) trans 0 rc 0/0 00000100:00100000:1.0:1789049420.199151:0:6707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00080000:1.0:1789049420.199203:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789049420.200121:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb8c581bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:7ef694ec-1ea0-4f02-800c-d1279b4fdf12:3311:1875954110603904:0@lo:400:kworker.0 00000100:00100000:3.0:1789049420.200210:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789049420.200980:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954110603904 00000100:00100000:3.0:1789049420.200993:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954110603904 00000100:00100000:3.0:1789049420.201060:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 203 00000100:00100000:3.0:1789049420.201071:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8c6249850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7ef694ec-1ea0-4f02-800c-d1279b4fdf12+19:3311:x1875954110603904:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789049420.201158:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8c6249850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7ef694ec-1ea0-4f02-800c-d1279b4fdf12+19:3311:x1875954110603904:12345-0@lo:400:kworker.0 Request processed in 89us (948us total) trans 0 rc 0/0 00000100:00100000:3.0:1789049420.201167:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 203 00000100:00100000:3.0:1789049420.201238:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb8c581bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:7ef694ec-1ea0-4f02-800c-d1279b4fdf12:3311:1875954110603904:0@lo:400:kworker.0 00000100:00100000:2.0:1789049420.203220:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb8c581a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3309:1875954110604160:0@lo:400:kworker.0 00000100:00100000:2.0:1789049420.203326:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789049420.203391:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1789049420.203398:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb8c5818a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3309:1875954110604032:0@lo:400:kworker.0 00000100:00100000:2.0:1789049420.203423:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789049420.203457:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954110604160 00000100:00100000:2.0:1789049420.203468:0:5850:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954110604160 00000100:00100000:2.0:1789049420.203538:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954110604032 00000100:00100000:2.0:1789049420.203542:0:5850:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954110604032 00000100:00100000:2.0:1789049420.203568:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1789049420.203586:0:5850:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8c581b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1875954110604160:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789049420.203646:0:5850:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8c581b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1875954110604160:12345-0@lo:400:kworker.0 Request processed in 69us (321us total) trans 0 rc 0/0 00000100:00100000:2.0:1789049420.203654:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1789049420.203673:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1789049420.203679:0:5850:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8c5819c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1875954110604032:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789049420.203721:0:5850:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8c5819c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1875954110604032:12345-0@lo:400:kworker.0 Request processed in 41us (297us total) trans 0 rc 0/0 00000100:00100000:2.0:1789049420.203741:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00080000:2.0:1789049420.203762:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789049420.203803:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb8c5818a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3309:1875954110604032:0@lo:400:kworker.0 00000100:00100000:2.0:1789049420.204003:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb8c581a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3309:1875954110604160:0@lo:400:kworker.0 00000100:00100000:2.0:1789049420.204031:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb8c581bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3311:1875954110604416:0@lo:400:kworker.0 00000100:00100000:2.0:1789049420.204061:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789049420.204081:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1789049420.204087:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb8c581aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3311:1875954110604288:0@lo:400:kworker.0 00000100:00100000:2.0:1789049420.204111:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789049420.204136:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954110604416 00000100:00100000:2.0:1789049420.204140:0:5850:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954110604416 00000100:00100000:2.0:1789049420.204170:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1789049420.204176:0:5850:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8c581a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1875954110604416:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789049420.204209:0:5850:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8c581a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1875954110604416:12345-0@lo:400:kworker.0 Request processed in 34us (148us total) trans 0 rc 0/0 00000100:00100000:2.0:1789049420.204215:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1789049420.204233:0:6705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954110604288 00000100:00100000:2.0:1789049420.204237:0:6705:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954110604288 00000100:00100000:2.0:1789049420.204271:0:6705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1789049420.204278:0:6705:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8c5818a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3311:x1875954110604288:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789049420.204309:0:6705:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8c5818a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3311:x1875954110604288:12345-0@lo:400:kworker.0 Request processed in 31us (197us total) trans 0 rc 0/0 00000100:00100000:2.0:1789049420.204315:0:6705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00080000:2.0:1789049420.204329:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:2.0:1789049420.204361:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cb8c581aa00 x1875954110604288/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789049436 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789049420.204381:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb8c581aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3311:1875954110604288:0@lo:400:kworker.0 00000100:00100000:2.0:1789049420.204395:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb8c581bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3311:1875954110604416:0@lo:400:kworker.0 00010000:00080000:0.0:1789049420.205032:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cb8fce96680 x1875954110603776/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789049436 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789049420.205057:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb8fce96680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1875954110603776:0@lo:13:osp-pre-1-0.0 00000001:02000400:0.0:1789049420.241264:0:10139:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: === sanity-pcc: start setup 10:10:17 (1789049417) === 00010000:00010000:0.0:1789049420.507057:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789049420.614466:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.26@tcp (source: 12345-192.168.206.26@tcp) 00000100:00100000:0.0:1789049420.619548:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954089599872 00000100:00100000:0.0:1789049420.619570:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954089599872 00000100:00100000:3.0:1789049420.619875:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.26@tcp, seq: 204 00000100:00100000:3.0:1789049420.619893:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8c6249050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:de93d576-ed8d-4d27-ab00-9189a62cea33+10:8122:x1875954089599872:12345-192.168.206.26@tcp:101:mount.lustre.0 00010000:00010000:3.0:1789049420.619916:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789049420.619942:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cb8c6b35200/0xf4f48ce5e1bbee17 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x7fc5e358805a32b8 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049420.619981:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cb8c6b35200/0xf4f48ce5e1bbee17 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a32b8 expref: 11 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049420.619994:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cb8c6b35200/0xf4f48ce5e1bbee17 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a32b8 expref: 11 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049420.620004:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cb8c6b35200, rc 0) 00000100:00100000:3.0:1789049420.620102:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8c6249050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:de93d576-ed8d-4d27-ab00-9189a62cea33+11:8122:x1875954089599872:12345-192.168.206.26@tcp:101:mount.lustre.0 Request processed in 215us (5652us total) trans 0 rc 0/0 00000100:00100000:3.0:1789049420.620110:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.26@tcp, seq: 204 00000100:00100000:2.0:1789049420.626995:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.26@tcp (source: 12345-192.168.206.26@tcp) 00000100:00100000:0.0:1789049420.627181:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954089600000 00000100:00100000:0.0:1789049420.627195:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954089600000 00000100:00100000:0.0:1789049420.627278:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.26@tcp, seq: 205 00000100:00100000:0.0:1789049420.627291:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8c624b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:de93d576-ed8d-4d27-ab00-9189a62cea33+11:8122:x1875954089600000:12345-192.168.206.26@tcp:501:mount.lustre.0 00000100:00100000:0.0:1789049420.627921:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8c624b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:de93d576-ed8d-4d27-ab00-9189a62cea33+11:8122:x1875954089600000:12345-192.168.206.26@tcp:501:mount.lustre.0 Request processed in 629us (936us total) trans 0 rc 0/0 00000100:00100000:0.0:1789049420.627932:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.26@tcp, seq: 205 00000100:00100000:1.0:1789049420.634198:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.26@tcp (source: 12345-192.168.206.26@tcp) 00000100:00100000:0.0:1789049420.635328:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954089600128 00000100:00100000:0.0:1789049420.635355:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954089600128 00000100:00100000:0.0:1789049420.635441:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.26@tcp, seq: 206 00000100:00100000:0.0:1789049420.635453:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8c6248850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:de93d576-ed8d-4d27-ab00-9189a62cea33+11:8122:x1875954089600128:12345-192.168.206.26@tcp:503:mount.lustre.0 00000100:00100000:0.0:1789049420.636088:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8c6248850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:de93d576-ed8d-4d27-ab00-9189a62cea33+11:8122:x1875954089600128:12345-192.168.206.26@tcp:503:mount.lustre.0 Request processed in 634us (1902us total) trans 0 rc 0/0 00000100:00100000:0.0:1789049420.636098:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.26@tcp, seq: 206 00000100:00100000:1.0:1789049420.641182:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.26@tcp (source: 12345-192.168.206.26@tcp) 00000100:00100000:3.0:1789049420.641286:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954089600256 00000100:00100000:3.0:1789049420.641299:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954089600256 00000100:00100000:3.0:1789049420.641393:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.26@tcp, seq: 207 00000100:00100000:3.0:1789049420.641405:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8c6249c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:de93d576-ed8d-4d27-ab00-9189a62cea33+11:8126:x1875954089600256:12345-192.168.206.26@tcp:502:llog_process_th.0 00000100:00100000:3.0:1789049420.641751:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8c6249c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:de93d576-ed8d-4d27-ab00-9189a62cea33+11:8126:x1875954089600256:12345-192.168.206.26@tcp:502:llog_process_th.0 Request processed in 347us (582us total) trans 0 rc 0/0 00000100:00100000:3.0:1789049420.641759:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.26@tcp, seq: 207 00000100:00100000:2.0:1789049420.688261:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.26@tcp (source: 12345-192.168.206.26@tcp) 00000100:00100000:3.0:1789049420.688573:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954089600384 00000100:00100000:3.0:1789049420.688588:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954089600384 00000100:00100000:3.0:1789049420.688660:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.26@tcp, seq: 208 00000100:00100000:3.0:1789049420.688671:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8c624ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:de93d576-ed8d-4d27-ab00-9189a62cea33+11:8126:x1875954089600384:12345-192.168.206.26@tcp:502:llog_process_th.0 00000100:00100000:3.0:1789049420.689062:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8c624ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:de93d576-ed8d-4d27-ab00-9189a62cea33+11:8126:x1875954089600384:12345-192.168.206.26@tcp:502:llog_process_th.0 Request processed in 391us (814us total) trans 0 rc 0/0 00000100:00100000:3.0:1789049420.689072:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.26@tcp, seq: 208 00000100:00100000:1.0:1789049420.702056:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.26@tcp (source: 12345-192.168.206.26@tcp) 00000100:00100000:2.0:1789049420.705392:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954089600512 00000100:00100000:2.0:1789049420.705415:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954089600512 00000100:00100000:2.0:1789049420.705517:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.26@tcp, seq: 209 00000100:00100000:2.0:1789049420.705530:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8c6248450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:de93d576-ed8d-4d27-ab00-9189a62cea33+11:8122:x1875954089600512:12345-192.168.206.26@tcp:101:mount.lustre.0 00010000:00010000:2.0:1789049420.705556:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789049420.705582:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cb8d6714400/0xf4f48ce5e1bbee1e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x7fc5e358805a32e2 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049420.705619:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cb8d6714400/0xf4f48ce5e1bbee1e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a32e2 expref: 12 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049420.705633:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cb8d6714400/0xf4f48ce5e1bbee1e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a32e2 expref: 12 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049420.705643:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cb8d6714400, rc 0) 00000100:00100000:2.0:1789049420.706071:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8c6248450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:de93d576-ed8d-4d27-ab00-9189a62cea33+12:8122:x1875954089600512:12345-192.168.206.26@tcp:101:mount.lustre.0 Request processed in 541us (4026us total) trans 0 rc 0/0 00000100:00100000:2.0:1789049420.706080:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.26@tcp, seq: 209 00000100:00100000:1.0:1789049420.708723:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.26@tcp (source: 12345-192.168.206.26@tcp) 00000100:00100000:2.0:1789049420.709788:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954089600640 00000100:00100000:2.0:1789049420.709815:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954089600640 00000100:00100000:2.0:1789049420.709932:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.26@tcp, seq: 210 00000100:00100000:2.0:1789049420.709943:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8c6249450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:de93d576-ed8d-4d27-ab00-9189a62cea33+12:8122:x1875954089600640:12345-192.168.206.26@tcp:256:mount.lustre.0 20000000:01000000:2.0:1789049420.709995:0:5845:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:2.0:1789049420.710016:0:5845:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:2.0:1789049420.710021:0:5845:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:2.0:1789049420.710025:0:5845:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:2.0:1789049420.710027:0:5845:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 5 00000100:00100000:2.0:1789049420.714241:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8c6249450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:de93d576-ed8d-4d27-ab00-9189a62cea33+12:8122:x1875954089600640:12345-192.168.206.26@tcp:256:mount.lustre.0 Request processed in 4280us (5513us total) trans 0 rc 0/0 00000100:00100000:2.0:1789049420.714261:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.26@tcp, seq: 210 00000100:00100000:1.0:1789049420.722445:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.26@tcp (source: 12345-192.168.206.26@tcp) 00000100:00100000:2.0:1789049420.722644:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954089600768 00000100:00100000:2.0:1789049420.722659:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954089600768 00000100:00100000:2.0:1789049420.722749:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.26@tcp, seq: 211 00000100:00100000:2.0:1789049420.722761:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8c624a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:de93d576-ed8d-4d27-ab00-9189a62cea33+12:8122:x1875954089600768:12345-192.168.206.26@tcp:101:mount.lustre.0 00010000:00010000:2.0:1789049420.722784:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789049420.722811:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cb8d6715c00/0xf4f48ce5e1bbee25 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x7fc5e358805a32e9 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049420.722884:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cb8d6715c00/0xf4f48ce5e1bbee25 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a32e9 expref: 13 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049420.722898:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cb8d6715c00/0xf4f48ce5e1bbee25 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a32e9 expref: 13 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049420.722908:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cb8d6715c00, rc 0) 00000100:00100000:2.0:1789049420.722990:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8c624a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:de93d576-ed8d-4d27-ab00-9189a62cea33+13:8122:x1875954089600768:12345-192.168.206.26@tcp:101:mount.lustre.0 Request processed in 231us (570us total) trans 0 rc 0/0 00000100:00100000:2.0:1789049420.722998:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.26@tcp, seq: 211 00000100:00100000:1.0:1789049420.726990:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.26@tcp (source: 12345-192.168.206.26@tcp) 00000100:00100000:2.0:1789049420.727463:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954089600896 00000100:00100000:2.0:1789049420.727497:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954089600896 00000100:00100000:2.0:1789049420.727573:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.26@tcp, seq: 212 00000100:00100000:2.0:1789049420.727585:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8c624a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:de93d576-ed8d-4d27-ab00-9189a62cea33+13:8122:x1875954089600896:12345-192.168.206.26@tcp:501:mount.lustre.0 00000100:00100000:2.0:1789049420.728051:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8c624a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:de93d576-ed8d-4d27-ab00-9189a62cea33+13:8122:x1875954089600896:12345-192.168.206.26@tcp:501:mount.lustre.0 Request processed in 465us (1074us total) trans 0 rc 0/0 00000100:00100000:2.0:1789049420.728061:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.26@tcp, seq: 212 00000100:00100000:0.0:1789049420.733960:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.26@tcp (source: 12345-192.168.206.26@tcp) 00000100:00100000:3.0:1789049420.734260:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954089601024 00000100:00100000:3.0:1789049420.734273:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954089601024 00000100:00100000:3.0:1789049420.734790:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.26@tcp, seq: 213 00000100:00100000:3.0:1789049420.734805:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8c6297050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:de93d576-ed8d-4d27-ab00-9189a62cea33+13:8122:x1875954089601024:12345-192.168.206.26@tcp:503:mount.lustre.0 00000100:00100000:3.0:1789049420.735156:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8c6297050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:de93d576-ed8d-4d27-ab00-9189a62cea33+13:8122:x1875954089601024:12345-192.168.206.26@tcp:503:mount.lustre.0 Request processed in 354us (1216us total) trans 0 rc 0/0 00000100:00100000:3.0:1789049420.735165:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.26@tcp, seq: 213 00000100:00100000:1.0:1789049420.753412:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.26@tcp (source: 12345-192.168.206.26@tcp) 00000100:00100000:0.0:1789049420.753940:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954089601152 00000100:00100000:0.0:1789049420.753954:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954089601152 00000100:00100000:0.0:1789049420.754030:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.26@tcp, seq: 214 00000100:00100000:0.0:1789049420.754041:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8c6294050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:de93d576-ed8d-4d27-ab00-9189a62cea33+13:8129:x1875954089601152:12345-192.168.206.26@tcp:502:llog_process_th.0 00000100:00100000:0.0:1789049420.754562:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8c6294050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:de93d576-ed8d-4d27-ab00-9189a62cea33+13:8129:x1875954089601152:12345-192.168.206.26@tcp:502:llog_process_th.0 Request processed in 520us (1162us total) trans 0 rc 0/0 00000100:00100000:0.0:1789049420.754573:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.26@tcp, seq: 214 00000100:00100000:1.0:1789049420.758617:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.26@tcp (source: 12345-192.168.206.26@tcp) 00000100:00100000:3.0:1789049420.758728:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954089601280 00000100:00100000:3.0:1789049420.758757:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954089601280 00000100:00100000:3.0:1789049420.758831:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.26@tcp, seq: 215 00000100:00100000:3.0:1789049420.758883:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8c6294c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:de93d576-ed8d-4d27-ab00-9189a62cea33+13:8129:x1875954089601280:12345-192.168.206.26@tcp:502:llog_process_th.0 00000100:00100000:3.0:1789049420.759190:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8c6294c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:de93d576-ed8d-4d27-ab00-9189a62cea33+13:8129:x1875954089601280:12345-192.168.206.26@tcp:502:llog_process_th.0 Request processed in 348us (586us total) trans 0 rc 0/0 00000100:00100000:3.0:1789049420.759199:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.26@tcp, seq: 215 00000100:00100000:2.0:1789049420.764971:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.26@tcp (source: 12345-192.168.206.26@tcp) 00000100:00100000:2.0:1789049420.765021:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.26@tcp (source: 12345-192.168.206.26@tcp) 00000100:00100000:3.0:1789049420.765629:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954089601408 00000100:00100000:3.0:1789049420.765652:0:5851:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954089601408 00000100:00100000:3.0:1789049420.765710:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954089601536 00000100:00100000:3.0:1789049420.765713:0:5851:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954089601536 00000100:00100000:1.0:1789049420.765748:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.26@tcp, seq: 10 00000100:00100000:1.0:1789049420.765759:0:5852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8c581bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2354:x1875954089601408:12345-192.168.206.26@tcp:38:mount.lustre.0 00000100:00100000:3.0:1789049420.765771:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.26@tcp, seq: 58 00000100:00100000:3.0:1789049420.765778:0:5851:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8c581aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e823b53a-3591-475c-8624-c682227e5c13+6:2355:x1875954089601536:12345-192.168.206.26@tcp:400:kworker.0 00010000:00080000:1.0:1789049420.765799:0:5852:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from 59d63492-f1ee-4aa5-bf8c-853a603b0252@192.168.206.26@tcp t0 exp 0000000000000000 cur 246 last 0 00000020:00000080:1.0:1789049420.765880:0:5852:0:(genops.c:1384:class_connect()) connect: client 59d63492-f1ee-4aa5-bf8c-853a603b0252, cookie 0xf4f48ce5e1bbee2c 00000100:00100000:3.0:1789049420.765890:0:5851:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8c581aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e823b53a-3591-475c-8624-c682227e5c13+6:2355:x1875954089601536:12345-192.168.206.26@tcp:400:kworker.0 Request processed in 113us (869us total) trans 0 rc 0/0 00000100:00100000:3.0:1789049420.765897:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.26@tcp, seq: 58 00000004:00100000:1.0:1789049420.765916:0:5852:0:(mdt_handler.c:7311:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:0.0:1789049420.766168:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789049420.766245:0:5852:0:(import.c:65:import_set_state_nolock()) ffff8cb8c62e2000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1789049420.766311:0:5852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8c581bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:59d63492-f1ee-4aa5-bf8c-853a603b0252+6:2354:x1875954089601408:12345-192.168.206.26@tcp:38:mount.lustre.0 Request processed in 542us (1344us total) trans 0 rc 0/0 00000100:00100000:1.0:1789049420.766319:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.26@tcp, seq: 10 00000100:00100000:2.0:1789049420.769533:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.26@tcp (source: 12345-192.168.206.26@tcp) 00000100:00100000:2.0:1789049420.769599:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.26@tcp (source: 12345-192.168.206.26@tcp) 00000100:00100000:3.0:1789049420.769927:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954089601792 00000100:00100000:3.0:1789049420.769940:0:5851:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954089601792 00000100:00100000:3.0:1789049420.770029:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954089601664 00000100:00100000:3.0:1789049420.770033:0:5851:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954089601664 00000100:00100000:3.0:1789049420.770057:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.26@tcp, seq: 11 00000100:00100000:3.0:1789049420.770069:0:5851:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8d0aadf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:59d63492-f1ee-4aa5-bf8c-853a603b0252+7:8122:x1875954089601792:12345-192.168.206.26@tcp:41:mount.lustre.0 00000004:00000024:3.0:1789049420.770200:0:5851:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:3.0:1789049420.770393:0:5851:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8d0aadf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:59d63492-f1ee-4aa5-bf8c-853a603b0252+7:8122:x1875954089601792:12345-192.168.206.26@tcp:41:mount.lustre.0 Request processed in 248us (796us total) trans 0 rc 0/0 00000100:00100000:3.0:1789049420.770403:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.26@tcp, seq: 11 00000100:00100000:3.0:1789049420.770424:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.26@tcp, seq: 12 00000100:00100000:3.0:1789049420.770432:0:5851:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8d0aae680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:59d63492-f1ee-4aa5-bf8c-853a603b0252+6:0:x1875954089601664:12345-192.168.206.26@tcp:41:mount.lustre.0 00000004:00000024:3.0:1789049420.770464:0:5851:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:3.0:1789049420.770490:0:5851:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8d0aae680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:59d63492-f1ee-4aa5-bf8c-853a603b0252+6:0:x1875954089601664:12345-192.168.206.26@tcp:41:mount.lustre.0 Request processed in 58us (889us total) trans 0 rc 0/0 00000100:00100000:3.0:1789049420.770496:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.26@tcp, seq: 12 00000100:00080000:2.0:1789049420.771014:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789049420.777535:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.26@tcp (source: 12345-192.168.206.26@tcp) 00000100:00100000:3.0:1789049420.784888:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954089601920 00000100:00100000:3.0:1789049420.784910:0:5851:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954089601920 00000100:00100000:3.0:1789049420.784998:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.26@tcp, seq: 13 00000100:00100000:3.0:1789049420.785010:0:5851:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8d0aac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:59d63492-f1ee-4aa5-bf8c-853a603b0252+6:8122:x1875954089601920:12345-192.168.206.26@tcp:40:mount.lustre.0 00000100:00100000:3.0:1789049420.786429:0:5851:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8d0aac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:59d63492-f1ee-4aa5-bf8c-853a603b0252+6:8122:x1875954089601920:12345-192.168.206.26@tcp:40:mount.lustre.0 Request processed in 1303us (8792us total) trans 0 rc 0/0 00000100:00100000:3.0:1789049420.786448:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.26@tcp, seq: 13 00000100:00100000:2.0:1789049420.795558:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.26@tcp (source: 12345-192.168.206.26@tcp) 00000100:00100000:2.0:1789049420.795619:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.26@tcp (source: 12345-192.168.206.26@tcp) 00000100:00100000:2.0:1789049420.795664:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.26@tcp (source: 12345-192.168.206.26@tcp) 00000100:00100000:1.0:1789049420.795952:0:6705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954089602048 00000100:00100000:1.0:1789049420.795965:0:6705:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954089602048 00000100:00100000:1.0:1789049420.796023:0:6705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954089602176 00000100:00100000:1.0:1789049420.796026:0:6705:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954089602176 00000100:00100000:1.0:1789049420.796043:0:6705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.26@tcp, seq: 12 00000100:00100000:1.0:1789049420.796054:0:6705:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8d0aad880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2354:x1875954089602048:12345-192.168.206.26@tcp:8:mount.lustre.0 00010000:00080000:1.0:1789049420.796097:0:6705:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0000: connection from 59d63492-f1ee-4aa5-bf8c-853a603b0252@192.168.206.26@tcp t0 exp 0000000000000000 cur 246 last 0 00000020:00000080:1.0:1789049420.796143:0:6705:0:(genops.c:1384:class_connect()) connect: client 59d63492-f1ee-4aa5-bf8c-853a603b0252, cookie 0xf4f48ce5e1bbee33 00002000:00100000:1.0:1789049420.796158:0:6705:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 59d63492-f1ee-4aa5-bf8c-853a603b0252/ffff8cb8c62e4800 ocd_connect_flags: 0xa046faf2e3640038 ocd_version: 2113a28 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1789049420.796172:0:6705:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:1.0:1789049420.796507:0:6705:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:1.0:1789049420.796546:0:6705:0:(import.c:65:import_set_state_nolock()) ffff8cb8c62e7800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1789049420.796661:0:6705:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8d0aad880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:59d63492-f1ee-4aa5-bf8c-853a603b0252+6:2354:x1875954089602048:12345-192.168.206.26@tcp:8:mount.lustre.0 Request processed in 606us (1040us total) trans 0 rc 0/0 00000100:00100000:1.0:1789049420.796671:0:6705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.26@tcp, seq: 12 00000100:00100000:1.0:1789049420.796720:0:6705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.26@tcp, seq: 13 00000100:00100000:1.0:1789049420.796727:0:6705:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8d0aaed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2354:x1875954089602176:12345-192.168.206.26@tcp:8:mount.lustre.0 00010000:00080000:1.0:1789049420.796749:0:6705:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0001: connection from 59d63492-f1ee-4aa5-bf8c-853a603b0252@192.168.206.26@tcp t0 exp 0000000000000000 cur 246 last 0 00000020:00000080:1.0:1789049420.796770:0:6705:0:(genops.c:1384:class_connect()) connect: client 59d63492-f1ee-4aa5-bf8c-853a603b0252, cookie 0xf4f48ce5e1bbee3a 00002000:00100000:1.0:1789049420.796778:0:6705:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 59d63492-f1ee-4aa5-bf8c-853a603b0252/ffff8cb8c62e3800 ocd_connect_flags: 0xa046faf2e3640038 ocd_version: 2113a28 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1789049420.796787:0:6705:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:1.0:1789049420.796991:0:6705:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:1.0:1789049420.797007:0:6705:0:(import.c:65:import_set_state_nolock()) ffff8cb8c62e7000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1789049420.797036:0:6705:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8d0aaed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:59d63492-f1ee-4aa5-bf8c-853a603b0252+6:2354:x1875954089602176:12345-192.168.206.26@tcp:8:mount.lustre.0 Request processed in 308us (1371us total) trans 0 rc 0/0 00000100:00100000:1.0:1789049420.797043:0:6705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.26@tcp, seq: 13 00000100:00100000:3.0:1789049420.799011:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954089602304 00000100:00100000:3.0:1789049420.799044:0:5853:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954089602304 00000100:00100000:3.0:1789049420.799158:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.26@tcp, seq: 1 00000100:00100000:3.0:1789049420.799170:0:5853:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8d0aaf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:59d63492-f1ee-4aa5-bf8c-853a603b0252+6:8122:x1875954089602304:12345-192.168.206.26@tcp:33:mount.lustre.0 00000004:00200000:3.0:1789049420.799275:0:5853:0:(mdt_handler.c:922:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000100:00100000:3.0:1789049420.799405:0:5853:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8d0aaf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:59d63492-f1ee-4aa5-bf8c-853a603b0252+6:8122:x1875954089602304:12345-192.168.206.26@tcp:33:mount.lustre.0 Request processed in 237us (3863us total) trans 0 rc 0/0 00000100:00100000:3.0:1789049420.799414:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.26@tcp, seq: 1 00010000:00010000:2.0:1789049421.545235:0:6719:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789049422.557887:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1789049422.825110:0:7663:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 59d63492-f1ee-4aa5-bf8c-853a603b0252 00000001:00100000:3.0:1789049422.855467:0:5872:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 59d63492-f1ee-4aa5-bf8c-853a603b0252 00010000:00010000:0.0:1789049423.579049:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789049424.283553:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb8df482680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1875954110604544:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789049424.283635:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789049424.284097:0:6706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954110604544 00000100:00100000:3.0:1789049424.284105:0:6706:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954110604544 00000100:00100000:3.0:1789049424.284168:0:6706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1789049424.284178:0:6706:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8fce95180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1875954110604544:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789049424.284330:0:6706:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00080000:0.0:1789049424.284416:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789049424.294239:0:6706:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8fce95180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1875954110604544:12345-0@lo:13:osp-pre-0-0.0 Request processed in 10054us (10604us total) trans 0 rc 0/0 00000100:00100000:3.0:1789049424.294254:0:6706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00010000:00080000:1.0:1789049424.296536:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cb8df482680 x1875954110604544/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789049440 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789049424.296561:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb8df482680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1875954110604544:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1789049424.603095:0:6719:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1789049424.852583:0:6733:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 59d63492-f1ee-4aa5-bf8c-853a603b0252 00000100:00100000:0.0:1789049425.307128:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb8fce95880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3309:1875954110604672:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789049425.307171:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb8df483b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7ef694ec-1ea0-4f02-800c-d1279b4fdf12:3310:1875954110604800:0@lo:400:kworker.0 00000100:00100000:0.0:1789049425.307195:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789049425.307224:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789049425.307302:0:6707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954110604672 00000100:00100000:1.0:1789049425.307322:0:6707:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954110604672 00000100:00100000:1.0:1789049425.307395:0:6707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1789049425.307404:0:6707:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8fc99a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1875954110604672:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789049425.307435:0:6707:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789049425.307601:0:6707:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8fc99a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1875954110604672:12345-0@lo:13:osp-pre-1-0.0 Request processed in 197us (406us total) trans 0 rc 0/0 00000100:00100000:1.0:1789049425.307623:0:6707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00080000:1.0:1789049425.307642:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789049425.307660:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954110604800 00000100:00100000:1.0:1789049425.307664:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954110604800 00000100:00100000:1.0:1789049425.307687:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 216 00000100:00100000:1.0:1789049425.307693:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8c6296450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7ef694ec-1ea0-4f02-800c-d1279b4fdf12+19:3310:x1875954110604800:12345-0@lo:400:kworker.0 00010000:00080000:0.0:1789049425.307749:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cb8fce95880 x1875954110604672/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789049441 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789049425.307766:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb8fce95880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3309:1875954110604672:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789049425.307802:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb8df480380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3311:1875954110604928:0@lo:400:kworker.0 00000100:00100000:0.0:1789049425.307834:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789049425.307898:0:6841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954110604928 00000100:00100000:0.0:1789049425.307902:0:6841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954110604928 00000100:00100000:0.0:1789049425.307928:0:6841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1789049425.307934:0:6841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8fc998000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1875954110604928:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789049425.307965:0:6841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8fc998000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1875954110604928:12345-0@lo:400:kworker.0 Request processed in 31us (130us total) trans 0 rc 0/0 00000100:00100000:0.0:1789049425.307971:0:6841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1789049425.307995:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb8df480380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3311:1875954110604928:0@lo:400:kworker.0 00000100:00100000:1.0:1789049425.317648:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8c6296450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7ef694ec-1ea0-4f02-800c-d1279b4fdf12+19:3310:x1875954110604800:12345-0@lo:400:kworker.0 Request processed in 9946us (10415us total) trans 0 rc 0/0 00000100:00100000:1.0:1789049425.317662:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 216 00000100:00100000:0.0:1789049425.320239:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1789049425.320268:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb8df483480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3311:1875954110605312:0@lo:400:kworker.0 00000100:00100000:0.0:1789049425.320360:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789049425.320430:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb8df482a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3309:1875954110605184:0@lo:400:kworker.0 00000100:00100000:0.0:1789049425.320456:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789049425.320477:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1789049425.320483:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb8df482300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3309:1875954110605056:0@lo:400:kworker.0 00000100:00100000:0.0:1789049425.320504:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789049425.320540:0:6705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954110605184 00000100:00100000:0.0:1789049425.320546:0:6705:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954110605184 00000100:00100000:0.0:1789049425.320596:0:6705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1789049425.320604:0:6705:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8fcf07800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3309:x1875954110605184:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789049425.320656:0:6705:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8fcf07800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3309:x1875954110605184:12345-0@lo:400:kworker.0 Request processed in 53us (198us total) trans 0 rc 0/0 00000100:00100000:0.0:1789049425.320663:0:6705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00010000:00080000:0.0:1789049425.320699:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cb8df482a00 x1875954110605184/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789049441 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789049425.320711:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb8df482a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3309:1875954110605184:0@lo:400:kworker.0 00000100:00100000:0.0:1789049425.320749:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954110605312 00000100:00100000:0.0:1789049425.320752:0:5851:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954110605312 00000100:00100000:0.0:1789049425.320783:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954110605056 00000100:00100000:0.0:1789049425.320787:0:5851:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954110605056 00000100:00100000:0.0:1789049425.320804:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1789049425.320811:0:5851:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8fcf05180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1875954110605312:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789049425.320866:0:5851:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8fcf05180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1875954110605312:12345-0@lo:400:kworker.0 Request processed in 55us (506us total) trans 0 rc 0/0 00000100:00100000:0.0:1789049425.320872:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1789049425.320884:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1789049425.320890:0:5851:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8fcf04000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1875954110605056:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789049425.320921:0:5851:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8fcf04000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1875954110605056:12345-0@lo:400:kworker.0 Request processed in 31us (416us total) trans 0 rc 0/0 00000100:00100000:0.0:1789049425.320927:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00080000:0.0:1789049425.320943:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789049425.320967:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb8df483480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3311:1875954110605312:0@lo:400:kworker.0 00000100:00100000:0.0:1789049425.320991:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb8df482300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3309:1875954110605056:0@lo:400:kworker.0 00000100:00100000:3.0:1789049425.332296:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb8df483b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7ef694ec-1ea0-4f02-800c-d1279b4fdf12:3310:1875954110604800:0@lo:400:kworker.0 00010000:00010000:0.0:1789049425.627738:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789049426.243754:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.26@tcp (source: 12345-192.168.206.26@tcp) 00000100:00100000:0.0:1789049426.243791:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.26@tcp (source: 12345-192.168.206.26@tcp) 00000100:00100000:0.0:1789049426.243820:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.26@tcp (source: 12345-192.168.206.26@tcp) 00000100:00100000:0.0:1789049426.243863:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.26@tcp (source: 12345-192.168.206.26@tcp) 00000100:00100000:0.0:1789049426.243897:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.26@tcp (source: 12345-192.168.206.26@tcp) 00000100:00100000:0.0:1789049426.243923:0:6703:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954089602944 00000100:00100000:0.0:1789049426.243932:0:6703:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954089602944 00000100:00100000:0.0:1789049426.243988:0:6703:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954089602816 00000100:00100000:0.0:1789049426.243992:0:6703:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954089602816 00000100:00100000:0.0:1789049426.244012:0:6703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.26@tcp, seq: 29 00000100:00100000:0.0:1789049426.244020:0:6703:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8fcf05f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:59d63492-f1ee-4aa5-bf8c-853a603b0252+5:2355:x1875954089602944:12345-192.168.206.26@tcp:400:kworker.0 00000100:00100000:0.0:1789049426.244088:0:6703:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8fcf05f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:59d63492-f1ee-4aa5-bf8c-853a603b0252+5:2355:x1875954089602944:12345-192.168.206.26@tcp:400:kworker.0 Request processed in 68us (266us total) trans 0 rc 0/0 00000100:00100000:0.0:1789049426.244095:0:6703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.26@tcp, seq: 29 00000100:00100000:0.0:1789049426.244111:0:6703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.26@tcp, seq: 30 00000100:00100000:0.0:1789049426.244118:0:6703:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8fcf07100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:59d63492-f1ee-4aa5-bf8c-853a603b0252+5:2355:x1875954089602816:12345-192.168.206.26@tcp:400:kworker.0 00000100:00100000:0.0:1789049426.244142:0:6703:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8fcf07100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:59d63492-f1ee-4aa5-bf8c-853a603b0252+5:2355:x1875954089602816:12345-192.168.206.26@tcp:400:kworker.0 Request processed in 24us (244us total) trans 0 rc 0/0 00000100:00100000:0.0:1789049426.244148:0:6703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.26@tcp, seq: 30 00000100:00100000:0.0:1789049426.244167:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954089602688 00000100:00100000:0.0:1789049426.244170:0:5852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954089602688 00000100:00100000:0.0:1789049426.244196:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954089602560 00000100:00100000:0.0:1789049426.244198:0:5852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954089602560 00000100:00100000:0.0:1789049426.244220:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.26@tcp, seq: 62 00000100:00100000:0.0:1789049426.244227:0:5852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8fcf06d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:59d63492-f1ee-4aa5-bf8c-853a603b0252+5:2355:x1875954089602688:12345-192.168.206.26@tcp:400:kworker.0 00000100:00100000:0.0:1789049426.244270:0:5852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8fcf06d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:59d63492-f1ee-4aa5-bf8c-853a603b0252+5:2355:x1875954089602688:12345-192.168.206.26@tcp:400:kworker.0 Request processed in 43us (478us total) trans 0 rc 0/0 00000100:00100000:0.0:1789049426.244276:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.26@tcp, seq: 62 00000100:00100000:0.0:1789049426.244289:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.26@tcp, seq: 63 00000100:00100000:0.0:1789049426.244295:0:5852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8fcf05880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e823b53a-3591-475c-8624-c682227e5c13+6:2355:x1875954089602560:12345-192.168.206.26@tcp:400:kworker.0 00000100:00100000:0.0:1789049426.244331:0:5852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8fcf05880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e823b53a-3591-475c-8624-c682227e5c13+6:2355:x1875954089602560:12345-192.168.206.26@tcp:400:kworker.0 Request processed in 35us (487us total) trans 0 rc 0/0 00000100:00100000:0.0:1789049426.244336:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.26@tcp, seq: 63 00000100:00080000:0.0:1789049426.244357:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789049426.244362:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1789049426.244364:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789049426.245932:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954089602432 00000100:00100000:1.0:1789049426.245943:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954089602432 00000100:00100000:1.0:1789049426.245987:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.26@tcp, seq: 217 00000100:00100000:1.0:1789049426.245995:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8c6297450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:de93d576-ed8d-4d27-ab00-9189a62cea33+13:2355:x1875954089602432:12345-192.168.206.26@tcp:400:kworker.0 00000100:00100000:1.0:1789049426.246049:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8c6297450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:de93d576-ed8d-4d27-ab00-9189a62cea33+13:2355:x1875954089602432:12345-192.168.206.26@tcp:400:kworker.0 Request processed in 55us (2304us total) trans 0 rc 0/0 00000100:00100000:1.0:1789049426.246055:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.26@tcp, seq: 217 00000001:02000400:0.0:1789049426.261275:0:10335:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg626-client.virtnet: executing check_config_client /mnt/lustre 00010000:00010000:0.0:1789049426.652282:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789049427.678730:0:6719:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789049428.699661:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789049429.405278:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb8df481c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3311:1875954110605440:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789049429.405359:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789049429.405473:0:6707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954110605440 00000100:00100000:2.0:1789049429.405482:0:6707:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954110605440 00000100:00100000:2.0:1789049429.405553:0:6707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1789049429.405565:0:6707:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8df287480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1875954110605440:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789049429.405601:0:6707:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789049429.405650:0:6707:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8df287480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1875954110605440:12345-0@lo:13:osp-pre-0-0.0 Request processed in 89us (290us total) trans 0 rc 0/0 00000100:00100000:2.0:1789049429.405657:0:6707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00010000:00080000:2.0:1789049429.405701:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cb8df481c00 x1875954110605440/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789049445 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789049429.405726:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb8df481c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3311:1875954110605440:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1789049429.405921:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1789049429.724442:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789049430.428244:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb8df285c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7ef694ec-1ea0-4f02-800c-d1279b4fdf12:3308:1875954110605568:0@lo:400:kworker.0 00000100:00100000:2.0:1789049430.428320:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb8df285f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3310:1875954110605824:0@lo:400:kworker.0 00000100:00100000:1.0:1789049430.428337:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789049430.428363:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789049430.428407:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789049430.428410:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb8df284700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3308:1875954110606080:0@lo:400:kworker.0 00000100:00100000:2.0:1789049430.428417:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb8df287800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1875954110605952:0@lo:400:kworker.0 00000100:00100000:2.0:1789049430.428452:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789049430.428458:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789049430.428489:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1789049430.428497:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954110605824 00000100:00100000:1.0:1789049430.428497:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb8df284380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3308:1875954110605696:0@lo:400:kworker.0 00000100:00100000:2.0:1789049430.428506:0:5852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954110605824 00000100:00100000:1.0:1789049430.428522:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789049430.428541:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb8df284a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1875954110606208:0@lo:400:kworker.0 00000100:00100000:1.0:1789049430.428563:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789049430.428564:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954110606080 00000100:00100000:2.0:1789049430.428569:0:5852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954110606080 00000100:00100000:2.0:1789049430.428588:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954110605696 00000100:00100000:2.0:1789049430.428593:0:5852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954110605696 00000100:00100000:1.0:1789049430.428615:0:6841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1789049430.428626:0:6841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8df481c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1875954110605824:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789049430.428649:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954110605568 00000100:00100000:3.0:1789049430.428654:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954110605568 00000100:00100000:1.0:1789049430.428681:0:6841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8df481c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1875954110605824:12345-0@lo:400:kworker.0 Request processed in 57us (318us total) trans 0 rc 0/0 00000100:00100000:3.0:1789049430.428689:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 218 00000100:00100000:0.0:1789049430.428818:0:6705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954110605952 00000100:00100000:0.0:1789049430.428823:0:6705:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954110605952 00000100:00100000:0.0:1789049430.428870:0:6705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954110606208 00000100:00100000:0.0:1789049430.428874:0:6705:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954110606208 00000100:00100000:0.0:1789049430.428894:0:6705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1789049430.428901:0:6705:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8df480a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3310:x1875954110605952:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789049430.428961:0:6705:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8df480a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3310:x1875954110605952:12345-0@lo:400:kworker.0 Request processed in 56us (504us total) trans 0 rc 0/0 00000100:00100000:0.0:1789049430.428968:0:6705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1789049430.429025:0:6705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1789049430.429032:0:6705:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8fce96680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3308:x1875954110606208:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789049430.429100:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8c6297c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7ef694ec-1ea0-4f02-800c-d1279b4fdf12+19:3308:x1875954110605568:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789049430.429138:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8c6297c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7ef694ec-1ea0-4f02-800c-d1279b4fdf12+19:3308:x1875954110605568:12345-0@lo:400:kworker.0 Request processed in 443us (803us total) trans 0 rc 0/0 00000100:00100000:3.0:1789049430.429145:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 218 00000100:00080000:3.0:1789049430.429179:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789049430.429184:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789049430.429939:0:6705:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8fce96680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3308:x1875954110606208:12345-0@lo:400:kworker.0 Request processed in 905us (1373us total) trans 0 rc 0/0 00000100:00100000:0.0:1789049430.429948:0:6705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1789049430.433461:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1789049430.433497:0:6841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1789049430.433553:0:6841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1789049430.433570:0:6841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8fce95880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1875954110605696:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789049430.436113:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789049430.436133:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb8df284e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3311:1875954110606336:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789049430.436208:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789049430.436261:0:6707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954110606336 00000100:00100000:3.0:1789049430.436269:0:6707:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954110606336 00000100:00100000:3.0:1789049430.436330:0:6707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1789049430.436339:0:6707:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8c59cbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1875954110606336:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789049430.436388:0:6707:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789049430.436433:0:6707:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8c59cbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1875954110606336:12345-0@lo:13:osp-pre-1-0.0 Request processed in 94us (225us total) trans 0 rc 0/0 00000100:00100000:3.0:1789049430.436440:0:6707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00010000:00080000:3.0:1789049430.436478:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cb8df284e00 x1875954110606336/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789049446 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789049430.436496:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb8df284e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3311:1875954110606336:0@lo:13:osp-pre-1-0.0 00010000:00080000:3.0:1789049430.436620:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cb8df287800 x1875954110605952/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789049446 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789049430.436696:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb8df287800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1875954110605952:0@lo:400:kworker.0 00000100:00100000:3.0:1789049430.436714:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb8df285f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3310:1875954110605824:0@lo:400:kworker.0 00010000:00080000:0.0:1789049430.438827:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cb8df284a80 x1875954110606208/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789049446 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789049430.438864:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb8df284a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1875954110606208:0@lo:400:kworker.0 00000100:00100000:0.0:1789049430.438879:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb8df285c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7ef694ec-1ea0-4f02-800c-d1279b4fdf12:3308:1875954110605568:0@lo:400:kworker.0 00000100:00100000:1.0:1789049430.439143:0:6841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8fce95880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1875954110605696:12345-0@lo:400:kworker.0 Request processed in 5580us (10619us total) trans 0 rc 0/0 00000100:00100000:1.0:1789049430.439156:0:6841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1789049430.441666:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb8df284380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3308:1875954110605696:0@lo:400:kworker.0 00000100:00100000:2.0:1789049430.444527:0:5852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8fce97800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1875954110606080:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789049430.445829:0:5852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8fce97800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1875954110606080:12345-0@lo:400:kworker.0 Request processed in 1318us (17367us total) trans 0 rc 0/0 00000100:00100000:2.0:1789049430.445956:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1789049430.446087:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb8df284700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3308:1875954110606080:0@lo:400:kworker.0 00010000:00010000:2.0:1789049430.758716:0:6719:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789049431.363252:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.26@tcp (source: 12345-192.168.206.26@tcp) 00000100:00100000:1.0:1789049431.363303:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.26@tcp (source: 12345-192.168.206.26@tcp) 00000100:00100000:1.0:1789049431.363327:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.26@tcp (source: 12345-192.168.206.26@tcp) 00000100:00100000:1.0:1789049431.363358:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.26@tcp (source: 12345-192.168.206.26@tcp) 00000100:00100000:1.0:1789049431.363377:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.26@tcp (source: 12345-192.168.206.26@tcp) 00000100:00100000:1.0:1789049431.363424:0:6705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954089603584 00000100:00100000:1.0:1789049431.363435:0:6705:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954089603584 00000100:00100000:0.0:1789049431.363442:0:6703:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954089603456 00000100:00100000:0.0:1789049431.363457:0:6703:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954089603456 00000100:00100000:1.0:1789049431.363508:0:6705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.26@tcp, seq: 33 00000100:00100000:2.0:1789049431.363560:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954089603072 00000100:00100000:2.0:1789049431.363566:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954089603072 00000100:00100000:2.0:1789049431.363596:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.26@tcp, seq: 219 00000100:00100000:2.0:1789049431.363604:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8c6295850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:de93d576-ed8d-4d27-ab00-9189a62cea33+13:2356:x1875954089603072:12345-192.168.206.26@tcp:400:kworker.0 00000100:00100000:2.0:1789049431.363684:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8c6295850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:de93d576-ed8d-4d27-ab00-9189a62cea33+13:2356:x1875954089603072:12345-192.168.206.26@tcp:400:kworker.0 Request processed in 80us (440us total) trans 0 rc 0/0 00000100:00100000:2.0:1789049431.363691:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.26@tcp, seq: 219 00000100:00100000:2.0:1789049431.363839:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954089603328 00000100:00100000:2.0:1789049431.363888:0:5850:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954089603328 00000100:00100000:2.0:1789049431.363917:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954089603200 00000100:00100000:2.0:1789049431.363920:0:5850:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954089603200 00000100:00100000:2.0:1789049431.363940:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.26@tcp, seq: 67 00000100:00100000:2.0:1789049431.363947:0:5850:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8fce94380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:59d63492-f1ee-4aa5-bf8c-853a603b0252+5:2356:x1875954089603328:12345-192.168.206.26@tcp:400:kworker.0 00000100:00100000:2.0:1789049431.363983:0:5850:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8fce94380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:59d63492-f1ee-4aa5-bf8c-853a603b0252+5:2356:x1875954089603328:12345-192.168.206.26@tcp:400:kworker.0 Request processed in 37us (680us total) trans 0 rc 0/0 00000100:00100000:2.0:1789049431.363989:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.26@tcp, seq: 67 00000100:00100000:2.0:1789049431.364002:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.26@tcp, seq: 68 00000100:00100000:2.0:1789049431.364008:0:5850:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8fce95500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e823b53a-3591-475c-8624-c682227e5c13+6:2356:x1875954089603200:12345-192.168.206.26@tcp:400:kworker.0 00000100:00100000:2.0:1789049431.364033:0:5850:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8fce95500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e823b53a-3591-475c-8624-c682227e5c13+6:2356:x1875954089603200:12345-192.168.206.26@tcp:400:kworker.0 Request processed in 25us (674us total) trans 0 rc 0/0 00000100:00100000:2.0:1789049431.364038:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.26@tcp, seq: 68 00000100:00100000:1.0:1789049431.364481:0:6705:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8fce97b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:59d63492-f1ee-4aa5-bf8c-853a603b0252+5:2356:x1875954089603584:12345-192.168.206.26@tcp:400:kworker.0 00000100:00100000:1.0:1789049431.364529:0:6705:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8fce97b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:59d63492-f1ee-4aa5-bf8c-853a603b0252+5:2356:x1875954089603584:12345-192.168.206.26@tcp:400:kworker.0 Request processed in 1011us (1201us total) trans 0 rc 0/0 00000100:00080000:3.0:1789049431.364718:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789049431.364723:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1789049431.364726:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789049431.371007:0:6703:0:(service.c:3467:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:3.0:1789049431.371026:0:6704:0:(service.c:3467:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:0.0:1789049431.371040:0:6703:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost00_003' 00000100:00100000:3.0:1789049431.371076:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.26@tcp, seq: 34 00000100:00100000:3.0:1789049431.371096:0:6704:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8fce94700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:59d63492-f1ee-4aa5-bf8c-853a603b0252+5:2356:x1875954089603456:12345-192.168.206.26@tcp:400:kworker.0 00000100:00100000:3.0:1789049431.371209:0:6704:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8fce94700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:59d63492-f1ee-4aa5-bf8c-853a603b0252+5:2356:x1875954089603456:12345-192.168.206.26@tcp:400:kworker.0 Request processed in 120us (7829us total) trans 0 rc 0/0 00000100:00100000:3.0:1789049431.371217:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.26@tcp, seq: 34 00000100:00100000:1.0:1789049431.372245:0:6705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.26@tcp, seq: 33 00010000:00010000:0.0:1789049431.772767:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789049432.805497:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789049433.828761:0:6719:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789049434.524781:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb8df480e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3311:1875954110606464:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789049434.524903:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789049434.529488:0:6707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954110606464 00000100:00100000:0.0:1789049434.529511:0:6707:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954110606464 00000100:00100000:0.0:1789049434.529877:0:6707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1789049434.529889:0:6707:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8fcf06680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1875954110606464:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789049434.529938:0:6707:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789049434.530043:0:6707:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8fcf06680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1875954110606464:12345-0@lo:13:osp-pre-0-0.0 Request processed in 156us (5140us total) trans 0 rc 0/0 00000100:00100000:0.0:1789049434.530049:0:6707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00010000:00080000:0.0:1789049434.530170:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cb8df480e00 x1875954110606464/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789049450 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789049434.530207:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb8df480e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3311:1875954110606464:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1789049434.539426:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1789049434.844446:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789049435.551135:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb8df481180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3310:1875954110606848:0@lo:400:kworker.0 00000100:00100000:2.0:1789049435.551227:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789049435.551309:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789049435.551317:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb8df483800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1875954110606976:0@lo:400:kworker.0 00000100:00100000:2.0:1789049435.551346:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789049435.551388:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954110606848 00000100:00100000:2.0:1789049435.551397:0:5850:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954110606848 00000100:00100000:2.0:1789049435.551484:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1789049435.551497:0:5850:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8df481f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1875954110606848:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789049435.551557:0:5850:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8df481f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1875954110606848:12345-0@lo:400:kworker.0 Request processed in 63us (328us total) trans 0 rc 0/0 00000100:00100000:2.0:1789049435.551579:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1789049435.551655:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb8df481180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3310:1875954110606848:0@lo:400:kworker.0 00000100:00100000:2.0:1789049435.551705:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954110606976 00000100:00100000:2.0:1789049435.551708:0:6704:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954110606976 00000100:00100000:2.0:1789049435.551737:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1789049435.551743:0:6704:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8df481880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3310:x1875954110606976:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789049435.551779:0:6704:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8df481880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3310:x1875954110606976:12345-0@lo:400:kworker.0 Request processed in 36us (432us total) trans 0 rc 0/0 00000100:00100000:2.0:1789049435.551784:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00010000:00080000:2.0:1789049435.551811:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cb8df483800 x1875954110606976/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789049451 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789049435.551822:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb8df483800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1875954110606976:0@lo:400:kworker.0 00000100:00100000:0.0:1789049435.552071:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb8df480700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7ef694ec-1ea0-4f02-800c-d1279b4fdf12:3308:1875954110606592:0@lo:400:kworker.0 00000100:00100000:0.0:1789049435.552118:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789049435.552147:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb8df480000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3308:1875954110607104:0@lo:400:kworker.0 00000100:00100000:0.0:1789049435.552171:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789049435.552193:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1789049435.552199:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb8df481500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3308:1875954110606720:0@lo:400:kworker.0 00000100:00100000:0.0:1789049435.552219:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789049435.552234:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb8df482d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1875954110607232:0@lo:400:kworker.0 00000100:00100000:0.0:1789049435.552266:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789049435.552306:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954110606592 00000100:00100000:0.0:1789049435.552310:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954110606592 00000100:00100000:0.0:1789049435.552340:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 220 00000100:00100000:0.0:1789049435.552347:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8c6295050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7ef694ec-1ea0-4f02-800c-d1279b4fdf12+19:3308:x1875954110606592:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789049435.552380:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8c6295050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7ef694ec-1ea0-4f02-800c-d1279b4fdf12+19:3308:x1875954110606592:12345-0@lo:400:kworker.0 Request processed in 34us (262us total) trans 0 rc 0/0 00000100:00100000:0.0:1789049435.552386:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 220 00000100:00100000:0.0:1789049435.552411:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954110607104 00000100:00100000:0.0:1789049435.552415:0:5851:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954110607104 00000100:00100000:0.0:1789049435.552437:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954110606720 00000100:00100000:0.0:1789049435.552440:0:5851:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954110606720 00000100:00100000:0.0:1789049435.552455:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1789049435.552472:0:5851:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8fcf07b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1875954110607104:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789049435.552504:0:5851:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8fcf07b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1875954110607104:12345-0@lo:400:kworker.0 Request processed in 42us (332us total) trans 0 rc 0/0 00000100:00100000:0.0:1789049435.552522:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1789049435.552534:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1789049435.552538:0:5851:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8fcf04380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1875954110606720:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789049435.552564:0:5851:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8fcf04380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1875954110606720:12345-0@lo:400:kworker.0 Request processed in 25us (344us total) trans 0 rc 0/0 00000100:00100000:0.0:1789049435.552569:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1789049435.552613:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb8df481500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3308:1875954110606720:0@lo:400:kworker.0 00000100:00100000:0.0:1789049435.552622:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb8df480700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7ef694ec-1ea0-4f02-800c-d1279b4fdf12:3308:1875954110606592:0@lo:400:kworker.0 00000100:00100000:0.0:1789049435.552630:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb8df480000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3308:1875954110607104:0@lo:400:kworker.0 00000100:00100000:2.0:1789049435.552937:0:10560:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954110607232 00000100:00100000:2.0:1789049435.552942:0:10560:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954110607232 00000100:00100000:2.0:1789049435.552981:0:10560:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1789049435.552989:0:10560:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8fcf06300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3308:x1875954110607232:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789049435.553028:0:10560:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8fcf06300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3308:x1875954110607232:12345-0@lo:400:kworker.0 Request processed in 41us (762us total) trans 0 rc 0/0 00000100:00100000:2.0:1789049435.553034:0:10560:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00010000:00080000:0.0:1789049435.553244:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cb8df482d80 x1875954110607232/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789049451 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789049435.553267:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb8df482d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1875954110607232:0@lo:400:kworker.0 00000100:00080000:0.0:1789049435.554790:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789049435.554803:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789049435.556627:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb8fce94000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1875954110607360:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789049435.556720:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789049435.556980:0:6707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954110607360 00000100:00100000:1.0:1789049435.556991:0:6707:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954110607360 00000100:00100000:1.0:1789049435.557060:0:6707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1789049435.557089:0:6707:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8df483800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1875954110607360:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789049435.557135:0:6707:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789049435.557194:0:6707:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8df483800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1875954110607360:12345-0@lo:13:osp-pre-1-0.0 Request processed in 107us (474us total) trans 0 rc 0/0 00000100:00100000:1.0:1789049435.557202:0:6707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00010000:00080000:1.0:1789049435.557247:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cb8fce94000 x1875954110607360/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789049451 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789049435.557284:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb8fce94000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1875954110607360:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1789049435.867003:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789049436.486628:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.26@tcp (source: 12345-192.168.206.26@tcp) 00000100:00100000:2.0:1789049436.486677:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.26@tcp (source: 12345-192.168.206.26@tcp) 00000100:00100000:2.0:1789049436.486707:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.26@tcp (source: 12345-192.168.206.26@tcp) 00000100:00100000:2.0:1789049436.486733:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.26@tcp (source: 12345-192.168.206.26@tcp) 00000100:00100000:2.0:1789049436.486775:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.26@tcp (source: 12345-192.168.206.26@tcp) 00000100:00100000:2.0:1789049436.486815:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954089604224 00000100:00100000:2.0:1789049436.486831:0:6704:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954089604224 00000100:00100000:2.0:1789049436.486936:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954089604096 00000100:00100000:2.0:1789049436.486940:0:6704:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954089604096 00000100:00100000:2.0:1789049436.486972:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.26@tcp, seq: 37 00000100:00100000:2.0:1789049436.486987:0:6704:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8df483100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:59d63492-f1ee-4aa5-bf8c-853a603b0252+5:2355:x1875954089604224:12345-192.168.206.26@tcp:400:kworker.0 00000100:00100000:2.0:1789049436.487083:0:6704:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8df483100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:59d63492-f1ee-4aa5-bf8c-853a603b0252+5:2355:x1875954089604224:12345-192.168.206.26@tcp:400:kworker.0 Request processed in 101us (375us total) trans 0 rc 0/0 00000100:00100000:2.0:1789049436.487093:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.26@tcp, seq: 37 00000100:00100000:2.0:1789049436.487115:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.26@tcp, seq: 38 00000100:00080000:3.0:1789049436.487120:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789049436.487126:0:6704:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8df480000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:59d63492-f1ee-4aa5-bf8c-853a603b0252+5:2355:x1875954089604096:12345-192.168.206.26@tcp:400:kworker.0 00000100:00080000:3.0:1789049436.487128:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789049436.487162:0:6704:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8df480000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:59d63492-f1ee-4aa5-bf8c-853a603b0252+5:2355:x1875954089604096:12345-192.168.206.26@tcp:400:kworker.0 Request processed in 40us (387us total) trans 0 rc 0/0 00000100:00100000:2.0:1789049436.487169:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.26@tcp, seq: 38 00000100:00100000:0.0:1789049436.487221:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954089603712 00000100:00100000:0.0:1789049436.487226:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954089603712 00000100:00100000:0.0:1789049436.487283:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.26@tcp, seq: 221 00000100:00100000:0.0:1789049436.487293:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8c6297850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:de93d576-ed8d-4d27-ab00-9189a62cea33+13:2355:x1875954089603712:12345-192.168.206.26@tcp:400:kworker.0 00000100:00100000:0.0:1789049436.487328:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8c6297850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:de93d576-ed8d-4d27-ab00-9189a62cea33+13:2355:x1875954089603712:12345-192.168.206.26@tcp:400:kworker.0 Request processed in 38us (722us total) trans 0 rc 0/0 00000100:00100000:0.0:1789049436.487335:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.26@tcp, seq: 221 00000100:00100000:0.0:1789049436.487374:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954089603968 00000100:00100000:0.0:1789049436.487378:0:5851:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954089603968 00000100:00100000:0.0:1789049436.487426:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954089603840 00000100:00100000:0.0:1789049436.487429:0:5851:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954089603840 00000100:00100000:0.0:1789049436.487449:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.26@tcp, seq: 72 00000100:00100000:0.0:1789049436.487456:0:5851:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8df481180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:59d63492-f1ee-4aa5-bf8c-853a603b0252+5:2355:x1875954089603968:12345-192.168.206.26@tcp:400:kworker.0 00000100:00100000:0.0:1789049436.487492:0:5851:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8df481180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:59d63492-f1ee-4aa5-bf8c-853a603b0252+5:2355:x1875954089603968:12345-192.168.206.26@tcp:400:kworker.0 Request processed in 37us (814us total) trans 0 rc 0/0 00000100:00100000:0.0:1789049436.487498:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.26@tcp, seq: 72 00000100:00100000:0.0:1789049436.487509:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.26@tcp, seq: 73 00000100:00100000:0.0:1789049436.487516:0:5851:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8df482d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e823b53a-3591-475c-8624-c682227e5c13+6:2355:x1875954089603840:12345-192.168.206.26@tcp:400:kworker.0 00000100:00100000:0.0:1789049436.487539:0:5851:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8df482d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e823b53a-3591-475c-8624-c682227e5c13+6:2355:x1875954089603840:12345-192.168.206.26@tcp:400:kworker.0 Request processed in 23us (805us total) trans 0 rc 0/0 00000100:00100000:0.0:1789049436.487544:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.26@tcp, seq: 73 00000100:00080000:2.0:1789049436.488057:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1789049436.892903:0:6719:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789049437.915543:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789049438.941523:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789049439.643403:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789049439.643435:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb8df480700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1875954110607488:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789049439.643528:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789049439.643876:0:6707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954110607488 00000100:00100000:2.0:1789049439.643886:0:6707:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954110607488 00000100:00100000:2.0:1789049439.643958:0:6707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1789049439.643969:0:6707:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8fce94000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1875954110607488:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789049439.644015:0:6707:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00080000:3.0:1789049439.644141:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789049439.644302:0:6707:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8fce94000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1875954110607488:12345-0@lo:13:osp-pre-0-0.0 Request processed in 334us (774us total) trans 0 rc 0/0 00000100:00100000:2.0:1789049439.644310:0:6707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00010000:00080000:1.0:1789049439.655335:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cb8df480700 x1875954110607488/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789049455 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789049439.655580:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb8df480700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1875954110607488:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1789049439.963081:0:6719:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789049440.668145:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb8df483b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3310:1875954110607872:0@lo:400:kworker.0 00000100:00100000:2.0:1789049440.668254:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789049440.668454:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789049440.668462:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb8df482300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1875954110608000:0@lo:400:kworker.0 00000100:00100000:2.0:1789049440.668496:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789049440.668552:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954110607872 00000100:00100000:2.0:1789049440.668563:0:5851:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954110607872 00000100:00100000:1.0:1789049440.668872:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb8df480e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3309:1875954110607744:0@lo:400:kworker.0 00000100:00100000:1.0:1789049440.668910:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789049440.668933:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb8df482a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3309:1875954110608256:0@lo:400:kworker.0 00000100:00100000:1.0:1789049440.668978:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789049440.669006:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:1.0:1789049440.669012:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb8df481500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:7ef694ec-1ea0-4f02-800c-d1279b4fdf12:3309:1875954110607616:0@lo:400:kworker.0 00000100:00100000:1.0:1789049440.669044:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789049440.669064:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb8df483480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3309:1875954110608128:0@lo:400:kworker.0 00000100:00100000:1.0:1789049440.669082:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789049440.669282:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954110607744 00000100:00100000:2.0:1789049440.669287:0:5851:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954110607744 00000100:00100000:2.0:1789049440.669799:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954110608128 00000100:00100000:2.0:1789049440.669804:0:5851:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954110608128 00000100:00100000:2.0:1789049440.669828:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1789049440.669838:0:5851:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8df480380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1875954110607872:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789049440.670011:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1789049440.670033:0:5852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8fce94a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1875954110607744:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789049440.670077:0:5852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8fce94a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1875954110607744:12345-0@lo:400:kworker.0 Request processed in 46us (1166us total) trans 0 rc 0/0 00000100:00100000:1.0:1789049440.670085:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1789049440.670105:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:2.0:1789049440.670269:0:5851:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8df480380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1875954110607872:12345-0@lo:400:kworker.0 Request processed in 431us (2015us total) trans 0 rc 0/0 00000100:00100000:2.0:1789049440.670276:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1789049440.670408:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb9009d4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1875954110608384:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789049440.670450:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789049440.670498:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb8df483b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3310:1875954110607872:0@lo:400:kworker.0 00000100:00100000:0.0:1789049440.670542:0:6706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954110608384 00000100:00100000:0.0:1789049440.670546:0:6706:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954110608384 00000100:00100000:0.0:1789049440.670593:0:6706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1789049440.670602:0:6706:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8fcf06a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1875954110608384:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1789049440.670636:0:6706:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789049440.670673:0:6706:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8fcf06a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1875954110608384:12345-0@lo:13:osp-pre-1-0.0 Request processed in 73us (223us total) trans 0 rc 0/0 00000100:00100000:0.0:1789049440.670679:0:6706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1789049440.670819:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954110608000 00000100:00100000:2.0:1789049440.670825:0:6704:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954110608000 00000100:00100000:2.0:1789049440.670878:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954110608256 00000100:00100000:2.0:1789049440.670881:0:6704:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954110608256 00000100:00100000:1.0:1789049440.671070:0:5852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb9009d5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1875954110608128:12345-0@lo:400:kworker.0 00010000:00080000:0.0:1789049440.671235:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cb9009d4a80 x1875954110608384/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789049456 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789049440.671270:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb9009d4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1875954110608384:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789049440.671783:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1789049440.671796:0:6704:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8df482680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3310:x1875954110608000:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789049440.671880:0:6704:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8df482680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3310:x1875954110608000:12345-0@lo:400:kworker.0 Request processed in 88us (3383us total) trans 0 rc 0/0 00000100:00100000:2.0:1789049440.671887:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1789049440.671913:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1789049440.671920:0:6704:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb9009d7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3309:x1875954110608256:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789049440.671948:0:6704:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb9009d7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3309:x1875954110608256:12345-0@lo:400:kworker.0 Request processed in 29us (2970us total) trans 0 rc 0/0 00000100:00100000:2.0:1789049440.671962:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00080000:2.0:1789049440.671986:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789049440.671992:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:2.0:1789049440.672034:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cb8df482300 x1875954110608000/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789049456 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789049440.672045:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb8df482300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1875954110608000:0@lo:400:kworker.0 00000100:00100000:2.0:1789049440.672095:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954110607616 00000100:00100000:2.0:1789049440.672101:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954110607616 00000100:00100000:1.0:1789049440.672209:0:5852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb9009d5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1875954110608128:12345-0@lo:400:kworker.0 Request processed in 1000us (2027us total) trans 0 rc 0/0 00000100:00100000:1.0:1789049440.672218:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:1.0:1789049440.672271:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb8df483480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3309:1875954110608128:0@lo:400:kworker.0 00000100:00100000:1.0:1789049440.672284:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb8df480e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3309:1875954110607744:0@lo:400:kworker.0 00010000:00080000:1.0:1789049440.672295:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cb8df482a00 x1875954110608256/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789049456 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789049440.672496:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb8df482a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3309:1875954110608256:0@lo:400:kworker.0 00000100:00100000:2.0:1789049440.673432:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 222 00000100:00100000:2.0:1789049440.673447:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8c6294850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7ef694ec-1ea0-4f02-800c-d1279b4fdf12+19:3309:x1875954110607616:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789049440.673544:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8c6294850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7ef694ec-1ea0-4f02-800c-d1279b4fdf12+19:3309:x1875954110607616:12345-0@lo:400:kworker.0 Request processed in 101us (4498us total) trans 0 rc 0/0 00000100:00100000:2.0:1789049440.673550:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 222 00000100:00100000:1.0:1789049440.673632:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb8df481500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:7ef694ec-1ea0-4f02-800c-d1279b4fdf12:3309:1875954110607616:0@lo:400:kworker.0 00010000:00010000:3.0:1789049440.986981:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789049441.615093:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.26@tcp (source: 12345-192.168.206.26@tcp) 00000100:00100000:1.0:1789049441.615142:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.26@tcp (source: 12345-192.168.206.26@tcp) 00000100:00100000:1.0:1789049441.615171:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.26@tcp (source: 12345-192.168.206.26@tcp) 00000100:00100000:1.0:1789049441.615195:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.26@tcp (source: 12345-192.168.206.26@tcp) 00000100:00100000:1.0:1789049441.615233:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.26@tcp (source: 12345-192.168.206.26@tcp) 00000100:00100000:3.0:1789049441.616091:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954089604352 00000100:00100000:3.0:1789049441.616104:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954089604352 00000100:00100000:3.0:1789049441.616165:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.26@tcp, seq: 223 00000100:00100000:3.0:1789049441.616175:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8c6295c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:de93d576-ed8d-4d27-ab00-9189a62cea33+13:2355:x1875954089604352:12345-192.168.206.26@tcp:400:kworker.0 00000100:00100000:3.0:1789049441.616277:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8c6295c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:de93d576-ed8d-4d27-ab00-9189a62cea33+13:2355:x1875954089604352:12345-192.168.206.26@tcp:400:kworker.0 Request processed in 102us (1103us total) trans 0 rc 0/0 00000100:00100000:3.0:1789049441.616286:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.26@tcp, seq: 223 00000100:00100000:3.0:1789049441.616563:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954089604736 00000100:00100000:3.0:1789049441.616568:0:6704:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954089604736 00000100:00100000:3.0:1789049441.616603:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954089604864 00000100:00100000:3.0:1789049441.616606:0:6704:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954089604864 00000100:00100000:3.0:1789049441.616628:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.26@tcp, seq: 14 00000100:00100000:3.0:1789049441.616635:0:6704:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb9009d4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:59d63492-f1ee-4aa5-bf8c-853a603b0252+5:2354:x1875954089604736:12345-192.168.206.26@tcp:9:kworker.0 00000020:00000080:3.0:1789049441.616659:0:6704:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xf4f48ce5e1bbee33 00000100:00080000:3.0:1789049441.616668:0:6704:0:(import.c:65:import_set_state_nolock()) ffff8cb8c62e7800 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1789049441.616710:0:6704:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:3.0:1789049441.617124:0:6704:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb9009d4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:59d63492-f1ee-4aa5-bf8c-853a603b0252+2:2354:x1875954089604736:12345-192.168.206.26@tcp:9:kworker.0 Request processed in 488us (1980us total) trans 0 rc 0/0 00000100:00100000:3.0:1789049441.617133:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.26@tcp, seq: 14 00000100:00100000:3.0:1789049441.617149:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.26@tcp, seq: 15 00000100:00100000:3.0:1789049441.617157:0:6704:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8d6a26c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:59d63492-f1ee-4aa5-bf8c-853a603b0252+5:2354:x1875954089604864:12345-192.168.206.26@tcp:9:kworker.0 00000020:00000080:3.0:1789049441.617170:0:6704:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xf4f48ce5e1bbee3a 00000100:00080000:3.0:1789049441.617177:0:6704:0:(import.c:65:import_set_state_nolock()) ffff8cb8c62e7000 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1789049441.617202:0:6704:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:3.0:1789049441.617410:0:6704:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8d6a26c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:59d63492-f1ee-4aa5-bf8c-853a603b0252+2:2354:x1875954089604864:12345-192.168.206.26@tcp:9:kworker.0 Request processed in 254us (2213us total) trans 0 rc 0/0 00000100:00100000:3.0:1789049441.617437:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.26@tcp, seq: 15 00000100:00100000:3.0:1789049441.617635:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954089604480 00000100:00100000:3.0:1789049441.617641:0:5851:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954089604480 00000100:00100000:3.0:1789049441.617669:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954089604608 00000100:00100000:3.0:1789049441.617673:0:5851:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954089604608 00000100:00100000:3.0:1789049441.617695:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.26@tcp, seq: 77 00000100:00100000:3.0:1789049441.617702:0:5851:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb9009d4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e823b53a-3591-475c-8624-c682227e5c13+6:2355:x1875954089604480:12345-192.168.206.26@tcp:400:kworker.0 00000100:00100000:3.0:1789049441.617733:0:5851:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb9009d4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e823b53a-3591-475c-8624-c682227e5c13+6:2355:x1875954089604480:12345-192.168.206.26@tcp:400:kworker.0 Request processed in 32us (2654us total) trans 0 rc 0/0 00000100:00100000:3.0:1789049441.617740:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.26@tcp, seq: 77 00000100:00100000:3.0:1789049441.617751:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.26@tcp, seq: 78 00000100:00100000:3.0:1789049441.617758:0:5851:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb9009d5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:59d63492-f1ee-4aa5-bf8c-853a603b0252+5:2355:x1875954089604608:12345-192.168.206.26@tcp:400:kworker.0 00000100:00100000:3.0:1789049441.617782:0:5851:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb9009d5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:59d63492-f1ee-4aa5-bf8c-853a603b0252+5:2355:x1875954089604608:12345-192.168.206.26@tcp:400:kworker.0 Request processed in 25us (2559us total) trans 0 rc 0/0 00000100:00100000:3.0:1789049441.617788:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.26@tcp, seq: 78 00010000:00010000:3.0:1789049441.617809:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1789049441.617955:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789049441.617961:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789049441.617963:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1789049441.617989:0:6719:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789049442.012139:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789049443.034990:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1789049443.312257:0:7663:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 59d63492-f1ee-4aa5-bf8c-853a603b0252 00000020:00000080:3.0:1789049443.312270:0:7663:0:(genops.c:885:class_export_put()) final put ffff8cb8c62e3800/59d63492-f1ee-4aa5-bf8c-853a603b0252 00000020:00000080:0.0:1789049443.313487:0:494:0:(genops.c:844:class_export_destroy()) destroying export ffff8cb8c62e3800/59d63492-f1ee-4aa5-bf8c-853a603b0252 for lustre-OST0001 00000020:00000080:0.0:1789049443.313574:0:494:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8cb8c62e7000 for lustre-OST0001 00010000:00010000:3.0:1789049444.059505:0:6719:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789049444.763574:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb8c59c9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3311:1875954110608512:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789049444.763681:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789049444.763949:0:6706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954110608512 00000100:00100000:3.0:1789049444.763982:0:6706:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954110608512 00000100:00100000:3.0:1789049444.764066:0:6706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1789049444.764078:0:6706:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8fcf07480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1875954110608512:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789049444.764123:0:6706:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789049444.764176:0:6706:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8fcf07480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1875954110608512:12345-0@lo:13:osp-pre-0-0.0 Request processed in 101us (495us total) trans 0 rc 0/0 00000100:00100000:3.0:1789049444.764184:0:6706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00010000:00080000:3.0:1789049444.764242:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cb8c59c9f80 x1875954110608512/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789049460 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789049444.764263:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb8c59c9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3311:1875954110608512:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1789049444.764483:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1789049445.085596:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1789049445.369947:0:6731:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 59d63492-f1ee-4aa5-bf8c-853a603b0252 00000020:00000080:2.0:1789049445.369958:0:6731:0:(genops.c:885:class_export_put()) final put ffff8cb8c62e4800/59d63492-f1ee-4aa5-bf8c-853a603b0252 00000020:00000080:0.0:1789049445.374653:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8cb8c62e4800/59d63492-f1ee-4aa5-bf8c-853a603b0252 for lustre-OST0000 00000020:00000080:1.0:1789049445.374799:0:8:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8cb8c62e7800 for lustre-OST0000 00000100:00100000:1.0:1789049445.788367:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb9009d5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1875954110608640:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789049445.788463:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789049445.788571:0:6706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954110608640 00000100:00100000:1.0:1789049445.788581:0:6706:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954110608640 00000100:00100000:1.0:1789049445.788657:0:6706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1789049445.788667:0:6706:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb9009d7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1875954110608640:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789049445.788714:0:6706:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789049445.788766:0:6706:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb9009d7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1875954110608640:12345-0@lo:13:osp-pre-1-0.0 Request processed in 100us (303us total) trans 0 rc 0/0 00000100:00100000:1.0:1789049445.788773:0:6706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00080000:1.0:1789049445.788797:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:1.0:1789049445.788831:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cb9009d5180 x1875954110608640/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789049461 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789049445.788875:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb9009d5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1875954110608640:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789049445.790604:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb9009d5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:7ef694ec-1ea0-4f02-800c-d1279b4fdf12:3309:1875954110608768:0@lo:400:kworker.0 00000100:00100000:1.0:1789049445.790670:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789049445.791235:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb9009d5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3309:1875954110609280:0@lo:400:kworker.0 00000100:00100000:1.0:1789049445.791275:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789049445.791308:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1789049445.791314:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb9009d5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3309:1875954110609152:0@lo:400:kworker.0 00000100:00100000:1.0:1789049445.791341:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789049445.791377:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb9009d4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3310:1875954110608896:0@lo:400:kworker.0 00000100:00100000:1.0:1789049445.791403:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789049445.791422:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789049445.791427:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb9009d6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3310:1875954110609024:0@lo:400:kworker.0 00000100:00100000:1.0:1789049445.791447:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789049445.791947:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954110609280 00000100:00100000:1.0:1789049445.791957:0:5851:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954110609280 00000100:00100000:1.0:1789049445.792185:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954110608896 00000100:00100000:1.0:1789049445.792189:0:5851:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954110608896 00000100:00100000:1.0:1789049445.792215:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954110609024 00000100:00100000:1.0:1789049445.792218:0:5851:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954110609024 00000100:00100000:1.0:1789049445.792236:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:1.0:1789049445.792244:0:5851:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb9009d7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1875954110609280:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789049445.792309:0:5851:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb9009d7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1875954110609280:12345-0@lo:400:kworker.0 Request processed in 65us (1033us total) trans 0 rc 0/0 00000100:00100000:1.0:1789049445.792316:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:1.0:1789049445.792588:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:1.0:1789049445.792597:0:5851:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb9009d7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1875954110608896:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789049445.792691:0:5851:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb9009d7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1875954110608896:12345-0@lo:400:kworker.0 Request processed in 95us (1286us total) trans 0 rc 0/0 00000100:00100000:1.0:1789049445.792707:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:1.0:1789049445.792721:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:1.0:1789049445.792726:0:5851:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb9009d4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1875954110609024:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789049445.792753:0:5851:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb9009d4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1875954110609024:12345-0@lo:400:kworker.0 Request processed in 27us (1305us total) trans 0 rc 0/0 00000100:00100000:1.0:1789049445.792758:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:1.0:1789049445.792780:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954110609152 00000100:00100000:1.0:1789049445.792783:0:6704:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954110609152 00000100:00100000:1.0:1789049445.792813:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1789049445.792820:0:6704:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb9009d6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3309:x1875954110609152:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789049445.792875:0:6704:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb9009d6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3309:x1875954110609152:12345-0@lo:400:kworker.0 Request processed in 55us (1533us total) trans 0 rc 0/0 00000100:00100000:1.0:1789049445.792881:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00080000:1.0:1789049445.792906:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:1.0:1789049445.792959:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cb9009d5f80 x1875954110609152/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789049461 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789049445.792975:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb9009d5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3309:1875954110609152:0@lo:400:kworker.0 00000100:00100000:1.0:1789049445.792999:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb9009d5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3309:1875954110609280:0@lo:400:kworker.0 00000100:00100000:3.0:1789049445.799004:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954110608768 00000100:00100000:3.0:1789049445.799018:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954110608768 00000100:00100000:3.0:1789049445.799082:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 224 00000100:00100000:3.0:1789049445.799092:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8c6296c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7ef694ec-1ea0-4f02-800c-d1279b4fdf12+19:3309:x1875954110608768:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789049445.799204:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8c6296c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7ef694ec-1ea0-4f02-800c-d1279b4fdf12+19:3309:x1875954110608768:12345-0@lo:400:kworker.0 Request processed in 106us (8526us total) trans 0 rc 0/0 00000100:00100000:3.0:1789049445.799213:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 224 00000100:00100000:0.0:1789049445.801581:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb9009d4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3310:1875954110608896:0@lo:400:kworker.0 00000100:00100000:1.0:1789049445.805824:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb9009d5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:7ef694ec-1ea0-4f02-800c-d1279b4fdf12:3309:1875954110608768:0@lo:400:kworker.0 00000100:00100000:1.0:1789049445.805901:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb9009d6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3310:1875954110609024:0@lo:400:kworker.0 00010000:00010000:3.0:1789049446.107063:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789049446.725592:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.26@tcp (source: 12345-192.168.206.26@tcp) 00000100:00100000:1.0:1789049446.725637:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.26@tcp (source: 12345-192.168.206.26@tcp) 00000100:00100000:1.0:1789049446.725691:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.26@tcp (source: 12345-192.168.206.26@tcp) 00000100:00100000:1.0:1789049446.725729:0:6841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954089605248 00000100:00100000:1.0:1789049446.725741:0:6841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954089605248 00000100:00100000:1.0:1789049446.725822:0:6841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954089605120 00000100:00100000:1.0:1789049446.725826:0:6841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954089605120 00000100:00100000:1.0:1789049446.725886:0:6841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.26@tcp, seq: 82 00000100:00100000:1.0:1789049446.725899:0:6841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb9009d6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:59d63492-f1ee-4aa5-bf8c-853a603b0252+5:2358:x1875954089605248:12345-192.168.206.26@tcp:400:kworker.0 00000100:00100000:2.0:1789049446.726103:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.26@tcp, seq: 83 00000100:00100000:2.0:1789049446.726114:0:5851:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb9009d5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e823b53a-3591-475c-8624-c682227e5c13+6:2358:x1875954089605120:12345-192.168.206.26@tcp:400:kworker.0 00000100:00100000:1.0:1789049446.726177:0:6841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb9009d6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:59d63492-f1ee-4aa5-bf8c-853a603b0252+5:2358:x1875954089605248:12345-192.168.206.26@tcp:400:kworker.0 Request processed in 280us (538us total) trans 0 rc 0/0 00000100:00100000:1.0:1789049446.726186:0:6841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.26@tcp, seq: 82 00000100:00080000:1.0:1789049446.726223:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789049446.727105:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954089604992 00000100:00100000:3.0:1789049446.727117:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954089604992 00000100:00100000:3.0:1789049446.727166:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.26@tcp, seq: 225 00000100:00100000:3.0:1789049446.727176:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8c6294450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:de93d576-ed8d-4d27-ab00-9189a62cea33+13:2358:x1875954089604992:12345-192.168.206.26@tcp:400:kworker.0 00000100:00100000:2.0:1789049446.737243:0:5851:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb9009d5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e823b53a-3591-475c-8624-c682227e5c13+6:2358:x1875954089605120:12345-192.168.206.26@tcp:400:kworker.0 Request processed in 11113us (11532us total) trans 0 rc 0/0 00000100:00100000:2.0:1789049446.737262:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.26@tcp, seq: 83 00000100:00100000:3.0:1789049446.740397:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8c6294450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:de93d576-ed8d-4d27-ab00-9189a62cea33+13:2358:x1875954089604992:12345-192.168.206.26@tcp:400:kworker.0 Request processed in 13202us (14798us total) trans 0 rc 0/0 00000100:00100000:3.0:1789049446.740415:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.26@tcp, seq: 225 00010000:00010000:0.0:1789049447.132607:0:6719:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1789049447.778074:0:11038:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00010000:00010000:2.0:1789049448.157158:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789049449.179109:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789049449.889257:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb8df482300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1875954110609408:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789049449.889322:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789049449.892805:0:6706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954110609408 00000100:00100000:2.0:1789049449.892821:0:6706:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954110609408 00000100:00100000:2.0:1789049449.892902:0:6706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1789049449.892912:0:6706:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8c59c9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1875954110609408:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789049449.892976:0:6706:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789049449.893049:0:6706:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8c59c9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1875954110609408:12345-0@lo:13:osp-pre-0-0.0 Request processed in 139us (3726us total) trans 0 rc 0/0 00000100:00100000:2.0:1789049449.893056:0:6706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00010000:00080000:3.0:1789049449.894569:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cb8df482300 x1875954110609408/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789049465 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789049449.894600:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb8df482300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1875954110609408:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1789049449.897080:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1789049450.205296:0:6719:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789049450.913209:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb9009d5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3311:1875954110609536:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789049450.913312:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789049450.915303:0:6706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954110609536 00000100:00100000:2.0:1789049450.915319:0:6706:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954110609536 00000100:00100000:2.0:1789049450.915396:0:6706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1789049450.915407:0:6706:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb9009d5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1875954110609536:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1789049450.915452:0:6706:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789049450.915544:0:6706:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb9009d5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1875954110609536:12345-0@lo:13:osp-pre-1-0.0 Request processed in 139us (2233us total) trans 0 rc 0/0 00000100:00100000:2.0:1789049450.915552:0:6706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00080000:2.0:1789049450.915575:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:2.0:1789049450.915617:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cb9009d5880 x1875954110609536/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789049466 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789049450.915640:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb9009d5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3311:1875954110609536:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789049450.926676:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb8fcf05c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7ef694ec-1ea0-4f02-800c-d1279b4fdf12:3308:1875954110609664:0@lo:400:kworker.0 00000100:00100000:3.0:1789049450.926791:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789049450.931911:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb8fcf04a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3309:1875954110609792:0@lo:400:kworker.0 00000100:00100000:1.0:1789049450.932014:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789049450.932268:0:6841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954110609792 00000100:00100000:2.0:1789049450.932279:0:6841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954110609792 00000100:00100000:2.0:1789049450.932347:0:6841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:2.0:1789049450.932358:0:6841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb9009d6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1875954110609792:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789049450.932426:0:6841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb9009d6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1875954110609792:12345-0@lo:400:kworker.0 Request processed in 70us (413us total) trans 0 rc 0/0 00000100:00100000:2.0:1789049450.932433:0:6841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:1.0:1789049450.932916:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb8fcf04a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3309:1875954110609792:0@lo:400:kworker.0 00000100:00100000:2.0:1789049450.932999:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954110609664 00000100:00100000:2.0:1789049450.933005:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954110609664 00000100:00100000:2.0:1789049450.933041:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 226 00000100:00100000:2.0:1789049450.933058:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8c6295450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7ef694ec-1ea0-4f02-800c-d1279b4fdf12+19:3308:x1875954110609664:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789049450.936717:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1789049450.936739:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb8fcf04e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3311:1875954110609920:0@lo:400:kworker.0 00000100:00100000:1.0:1789049450.937973:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789049450.937990:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb9009d6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1875954110610048:0@lo:400:kworker.0 00000100:00100000:1.0:1789049450.938062:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789049450.938119:0:6703:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954110610048 00000100:00100000:1.0:1789049450.938127:0:6703:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954110610048 00000100:00100000:1.0:1789049450.938190:0:6703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1789049450.938199:0:6703:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb9009d5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3310:x1875954110610048:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789049450.938255:0:6703:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb9009d5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3310:x1875954110610048:12345-0@lo:400:kworker.0 Request processed in 57us (193us total) trans 0 rc 0/0 00000100:00100000:1.0:1789049450.938262:0:6703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00010000:00080000:1.0:1789049450.938306:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cb9009d6a00 x1875954110610048/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789049466 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789049450.938321:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb9009d6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1875954110610048:0@lo:400:kworker.0 00000100:00100000:1.0:1789049450.938358:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1789049450.938365:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb9009d6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3309:1875954110610176:0@lo:400:kworker.0 00000100:00100000:1.0:1789049450.938390:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789049450.938413:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954110610176 00000100:00100000:1.0:1789049450.938417:0:5852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954110610176 00000100:00100000:1.0:1789049450.938452:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:1.0:1789049450.938458:0:5852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb9009d4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1875954110610176:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789049450.938488:0:5852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb9009d4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1875954110610176:12345-0@lo:400:kworker.0 Request processed in 31us (97us total) trans 0 rc 0/0 00000100:00100000:1.0:1789049450.938494:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00080000:1.0:1789049450.938508:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789049450.938527:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb9009d6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3309:1875954110610176:0@lo:400:kworker.0 00000100:00100000:0.0:1789049450.939876:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789049450.939944:0:6841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954110609920 00000100:00100000:0.0:1789049450.939952:0:6841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954110609920 00000100:00100000:0.0:1789049450.940006:0:6841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:0.0:1789049450.940015:0:6841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8fcf04700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1875954110609920:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789049450.940068:0:6841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8fcf04700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1875954110609920:12345-0@lo:400:kworker.0 Request processed in 53us (198us total) trans 0 rc 0/0 00000100:00100000:0.0:1789049450.940075:0:6841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:0.0:1789049450.940114:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb8fcf04e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3311:1875954110609920:0@lo:400:kworker.0 00000100:00080000:0.0:1789049450.940141:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789049450.940935:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8c6295450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7ef694ec-1ea0-4f02-800c-d1279b4fdf12+19:3308:x1875954110609664:12345-0@lo:400:kworker.0 Request processed in 7872us (14157us total) trans 0 rc 0/0 00000100:00100000:2.0:1789049450.940948:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 226 00000100:00100000:3.0:1789049450.942156:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb8fcf05c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7ef694ec-1ea0-4f02-800c-d1279b4fdf12:3308:1875954110609664:0@lo:400:kworker.0 00010000:00010000:0.0:1789049451.237219:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789049451.843460:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.26@tcp (source: 12345-192.168.206.26@tcp) 00000100:00100000:1.0:1789049451.843501:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.26@tcp (source: 12345-192.168.206.26@tcp) 00000100:00100000:1.0:1789049451.843528:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.26@tcp (source: 12345-192.168.206.26@tcp) 00000100:00100000:1.0:1789049451.843558:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954089605632 00000100:00100000:1.0:1789049451.843569:0:5852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954089605632 00000100:00100000:1.0:1789049451.843639:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954089605504 00000100:00100000:1.0:1789049451.843641:0:5852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954089605504 00000100:00100000:1.0:1789049451.843663:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.26@tcp, seq: 87 00000100:00100000:1.0:1789049451.843673:0:5852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb9009d6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:59d63492-f1ee-4aa5-bf8c-853a603b0252+5:2357:x1875954089605632:12345-192.168.206.26@tcp:400:kworker.0 00000100:00100000:1.0:1789049451.843757:0:5852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb9009d6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:59d63492-f1ee-4aa5-bf8c-853a603b0252+5:2357:x1875954089605632:12345-192.168.206.26@tcp:400:kworker.0 Request processed in 85us (254us total) trans 0 rc 0/0 00000100:00100000:1.0:1789049451.843766:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.26@tcp, seq: 87 00000100:00100000:1.0:1789049451.843784:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.26@tcp, seq: 88 00000100:00100000:1.0:1789049451.843791:0:5852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb9009d7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e823b53a-3591-475c-8624-c682227e5c13+6:2357:x1875954089605504:12345-192.168.206.26@tcp:400:kworker.0 00000100:00100000:1.0:1789049451.843815:0:5852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb9009d7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e823b53a-3591-475c-8624-c682227e5c13+6:2357:x1875954089605504:12345-192.168.206.26@tcp:400:kworker.0 Request processed in 25us (286us total) trans 0 rc 0/0 00000100:00100000:1.0:1789049451.843821:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.26@tcp, seq: 88 00000100:00100000:2.0:1789049451.843964:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954089605376 00000100:00100000:2.0:1789049451.843968:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954089605376 00000100:00100000:2.0:1789049451.844010:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.26@tcp, seq: 227 00000100:00100000:2.0:1789049451.844017:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8c6296850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:de93d576-ed8d-4d27-ab00-9189a62cea33+13:2357:x1875954089605376:12345-192.168.206.26@tcp:400:kworker.0 00000100:00100000:2.0:1789049451.844046:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8c6296850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:de93d576-ed8d-4d27-ab00-9189a62cea33+13:2357:x1875954089605376:12345-192.168.206.26@tcp:400:kworker.0 Request processed in 30us (600us total) trans 0 rc 0/0 00000100:00100000:2.0:1789049451.844052:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.26@tcp, seq: 227 00000100:00080000:1.0:1789049451.846609:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1789049452.251957:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1789049452.693278:0:11185:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffe13985500 20000000:00000080:3.0:1789049452.693298:0:11185:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff8cb900c1cc00 uarg=0000000000000000 20000000:01000000:3.0:1789049452.693342:0:11185:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:3.0:1789049452.693348:0:11185:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:3.0:1789049452.693354:0:11185:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:3.0:1789049452.694364:0:11186:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 5 count 7 20000000:00000400:1.0:1789049452.694658:0:11185:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 10000000:01000000:1.0:1789049452.701131:0:11185:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:1.0:1789049452.701208:0:11185:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8cb8c146ca00/0xf4f48ce5e1bbee41 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049452.701230:0:11185:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8cb8c146dc00/0xf4f48ce5e1bbeded lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf4f48ce5e1bbede6 expref: 18 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049452.701237:0:11185:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8cb8c146d200/0xf4f48ce5e1bbedfb lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf4f48ce5e1bbedf4 expref: 18 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049452.701265:0:11185:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8cb7c4c38c00/0xf4f48ce5e1bbee09 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf4f48ce5e1bbee02 expref: 18 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049452.701278:0:11185:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8cb7c4c38800/0xf4f48ce5e1bbee10 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a32b1 expref: 12 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049452.701285:0:11185:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8cb8d6715c00/0xf4f48ce5e1bbee25 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a32e9 expref: 12 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049452.701293:0:11185:0:(ldlm_resource.c:1751:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8cb8c146ca00/0xf4f48ce5e1bbee41 lrc: 8/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 11185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049452.701346:0:11185:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8cb8d6715c00/0xf4f48ce5e1bbee25 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a32e9 expref: 12 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049452.701363:0:11185:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8cb8d6715c00/0xf4f48ce5e1bbee25 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a32e9 expref: 12 pid: 5843 timeout: 378 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789049452.701446:0:11185:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb9009d4700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11185:1875954110610304:192.168.206.26@tcp:104: 00010000:00010000:1.0:1789049452.701672:0:11185:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8cb7c4c38800/0xf4f48ce5e1bbee10 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a32b1 expref: 12 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049452.701682:0:11185:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8cb7c4c38800/0xf4f48ce5e1bbee10 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a32b1 expref: 12 pid: 5845 timeout: 378 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789049452.701692:0:11185:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb9009d4a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11185:1875954110610432:192.168.206.26@tcp:104: 00010000:00010000:1.0:1789049452.701746:0:11185:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8cb7c4c38c00/0xf4f48ce5e1bbee09 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf4f48ce5e1bbee02 expref: 18 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049452.701765:0:11185:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8cb7c4c38c00/0xf4f48ce5e1bbee09 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf4f48ce5e1bbee02 expref: 18 pid: 5844 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789049452.701776:0:11185:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb8f7745c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11185:1875954110610560:0@lo:104: 00000100:00100000:1.0:1789049452.701825:0:11185:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1789049452.701908:0:11185:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8cb8c146d200/0xf4f48ce5e1bbedfb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf4f48ce5e1bbedf4 expref: 18 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049452.701917:0:11185:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8cb8c146d200/0xf4f48ce5e1bbedfb lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf4f48ce5e1bbedf4 expref: 18 pid: 5845 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789049452.701925:0:11185:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb8f7744e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11185:1875954110610688:0@lo:104: 00000100:00100000:1.0:1789049452.702012:0:11185:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1789049452.702034:0:11185:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8cb8c146dc00/0xf4f48ce5e1bbeded lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf4f48ce5e1bbede6 expref: 18 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049452.702042:0:11185:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8cb8c146dc00/0xf4f48ce5e1bbeded lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf4f48ce5e1bbede6 expref: 18 pid: 5844 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789049452.702051:0:11185:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb8f7745500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11185:1875954110610816:0@lo:104: 00000100:00100000:1.0:1789049452.702069:0:11185:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789049452.702087:0:11185:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cb8c79e09c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789049452.702189:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954110610560 00000100:00100000:0.0:1789049452.702199:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954110610560 00000100:00100000:0.0:1789049452.702249:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954110610688 00000100:00100000:0.0:1789049452.702252:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954110610688 00000100:00100000:0.0:1789049452.702260:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954110610816 00000100:00100000:0.0:1789049452.702262:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954110610816 00000100:00100000:0.0:1789049452.702274:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1789049452.702284:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8f7744a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:7ef694ec-1ea0-4f02-800c-d1279b4fdf12+5:11185:x1875954110610560:12345-0@lo:104: 00010000:00010000:0.0:1789049452.702297:0:5833:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.126@tcp lock: ffff8cb8c146d800/0xf4f48ce5e1bbee02 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xf4f48ce5e1bbee09 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049452.702360:0:5833:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1789049452.702366:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8f7744a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:7ef694ec-1ea0-4f02-800c-d1279b4fdf12+5:11185:x1875954110610560:12345-0@lo:104: Request processed in 84us (542us total) trans 0 rc 0/0 00000100:00100000:0.0:1789049452.702381:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1789049452.702398:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1789049452.702403:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8f7744700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:7ef694ec-1ea0-4f02-800c-d1279b4fdf12+4:11185:x1875954110610688:12345-0@lo:104: 00010000:00010000:0.0:1789049452.702411:0:5833:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.126@tcp lock: ffff8cb8c146c200/0xf4f48ce5e1bbedf4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xf4f48ce5e1bbedfb expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049452.702443:0:5833:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1789049452.702449:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8f7744700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:7ef694ec-1ea0-4f02-800c-d1279b4fdf12+4:11185:x1875954110610688:12345-0@lo:104: Request processed in 45us (436us total) trans 0 rc 0/0 00000100:00100000:0.0:1789049452.702456:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1789049452.702469:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1789049452.702475:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8f7745180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:7ef694ec-1ea0-4f02-800c-d1279b4fdf12+3:11185:x1875954110610816:12345-0@lo:104: 00010000:00010000:0.0:1789049452.702481:0:5833:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.126@tcp lock: ffff8cb8d6715200/0xf4f48ce5e1bbede6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xf4f48ce5e1bbeded expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049452.702526:0:5833:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:0.0:1789049452.702537:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8f7745180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:7ef694ec-1ea0-4f02-800c-d1279b4fdf12+3:11185:x1875954110610816:12345-0@lo:104: Request processed in 63us (467us total) trans 0 rc 0/0 00000100:00100000:0.0:1789049452.702543:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00010000:00010000:0.0:1789049452.702562:0:6719:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1789049452.702569:0:6719:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.126@tcp lock: ffff8cb8c146d800/0xf4f48ce5e1bbee02 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xf4f48ce5e1bbee09 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049452.702578:0:6719:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cb8c146d800 already unused, calling callback (ffffffffc1ca3c20) 10000000:00010000:0.0:1789049452.702582:0:6719:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.126@tcp lock: ffff8cb8c146d800/0xf4f48ce5e1bbee02 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xf4f48ce5e1bbee09 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049452.702592:0:6719:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.126@tcp lock: ffff8cb8c146d800/0xf4f48ce5e1bbee02 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xf4f48ce5e1bbee09 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789049452.702599:0:6719:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.126@tcp lock: ffff8cb8c146d800/0xf4f48ce5e1bbee02 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xf4f48ce5e1bbee09 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789049452.702607:0:6719:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1789049452.702634:0:6719:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.126@tcp lock: ffff8cb8c146d800/0xf4f48ce5e1bbee02 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf4f48ce5e1bbee09 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049452.702641:0:6719:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789049452.702666:0:6719:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.126@tcp lock: ffff8cb8c146d800/0xf4f48ce5e1bbee02 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf4f48ce5e1bbee09 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049452.702673:0:6719:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.126@tcp lock: ffff8cb8c146d800/0xf4f48ce5e1bbee02 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf4f48ce5e1bbee09 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049452.702687:0:6719:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1789049452.702691:0:6719:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.126@tcp lock: ffff8cb8c146c200/0xf4f48ce5e1bbedf4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xf4f48ce5e1bbedfb expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049452.702707:0:6719:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cb8c146c200 already unused, calling callback (ffffffffc1ca3c20) 10000000:00010000:0.0:1789049452.702710:0:6719:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.126@tcp lock: ffff8cb8c146c200/0xf4f48ce5e1bbedf4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xf4f48ce5e1bbedfb expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049452.702717:0:6719:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.126@tcp lock: ffff8cb8c146c200/0xf4f48ce5e1bbedf4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xf4f48ce5e1bbedfb expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789049452.702723:0:6719:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.126@tcp lock: ffff8cb8c146c200/0xf4f48ce5e1bbedf4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xf4f48ce5e1bbedfb expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789049452.702728:0:6719:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1789049452.702743:0:6719:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.126@tcp lock: ffff8cb8c146c200/0xf4f48ce5e1bbedf4 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf4f48ce5e1bbedfb expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049452.702749:0:6719:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789049452.702765:0:6719:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.126@tcp lock: ffff8cb8c146c200/0xf4f48ce5e1bbedf4 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf4f48ce5e1bbedfb expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049452.702772:0:6719:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.126@tcp lock: ffff8cb8c146c200/0xf4f48ce5e1bbedf4 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf4f48ce5e1bbedfb expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049452.702782:0:6719:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789049452.702785:0:6719:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.126@tcp lock: ffff8cb8d6715200/0xf4f48ce5e1bbede6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xf4f48ce5e1bbeded expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049452.702790:0:6719:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cb8d6715200 already unused, calling callback (ffffffffc1ca3c20) 10000000:00010000:0.0:1789049452.702793:0:6719:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.126@tcp lock: ffff8cb8d6715200/0xf4f48ce5e1bbede6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xf4f48ce5e1bbeded expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049452.702809:0:6719:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.126@tcp lock: ffff8cb8d6715200/0xf4f48ce5e1bbede6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xf4f48ce5e1bbeded expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789049452.702816:0:6719:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.126@tcp lock: ffff8cb8d6715200/0xf4f48ce5e1bbede6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xf4f48ce5e1bbeded expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789049452.702822:0:6719:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1789049452.702834:0:6719:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.126@tcp lock: ffff8cb8d6715200/0xf4f48ce5e1bbede6 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf4f48ce5e1bbeded expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049452.702840:0:6719:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789049452.702870:0:6719:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.126@tcp lock: ffff8cb8d6715200/0xf4f48ce5e1bbede6 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf4f48ce5e1bbeded expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049452.702877:0:6719:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.126@tcp lock: ffff8cb8d6715200/0xf4f48ce5e1bbede6 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf4f48ce5e1bbeded expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049452.702891:0:6719:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789049452.702893:0:6719:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789049452.702895:0:6719:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789049452.702901:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789049452.702907:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789049452.702917:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb8fcf04e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:7ef694ec-1ea0-4f02-800c-d1279b4fdf12:3309:1875954110610944:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789049452.702965:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789049452.703002:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb8fcf05500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7ef694ec-1ea0-4f02-800c-d1279b4fdf12:3310:1875954110611072:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789049452.703024:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789049452.703046:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789049452.703051:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb8fcf05c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7ef694ec-1ea0-4f02-800c-d1279b4fdf12:3310:1875954110611200:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789049452.703080:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789049452.703110:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954110610944 00000100:00100000:0.0:1789049452.703116:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954110610944 00010000:00010000:0.0:1789049452.703139:0:5835:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8cb7c4c38c00/0xf4f48ce5e1bbee09 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf4f48ce5e1bbee02 expref: 19 pid: 5844 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789049452.703170:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954110611072 00000100:00100000:0.0:1789049452.703173:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954110611072 00010000:00010000:0.0:1789049452.703184:0:5835:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8cb8c146d200/0xf4f48ce5e1bbedfb lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf4f48ce5e1bbedf4 expref: 20 pid: 5845 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789049452.703193:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954110611200 00000100:00100000:0.0:1789049452.703195:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954110611200 00010000:00010000:0.0:1789049452.703205:0:5835:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8cb8c146dc00/0xf4f48ce5e1bbeded lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf4f48ce5e1bbede6 expref: 21 pid: 5844 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789049452.703216:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1789049452.703222:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8c7dee850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7ef694ec-1ea0-4f02-800c-d1279b4fdf12+21:3309:x1875954110610944:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789049452.703233:0:5835:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789049452.703238:0:5835:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8cb7c4c38c00/0xf4f48ce5e1bbee09 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf4f48ce5e1bbee02 expref: 21 pid: 5844 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049452.703247:0:5835:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8cb7c4c38c00/0xf4f48ce5e1bbee09 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf4f48ce5e1bbee02 expref: 21 pid: 5844 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049452.703264:0:5835:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789049452.703288:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8c7dee850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7ef694ec-1ea0-4f02-800c-d1279b4fdf12+21:3309:x1875954110610944:12345-0@lo:103:ldlm_bl.0 Request processed in 66us (323us total) trans 0 rc 0/0 00000100:00100000:0.0:1789049452.703295:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1789049452.703334:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1789049452.703345:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8fcf04a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7ef694ec-1ea0-4f02-800c-d1279b4fdf12+20:3310:x1875954110611072:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789049452.703352:0:5835:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789049452.703356:0:5835:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8cb8c146d200/0xf4f48ce5e1bbedfb lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf4f48ce5e1bbedf4 expref: 20 pid: 5845 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049452.703365:0:5835:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8cb8c146d200/0xf4f48ce5e1bbedfb lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf4f48ce5e1bbedf4 expref: 20 pid: 5845 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049452.703374:0:5835:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789049452.703395:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8fcf04a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7ef694ec-1ea0-4f02-800c-d1279b4fdf12+20:3310:x1875954110611072:12345-0@lo:103:ldlm_bl.0 Request processed in 50us (370us total) trans 0 rc 0/0 00000100:00100000:0.0:1789049452.703401:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1789049452.703412:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1789049452.703418:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8fcf07800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7ef694ec-1ea0-4f02-800c-d1279b4fdf12+19:3310:x1875954110611200:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789049452.703424:0:5835:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789049452.703428:0:5835:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8cb8c146dc00/0xf4f48ce5e1bbeded lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf4f48ce5e1bbede6 expref: 19 pid: 5844 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049452.703436:0:5835:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8cb8c146dc00/0xf4f48ce5e1bbeded lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf4f48ce5e1bbede6 expref: 19 pid: 5844 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049452.703445:0:5835:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789049452.703461:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8fcf07800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7ef694ec-1ea0-4f02-800c-d1279b4fdf12+19:3310:x1875954110611200:12345-0@lo:103:ldlm_bl.0 Request processed in 44us (381us total) trans 0 rc 0/0 00000100:00100000:0.0:1789049452.703467:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1789049452.703506:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb8fcf04e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:7ef694ec-1ea0-4f02-800c-d1279b4fdf12:3309:1875954110610944:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789049452.703527:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb8fcf05c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7ef694ec-1ea0-4f02-800c-d1279b4fdf12:3310:1875954110611200:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789049452.703533:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb8fcf05500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7ef694ec-1ea0-4f02-800c-d1279b4fdf12:3310:1875954110611072:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789049452.705416:0:11185:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cb7c4c38c00/0xf4f48ce5e1bbee09 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf4f48ce5e1bbee02 expref: 18 pid: 5844 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789049452.705438:0:11185:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb8f7745c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11185:1875954110610560:0@lo:104: 00010000:00010000:1.0:1789049452.705458:0:11185:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cb8c146d200/0xf4f48ce5e1bbedfb lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf4f48ce5e1bbedf4 expref: 17 pid: 5845 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789049452.705490:0:11185:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb8f7744e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11185:1875954110610688:0@lo:104: 00010000:00010000:1.0:1789049452.705505:0:11185:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cb8c146dc00/0xf4f48ce5e1bbeded lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf4f48ce5e1bbede6 expref: 16 pid: 5844 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789049452.705690:0:11185:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb8f7745500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11185:1875954110610816:0@lo:104: 00000100:00100000:3.0:1789049452.716356:0:11185:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb9009d4700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11185:1875954110610304:192.168.206.26@tcp:104: 00000100:00100000:3.0:1789049452.716389:0:11185:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb9009d4a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11185:1875954110610432:192.168.206.26@tcp:104: 00010000:00010000:3.0:1789049452.716433:0:11185:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8cb8c146ca00/0xf4f48ce5e1bbee41 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 11185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789049452.716487:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.26@tcp (source: 12345-192.168.206.26@tcp) 00000100:00100000:0.0:1789049452.716599:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954089605760 00000100:00100000:0.0:1789049452.716608:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954089605760 00010000:00010000:0.0:1789049452.716655:0:5835:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8cb7c4c38800/0xf4f48ce5e1bbee10 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a32b1 expref: 13 pid: 5845 timeout: 378 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789049452.716698:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.26@tcp, seq: 28 00000100:00100000:0.0:1789049452.716709:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8f7747800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:de93d576-ed8d-4d27-ab00-9189a62cea33+13:2357:x1875954089605760:12345-192.168.206.26@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789049452.716728:0:5835:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789049452.716735:0:5835:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8cb7c4c38800/0xf4f48ce5e1bbee10 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a32b1 expref: 13 pid: 5845 timeout: 378 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049452.716746:0:5835:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8cb7c4c38800/0xf4f48ce5e1bbee10 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a32b1 expref: 13 pid: 5845 timeout: 378 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049452.716768:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cb7c4c38800/0xf4f48ce5e1bbee10 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a32b1 expref: 13 pid: 5845 timeout: 378 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049452.716783:0:5835:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789049452.716884:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8f7747800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:de93d576-ed8d-4d27-ab00-9189a62cea33+12:2357:x1875954089605760:12345-192.168.206.26@tcp:103:ldlm_bl.0 Request processed in 176us (397us total) trans 0 rc 0/0 00000100:00100000:0.0:1789049452.716893:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.26@tcp, seq: 28 00000100:00100000:3.0:1789049452.718405:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.26@tcp (source: 12345-192.168.206.26@tcp) 00000100:00100000:0.0:1789049452.718512:0:6720:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954089605888 00000100:00100000:0.0:1789049452.718521:0:6720:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954089605888 00010000:00010000:0.0:1789049452.718555:0:6720:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8cb8d6715c00/0xf4f48ce5e1bbee25 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a32e9 expref: 12 pid: 5843 timeout: 378 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789049452.718592:0:6720:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.26@tcp, seq: 29 00000100:00100000:0.0:1789049452.718601:0:6720:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8c59cb100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:de93d576-ed8d-4d27-ab00-9189a62cea33+12:2356:x1875954089605888:12345-192.168.206.26@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789049452.718634:0:6720:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789049452.718639:0:6720:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8cb8d6715c00/0xf4f48ce5e1bbee25 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a32e9 expref: 12 pid: 5843 timeout: 378 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049452.718649:0:6720:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8cb8d6715c00/0xf4f48ce5e1bbee25 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a32e9 expref: 12 pid: 5843 timeout: 378 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049452.718666:0:6720:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cb8d6715c00/0xf4f48ce5e1bbee25 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a32e9 expref: 12 pid: 5843 timeout: 378 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049452.718682:0:6720:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8cb8c146ca00/0xf4f48ce5e1bbee41 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 11185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049452.718691:0:6720:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cb8c146ca00/0xf4f48ce5e1bbee41 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 11185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049452.718707:0:6720:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8cb8c146ca00/0xf4f48ce5e1bbee41 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 11185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049452.718715:0:6720:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8cb8c146ca00/0xf4f48ce5e1bbee41 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049452.718723:0:6720:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8cb8c146ca00/0xf4f48ce5e1bbee41 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049452.718730:0:6720:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8cb8c146ca00/0xf4f48ce5e1bbee41 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049452.718737:0:6720:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cb8c146ca00 already unused, calling callback (ffffffffc166a8f0) 00010000:00010000:0.0:1789049452.718742:0:6720:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8cb8c146ca00/0xf4f48ce5e1bbee41 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049452.718759:0:6720:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8cb8c146ca00/0xf4f48ce5e1bbee41 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 11185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049452.718780:0:6720:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8cb8c146ca00/0xf4f48ce5e1bbee41 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049452.718790:0:6720:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789049452.718947:0:6720:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8c59cb100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:de93d576-ed8d-4d27-ab00-9189a62cea33+11:2356:x1875954089605888:12345-192.168.206.26@tcp:103:ldlm_bl.0 Request processed in 345us (551us total) trans 0 rc 0/0 00000100:00100000:0.0:1789049452.718956:0:6720:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.26@tcp, seq: 29 00010000:00010000:3.0:1789049452.719153:0:11185:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8cb8c146ca00/0xf4f48ce5e1bbee41 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049452.719172:0:11185:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8cb8c146ca00/0xf4f48ce5e1bbee41 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049452.719187:0:11185:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cb8c146ca00/0xf4f48ce5e1bbee41 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049453.275241:0:6719:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1789049454.042942:0:5848:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1789049454.042954:0:5848:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8cb8c631b800 from 7 10000000:01000000:1.0:1789049454.042961:0:5848:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1789049454.043300:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.126@tcp lock: ffff8cb8c146d200/0xf4f48ce5e1bbee48 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049454.043316:0:5848:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.126@tcp lock: ffff8cb8c146d200/0xf4f48ce5e1bbee48 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049454.043329:0:5848:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.126@tcp lock: ffff8cb8c146d200/0xf4f48ce5e1bbee48 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789049454.043362:0:5848:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb8f7744000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7ef694ec-1ea0-4f02-800c-d1279b4fdf12:5848:1875954110611328:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1789049454.043457:0:5848:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789049454.043586:0:5848:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cb8c79e0300 going to sleep for 11 seconds 00000100:00100000:2.0:1789049454.043675:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954110611328 00000100:00100000:2.0:1789049454.043684:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954110611328 00000100:00100000:2.0:1789049454.043758:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 228 00000100:00100000:2.0:1789049454.043769:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8c6296050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7ef694ec-1ea0-4f02-800c-d1279b4fdf12+16:5848:x1875954110611328:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789049454.043786:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789049454.043814:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cb8d6714c00/0xf4f48ce5e1bbee4f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xf4f48ce5e1bbee48 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049454.043866:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cb8d6714c00/0xf4f48ce5e1bbee4f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf4f48ce5e1bbee48 expref: 17 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049454.043880:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cb8d6714c00/0xf4f48ce5e1bbee4f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf4f48ce5e1bbee48 expref: 17 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049454.043890:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cb8d6714c00, rc 0) 00000100:00100000:2.0:1789049454.043949:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8c6296050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7ef694ec-1ea0-4f02-800c-d1279b4fdf12+17:5848:x1875954110611328:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 182us (492us total) trans 0 rc 0/0 00000100:00100000:2.0:1789049454.043985:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 228 00000100:00100000:1.0:1789049454.044332:0:5848:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb8f7744000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7ef694ec-1ea0-4f02-800c-d1279b4fdf12:5848:1875954110611328:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789049454.044350:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.126@tcp lock: ffff8cb8c146d200/0xf4f48ce5e1bbee48 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf4f48ce5e1bbee4f expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049454.044360:0:5848:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.126@tcp lock: ffff8cb8c146d200/0xf4f48ce5e1bbee48 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xf4f48ce5e1bbee4f expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789049454.044450:0:5848:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb8f7744000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7ef694ec-1ea0-4f02-800c-d1279b4fdf12:5848:1875954110611456:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789049454.044482:0:5848:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789049454.044565:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954110611456 00000100:00100000:3.0:1789049454.044571:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954110611456 00000100:00100000:3.0:1789049454.044602:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 229 00000100:00100000:3.0:1789049454.044610:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8c6befc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7ef694ec-1ea0-4f02-800c-d1279b4fdf12+17:5848:x1875954110611456:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789049454.045043:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8c6befc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7ef694ec-1ea0-4f02-800c-d1279b4fdf12+17:5848:x1875954110611456:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 433us (558us total) trans 0 rc 0/0 00000100:00100000:3.0:1789049454.045050:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 229 00000100:00100000:1.0:1789049454.045522:0:5848:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cb8c79e0300 going to sleep for 11 seconds 00000100:00100000:1.0:1789049454.045547:0:5848:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb8f7744000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7ef694ec-1ea0-4f02-800c-d1279b4fdf12:5848:1875954110611456:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789049454.046227:0:5848:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb8f7744000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7ef694ec-1ea0-4f02-800c-d1279b4fdf12:5848:1875954110611584:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789049454.046305:0:5848:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789049454.046339:0:5848:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cb8c79e0300 going to sleep for 11 seconds 00000100:00100000:3.0:1789049454.046442:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954110611584 00000100:00100000:3.0:1789049454.046450:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954110611584 00000100:00100000:3.0:1789049454.046515:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 230 00000100:00100000:3.0:1789049454.046525:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8c6bed850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7ef694ec-1ea0-4f02-800c-d1279b4fdf12+17:5848:x1875954110611584:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789049454.046747:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8c6bed850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7ef694ec-1ea0-4f02-800c-d1279b4fdf12+17:5848:x1875954110611584:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 223us (442us total) trans 0 rc 0/0 00000100:00100000:3.0:1789049454.046755:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 230 00000100:00100000:0.0:1789049454.047205:0:5848:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb8f7744000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7ef694ec-1ea0-4f02-800c-d1279b4fdf12:5848:1875954110611584:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1789049454.048380:0:11200:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:3.0:1789049454.048964:0:5848:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:3.0:1789049454.049066:0:5848:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.126@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1789049454.049080:0:5848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.126@tcp lock: ffff8cb8c146d200/0xf4f48ce5e1bbee48 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf4f48ce5e1bbee4f expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049454.049095:0:5848:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.126@tcp lock: ffff8cb8c146d200/0xf4f48ce5e1bbee48 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf4f48ce5e1bbee4f expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789049454.049108:0:5848:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1789049454.049111:0:5848:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8cb8d1c83000 from 7 10000000:01000000:3.0:1789049454.049133:0:5848:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1789049454.062194:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.126@tcp lock: ffff8cb8c6b34200/0xf4f48ce5e1bbee56 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049454.062229:0:5848:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.126@tcp lock: ffff8cb8c6b34200/0xf4f48ce5e1bbee56 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049454.062247:0:5848:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.126@tcp lock: ffff8cb8c6b34200/0xf4f48ce5e1bbee56 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789049454.062285:0:5848:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb8c59ca300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7ef694ec-1ea0-4f02-800c-d1279b4fdf12:5848:1875954110611712:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1789049454.062377:0:5848:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789049454.062439:0:5848:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cb8c7802300 going to sleep for 11 seconds 00000100:00100000:2.0:1789049454.062545:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954110611712 00000100:00100000:2.0:1789049454.062556:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954110611712 00000100:00100000:2.0:1789049454.062630:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 231 00000100:00100000:2.0:1789049454.062642:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8c6bed050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7ef694ec-1ea0-4f02-800c-d1279b4fdf12+17:5848:x1875954110611712:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789049454.062659:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789049454.062681:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cb8d6715800/0xf4f48ce5e1bbee5d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xf4f48ce5e1bbee56 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049454.062714:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cb8d6715800/0xf4f48ce5e1bbee5d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf4f48ce5e1bbee56 expref: 18 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049454.062726:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cb8d6715800/0xf4f48ce5e1bbee5d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf4f48ce5e1bbee56 expref: 18 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049454.062737:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cb8d6715800, rc 0) 00000100:00100000:2.0:1789049454.062790:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8c6bed050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7ef694ec-1ea0-4f02-800c-d1279b4fdf12+18:5848:x1875954110611712:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 150us (412us total) trans 0 rc 0/0 00000100:00100000:2.0:1789049454.062808:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 231 00000100:00100000:3.0:1789049454.065096:0:5848:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb8c59ca300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7ef694ec-1ea0-4f02-800c-d1279b4fdf12:5848:1875954110611712:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789049454.065132:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.126@tcp lock: ffff8cb8c6b34200/0xf4f48ce5e1bbee56 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf4f48ce5e1bbee5d expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049454.065148:0:5848:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.126@tcp lock: ffff8cb8c6b34200/0xf4f48ce5e1bbee56 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xf4f48ce5e1bbee5d expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789049454.065268:0:5848:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb8c59ca300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7ef694ec-1ea0-4f02-800c-d1279b4fdf12:5848:1875954110611840:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789049454.065336:0:5848:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789049454.065385:0:5848:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cb8c7802300 going to sleep for 11 seconds 00000100:00100000:1.0:1789049454.066416:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954110611840 00000100:00100000:1.0:1789049454.066428:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954110611840 00000100:00100000:1.0:1789049454.066493:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 232 00000100:00100000:1.0:1789049454.066515:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8c6bef850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7ef694ec-1ea0-4f02-800c-d1279b4fdf12+18:5848:x1875954110611840:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789049454.066914:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8c6bef850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7ef694ec-1ea0-4f02-800c-d1279b4fdf12+18:5848:x1875954110611840:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 400us (1577us total) trans 0 rc 0/0 00000100:00100000:1.0:1789049454.066923:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 232 00000100:00100000:3.0:1789049454.072054:0:5848:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb8c59ca300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7ef694ec-1ea0-4f02-800c-d1279b4fdf12:5848:1875954110611840:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789049454.072148:0:5848:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb8c59ca300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7ef694ec-1ea0-4f02-800c-d1279b4fdf12:5848:1875954110611968:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789049454.072264:0:5848:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789049454.072328:0:5848:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cb8c7802300 going to sleep for 11 seconds 00000100:00100000:2.0:1789049454.072453:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954110611968 00000100:00100000:2.0:1789049454.072463:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954110611968 00000100:00100000:2.0:1789049454.072541:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 233 00000100:00100000:2.0:1789049454.072552:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8c6bec850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7ef694ec-1ea0-4f02-800c-d1279b4fdf12+18:5848:x1875954110611968:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789049454.072813:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8c6bec850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7ef694ec-1ea0-4f02-800c-d1279b4fdf12+18:5848:x1875954110611968:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 262us (547us total) trans 0 rc 0/0 00000100:00100000:2.0:1789049454.072822:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 233 00000100:00100000:3.0:1789049454.076957:0:5848:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb8c59ca300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7ef694ec-1ea0-4f02-800c-d1279b4fdf12:5848:1875954110611968:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1789049454.079118:0:11203:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:3.0:1789049454.079334:0:5848:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:3.0:1789049454.079359:0:5848:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.126@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1789049454.079372:0:5848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.126@tcp lock: ffff8cb8c6b34200/0xf4f48ce5e1bbee56 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf4f48ce5e1bbee5d expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049454.079387:0:5848:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.126@tcp lock: ffff8cb8c6b34200/0xf4f48ce5e1bbee56 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf4f48ce5e1bbee5d expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789049454.079399:0:5848:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1789049454.079401:0:5848:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8cb8e01c3000 from 7 10000000:01000000:3.0:1789049454.079404:0:5848:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1789049454.079451:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.126@tcp lock: ffff8cb8c6b35c00/0xf4f48ce5e1bbee64 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049454.079460:0:5848:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.126@tcp lock: ffff8cb8c6b35c00/0xf4f48ce5e1bbee64 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049454.079472:0:5848:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.126@tcp lock: ffff8cb8c6b35c00/0xf4f48ce5e1bbee64 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789049454.079514:0:5848:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb8c59ca300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7ef694ec-1ea0-4f02-800c-d1279b4fdf12:5848:1875954110612096:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1789049454.079597:0:5848:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789049454.079643:0:5848:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cb8c7802300 going to sleep for 11 seconds 00000100:00100000:2.0:1789049454.079801:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954110612096 00000100:00100000:2.0:1789049454.079827:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954110612096 00000100:00100000:2.0:1789049454.079904:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 234 00000100:00100000:2.0:1789049454.079915:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8c6bedc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7ef694ec-1ea0-4f02-800c-d1279b4fdf12+18:5848:x1875954110612096:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789049454.079933:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789049454.079948:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cb8d6714a00/0xf4f48ce5e1bbee6b lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xf4f48ce5e1bbee64 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049454.079975:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cb8d6714a00/0xf4f48ce5e1bbee6b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf4f48ce5e1bbee64 expref: 19 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049454.079987:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cb8d6714a00/0xf4f48ce5e1bbee6b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf4f48ce5e1bbee64 expref: 19 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049454.079995:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cb8d6714a00, rc 0) 00000100:00100000:2.0:1789049454.080047:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8c6bedc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7ef694ec-1ea0-4f02-800c-d1279b4fdf12+19:5848:x1875954110612096:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 135us (450us total) trans 0 rc 0/0 00000100:00100000:2.0:1789049454.080054:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 234 00000100:00100000:1.0:1789049454.080315:0:5848:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb8c59ca300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7ef694ec-1ea0-4f02-800c-d1279b4fdf12:5848:1875954110612096:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789049454.080333:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.126@tcp lock: ffff8cb8c6b35c00/0xf4f48ce5e1bbee64 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf4f48ce5e1bbee6b expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049454.080342:0:5848:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.126@tcp lock: ffff8cb8c6b35c00/0xf4f48ce5e1bbee64 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xf4f48ce5e1bbee6b expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789049454.080406:0:5848:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb8f7746d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7ef694ec-1ea0-4f02-800c-d1279b4fdf12:5848:1875954110612224:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789049454.080438:0:5848:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789049454.080475:0:5848:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cb8c79e0300 going to sleep for 11 seconds 00000100:00100000:3.0:1789049454.084821:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954110612224 00000100:00100000:3.0:1789049454.084859:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954110612224 00000100:00100000:3.0:1789049454.084935:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 235 00000100:00100000:3.0:1789049454.084948:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8c6beec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7ef694ec-1ea0-4f02-800c-d1279b4fdf12+19:5848:x1875954110612224:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789049454.085342:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8c6beec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7ef694ec-1ea0-4f02-800c-d1279b4fdf12+19:5848:x1875954110612224:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 396us (4902us total) trans 0 rc 0/0 00000100:00100000:3.0:1789049454.085362:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 235 00000100:00100000:3.0:1789049454.085442:0:5848:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb8f7746d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7ef694ec-1ea0-4f02-800c-d1279b4fdf12:5848:1875954110612224:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789049454.085503:0:5848:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb8c59c9c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7ef694ec-1ea0-4f02-800c-d1279b4fdf12:5848:1875954110612352:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789049454.085555:0:5848:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789049454.085587:0:5848:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cb8c7802180 going to sleep for 11 seconds 00000100:00100000:3.0:1789049454.085599:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954110612352 00000100:00100000:3.0:1789049454.085604:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954110612352 00000100:00100000:3.0:1789049454.085622:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 236 00000100:00100000:3.0:1789049454.085628:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8c6bec450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7ef694ec-1ea0-4f02-800c-d1279b4fdf12+19:5848:x1875954110612352:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789049454.085793:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8c6bec450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7ef694ec-1ea0-4f02-800c-d1279b4fdf12+19:5848:x1875954110612352:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 163us (238us total) trans 0 rc 0/0 00000100:00100000:3.0:1789049454.085800:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 236 00000100:00100000:3.0:1789049454.085837:0:5848:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb8c59c9c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7ef694ec-1ea0-4f02-800c-d1279b4fdf12:5848:1875954110612352:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1789049454.088379:0:11204:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:0.0:1789049454.090240:0:5848:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:0.0:1789049454.090268:0:5848:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.126@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1789049454.090283:0:5848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.126@tcp lock: ffff8cb8c6b35c00/0xf4f48ce5e1bbee64 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf4f48ce5e1bbee6b expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049454.090298:0:5848:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.126@tcp lock: ffff8cb8c6b35c00/0xf4f48ce5e1bbee64 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf4f48ce5e1bbee6b expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049454.299126:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789049454.726707:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.26@tcp (source: 12345-192.168.206.26@tcp) 00000100:00100000:0.0:1789049454.726935:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954089606016 00000100:00100000:0.0:1789049454.726944:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954089606016 00000100:00100000:0.0:1789049454.727007:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.26@tcp, seq: 237 00000100:00100000:0.0:1789049454.727019:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8c6bed450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:de93d576-ed8d-4d27-ab00-9189a62cea33+11:5598:x1875954089606016:12345-192.168.206.26@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789049454.727039:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789049454.727058:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cb7c4c39000/0xf4f48ce5e1bbee72 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x7fc5e358805a3313 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049454.727099:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cb7c4c39000/0xf4f48ce5e1bbee72 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a3313 expref: 12 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049454.727112:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cb7c4c39000/0xf4f48ce5e1bbee72 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a3313 expref: 12 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049454.727122:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cb7c4c39000, rc 0) 00000100:00100000:0.0:1789049454.727197:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8c6bed450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:de93d576-ed8d-4d27-ab00-9189a62cea33+12:5598:x1875954089606016:12345-192.168.206.26@tcp:101:ll_cfg_requeue.0 Request processed in 180us (501us total) trans 0 rc 0/0 00000100:00100000:0.0:1789049454.727217:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.26@tcp, seq: 237 00000100:00100000:2.0:1789049454.732686:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.26@tcp (source: 12345-192.168.206.26@tcp) 00000100:00100000:3.0:1789049454.732950:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954089606144 00000100:00100000:3.0:1789049454.732961:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954089606144 00000100:00100000:3.0:1789049454.733019:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.26@tcp, seq: 238 00000100:00100000:3.0:1789049454.733028:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8c6bee850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:de93d576-ed8d-4d27-ab00-9189a62cea33+12:5598:x1875954089606144:12345-192.168.206.26@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789049454.733329:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8c6bee850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:de93d576-ed8d-4d27-ab00-9189a62cea33+12:5598:x1875954089606144:12345-192.168.206.26@tcp:501:ll_cfg_requeue.0 Request processed in 300us (650us total) trans 0 rc 0/0 00000100:00100000:3.0:1789049454.733337:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.26@tcp, seq: 238 00000100:00100000:3.0:1789049454.738752:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.26@tcp (source: 12345-192.168.206.26@tcp) 00000100:00100000:2.0:1789049454.738832:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954089606272 00000100:00100000:2.0:1789049454.738915:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954089606272 00000100:00100000:2.0:1789049454.738976:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.26@tcp, seq: 239 00000100:00100000:2.0:1789049454.738985:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8c6bee050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:de93d576-ed8d-4d27-ab00-9189a62cea33+12:5598:x1875954089606272:12345-192.168.206.26@tcp:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789049454.739215:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8c6bee050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:de93d576-ed8d-4d27-ab00-9189a62cea33+12:5598:x1875954089606272:12345-192.168.206.26@tcp:503:ll_cfg_requeue.0 Request processed in 229us (469us total) trans 0 rc 0/0 00000100:00100000:2.0:1789049454.739224:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.26@tcp, seq: 239 00000100:00100000:3.0:1789049454.766026:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.26@tcp (source: 12345-192.168.206.26@tcp) 00000100:00100000:0.0:1789049454.766420:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954089606400 00000100:00100000:0.0:1789049454.766432:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954089606400 00000100:00100000:0.0:1789049454.766484:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.26@tcp, seq: 240 00000100:00100000:0.0:1789049454.766493:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8c6bef050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:de93d576-ed8d-4d27-ab00-9189a62cea33+12:5598:x1875954089606400:12345-192.168.206.26@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789049454.766522:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789049454.766542:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cb7c4c39a00/0xf4f48ce5e1bbee79 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x7fc5e358805a331a expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049454.766831:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cb7c4c39a00/0xf4f48ce5e1bbee79 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a331a expref: 13 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049454.766868:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cb7c4c39a00/0xf4f48ce5e1bbee79 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a331a expref: 13 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049454.766879:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cb7c4c39a00, rc 0) 00000100:00100000:0.0:1789049454.767714:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8c6bef050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:de93d576-ed8d-4d27-ab00-9189a62cea33+13:5598:x1875954089606400:12345-192.168.206.26@tcp:101:ll_cfg_requeue.0 Request processed in 1215us (1691us total) trans 0 rc 0/0 00000100:00100000:0.0:1789049454.767736:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.26@tcp, seq: 240 00000100:00100000:3.0:1789049454.774026:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.26@tcp (source: 12345-192.168.206.26@tcp) 00000100:00100000:0.0:1789049454.774123:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954089606528 00000100:00100000:0.0:1789049454.774135:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954089606528 00000100:00100000:0.0:1789049454.774200:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.26@tcp, seq: 241 00000100:00100000:0.0:1789049454.774210:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8c6bec050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:de93d576-ed8d-4d27-ab00-9189a62cea33+13:5598:x1875954089606528:12345-192.168.206.26@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789049454.774480:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8c6bec050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:de93d576-ed8d-4d27-ab00-9189a62cea33+13:5598:x1875954089606528:12345-192.168.206.26@tcp:501:ll_cfg_requeue.0 Request processed in 270us (460us total) trans 0 rc 0/0 00000100:00100000:0.0:1789049454.774487:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.26@tcp, seq: 241 00000100:00100000:3.0:1789049454.777906:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.26@tcp (source: 12345-192.168.206.26@tcp) 00000100:00100000:0.0:1789049454.778004:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954089606656 00000100:00100000:0.0:1789049454.778014:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954089606656 00000100:00100000:0.0:1789049454.778075:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.26@tcp, seq: 242 00000100:00100000:0.0:1789049454.778086:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8c6becc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:de93d576-ed8d-4d27-ab00-9189a62cea33+13:5598:x1875954089606656:12345-192.168.206.26@tcp:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789049454.778305:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8c6becc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:de93d576-ed8d-4d27-ab00-9189a62cea33+13:5598:x1875954089606656:12345-192.168.206.26@tcp:503:ll_cfg_requeue.0 Request processed in 221us (408us total) trans 0 rc 0/0 00000100:00100000:0.0:1789049454.778313:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.26@tcp, seq: 242 00000100:00100000:1.0:1789049455.008622:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1789049455.008645:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb8df482300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3309:1875954110612480:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789049455.008713:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789049455.009297:0:6706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954110612480 00000100:00100000:2.0:1789049455.009306:0:6706:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954110612480 00000100:00100000:2.0:1789049455.009386:0:6706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1789049455.009410:0:6706:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8f7745f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1875954110612480:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789049455.009448:0:6706:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789049455.009498:0:6706:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8f7745f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1875954110612480:12345-0@lo:13:osp-pre-0-0.0 Request processed in 91us (785us total) trans 0 rc 0/0 00000100:00100000:2.0:1789049455.009505:0:6706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00080000:1.0:1789049455.009603:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1789049455.009633:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cb8df482300 x1875954110612480/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789049471 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789049455.009653:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb8df482300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3309:1875954110612480:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1789049455.326070:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789049456.027183:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789049456.027202:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb8fcf05500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1875954110612608:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789049456.027267:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789049456.027345:0:6706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954110612608 00000100:00100000:0.0:1789049456.027351:0:6706:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954110612608 00000100:00100000:0.0:1789049456.027403:0:6706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1789049456.027411:0:6706:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8fcf05c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1875954110612608:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1789049456.027442:0:6706:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789049456.027497:0:6706:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8fcf05c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1875954110612608:12345-0@lo:13:osp-pre-1-0.0 Request processed in 86us (230us total) trans 0 rc 0/0 00000100:00100000:0.0:1789049456.027517:0:6706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00080000:0.0:1789049456.027538:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:0.0:1789049456.027566:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cb8fcf05500 x1875954110612608/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789049472 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789049456.027585:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb8fcf05500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1875954110612608:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789049456.031199:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb8df480a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7ef694ec-1ea0-4f02-800c-d1279b4fdf12:3310:1875954110612736:0@lo:400:kworker.0 00000100:00100000:2.0:1789049456.031278:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789049456.031318:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb8df482680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3310:1875954110613248:0@lo:400:kworker.0 00000100:00100000:2.0:1789049456.031345:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789049456.031374:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789049456.031380:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb8df481880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3310:1875954110612864:0@lo:400:kworker.0 00000100:00100000:2.0:1789049456.031401:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789049456.031438:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954110612736 00000100:00100000:2.0:1789049456.031447:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954110612736 00000100:00100000:2.0:1789049456.032002:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 243 00000100:00100000:2.0:1789049456.032013:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8c6bee450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7ef694ec-1ea0-4f02-800c-d1279b4fdf12+19:3310:x1875954110612736:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789049456.032070:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8c6bee450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7ef694ec-1ea0-4f02-800c-d1279b4fdf12+19:3310:x1875954110612736:12345-0@lo:400:kworker.0 Request processed in 59us (793us total) trans 0 rc 0/0 00000100:00100000:2.0:1789049456.032077:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 243 00000100:00100000:2.0:1789049456.032109:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954110613248 00000100:00100000:2.0:1789049456.032114:0:5852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954110613248 00000100:00100000:2.0:1789049456.032160:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954110612864 00000100:00100000:2.0:1789049456.032164:0:5852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954110612864 00000100:00100000:2.0:1789049456.032182:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:2.0:1789049456.032188:0:5852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8df481500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1875954110613248:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789049456.032220:0:5852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8df481500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1875954110613248:12345-0@lo:400:kworker.0 Request processed in 32us (874us total) trans 0 rc 0/0 00000100:00100000:2.0:1789049456.032240:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:2.0:1789049456.032253:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:2.0:1789049456.032258:0:5852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8df482a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1875954110612864:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789049456.032285:0:5852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8df482a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1875954110612864:12345-0@lo:400:kworker.0 Request processed in 27us (884us total) trans 0 rc 0/0 00000100:00100000:2.0:1789049456.032290:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:2.0:1789049456.032315:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb8df480000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3309:1875954110613120:0@lo:400:kworker.0 00000100:00100000:2.0:1789049456.032345:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789049456.032366:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1789049456.032371:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb8df483100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3309:1875954110612992:0@lo:400:kworker.0 00000100:00100000:2.0:1789049456.032389:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1789049456.032411:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789049456.032419:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954110612992 00000100:00100000:2.0:1789049456.032422:0:5852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954110612992 00000100:00100000:2.0:1789049456.032446:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:1.0:1789049456.032591:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954110613120 00000100:00100000:1.0:1789049456.032595:0:6704:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954110613120 00000100:00100000:1.0:1789049456.032655:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1789049456.032662:0:6704:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8df480e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3309:x1875954110613120:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789049456.032701:0:6704:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8df480e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3309:x1875954110613120:12345-0@lo:400:kworker.0 Request processed in 40us (355us total) trans 0 rc 0/0 00000100:00100000:1.0:1789049456.032706:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00010000:00080000:1.0:1789049456.032742:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cb8df480000 x1875954110613120/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789049472 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789049456.032754:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb8df480000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3309:1875954110613120:0@lo:400:kworker.0 00000100:00100000:2.0:1789049456.034863:0:5852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8df483480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1875954110612992:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789049456.034956:0:5852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8df483480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1875954110612992:12345-0@lo:400:kworker.0 Request processed in 2502us (2563us total) trans 0 rc 0/0 00000100:00100000:2.0:1789049456.034965:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00080000:2.0:1789049456.035005:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789049456.035045:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb8df481880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3310:1875954110612864:0@lo:400:kworker.0 00000100:00100000:2.0:1789049456.035058:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb8df480a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7ef694ec-1ea0-4f02-800c-d1279b4fdf12:3310:1875954110612736:0@lo:400:kworker.0 00000100:00100000:2.0:1789049456.035069:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb8df482680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3310:1875954110613248:0@lo:400:kworker.0 00000100:00100000:1.0:1789049456.035208:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb8df483100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3309:1875954110612992:0@lo:400:kworker.0 00010000:00010000:0.0:1789049456.347326:0:6719:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789049456.973926:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.26@tcp (source: 12345-192.168.206.26@tcp) 00000100:00100000:0.0:1789049456.973985:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.26@tcp (source: 12345-192.168.206.26@tcp) 00000100:00100000:0.0:1789049456.974020:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.26@tcp (source: 12345-192.168.206.26@tcp) 00000100:00100000:0.0:1789049456.974062:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954089606912 00000100:00100000:0.0:1789049456.974071:0:5850:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954089606912 00000100:00100000:0.0:1789049456.974129:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954089607040 00000100:00100000:0.0:1789049456.974132:0:5850:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954089607040 00000100:00100000:0.0:1789049456.974169:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.26@tcp, seq: 92 00000100:00100000:0.0:1789049456.974178:0:5850:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8fcf05500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e823b53a-3591-475c-8624-c682227e5c13+6:2355:x1875954089606912:12345-192.168.206.26@tcp:400:kworker.0 00000100:00100000:0.0:1789049456.974248:0:5850:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8fcf05500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e823b53a-3591-475c-8624-c682227e5c13+6:2355:x1875954089606912:12345-192.168.206.26@tcp:400:kworker.0 Request processed in 71us (333us total) trans 0 rc 0/0 00000100:00100000:0.0:1789049456.974255:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.26@tcp, seq: 92 00000100:00100000:0.0:1789049456.974271:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.26@tcp, seq: 93 00000100:00100000:0.0:1789049456.974278:0:5850:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8fcf04e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:59d63492-f1ee-4aa5-bf8c-853a603b0252+5:2355:x1875954089607040:12345-192.168.206.26@tcp:400:kworker.0 00000100:00100000:0.0:1789049456.974305:0:5850:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8fcf04e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:59d63492-f1ee-4aa5-bf8c-853a603b0252+5:2355:x1875954089607040:12345-192.168.206.26@tcp:400:kworker.0 Request processed in 27us (285us total) trans 0 rc 0/0 00000100:00100000:0.0:1789049456.974311:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.26@tcp, seq: 93 00000100:00080000:0.0:1789049456.974327:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789049456.974911:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954089606784 00000100:00100000:3.0:1789049456.974917:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954089606784 00000100:00100000:3.0:1789049456.974962:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.26@tcp, seq: 244 00000100:00100000:3.0:1789049456.974970:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8c6bef450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:de93d576-ed8d-4d27-ab00-9189a62cea33+13:2355:x1875954089606784:12345-192.168.206.26@tcp:400:kworker.0 00000100:00100000:2.0:1789049456.981920:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8c6bef450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:de93d576-ed8d-4d27-ab00-9189a62cea33+13:2355:x1875954089606784:12345-192.168.206.26@tcp:400:kworker.0 Request processed in 6940us (7924us total) trans 0 rc 0/0 00000100:00100000:2.0:1789049456.981946:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.26@tcp, seq: 244 00010000:00010000:0.0:1789049457.373071:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1789049457.408633:0:11383:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg626-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:0.0:1789049458.395203:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789049459.421389:0:6719:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789049460.125976:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789049460.125998:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb8df482680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1875954110613376:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789049460.126062:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789049460.126237:0:6706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954110613376 00000100:00100000:2.0:1789049460.126246:0:6706:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954110613376 00000100:00100000:2.0:1789049460.126309:0:6706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1789049460.126318:0:6706:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8f7745880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1875954110613376:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789049460.126352:0:6706:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789049460.126396:0:6706:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8f7745880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1875954110613376:12345-0@lo:13:osp-pre-0-0.0 Request processed in 80us (334us total) trans 0 rc 0/0 00000100:00100000:2.0:1789049460.126404:0:6706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00080000:1.0:1789049460.126513:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1789049460.126542:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cb8df482680 x1875954110613376/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789049476 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789049460.126579:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb8df482680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1875954110613376:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1789049460.443177:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789049461.147994:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb8fcf05f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1875954110613504:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789049461.148200:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789049461.148317:0:6706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954110613504 00000100:00100000:0.0:1789049461.148325:0:6706:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954110613504 00000100:00100000:0.0:1789049461.148387:0:6706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1789049461.148397:0:6706:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8f7747100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1875954110613504:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1789049461.148430:0:6706:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789049461.148472:0:6706:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8f7747100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1875954110613504:12345-0@lo:13:osp-pre-1-0.0 Request processed in 77us (272us total) trans 0 rc 0/0 00000100:00100000:0.0:1789049461.148479:0:6706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00080000:1.0:1789049461.148786:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:1.0:1789049461.148816:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cb8fcf05f80 x1875954110613504/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789049477 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789049461.148834:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb8fcf05f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1875954110613504:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789049461.151320:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb8f7746300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1875954110614016:0@lo:400:kworker.0 00000100:00100000:1.0:1789049461.151380:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789049461.151422:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1789049461.151429:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb8f7746680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7ef694ec-1ea0-4f02-800c-d1279b4fdf12:3308:1875954110613632:0@lo:400:kworker.0 00000100:00100000:1.0:1789049461.151455:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789049461.151476:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb8f7746a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3308:1875954110614144:0@lo:400:kworker.0 00000100:00100000:1.0:1789049461.151501:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789049461.151528:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb8f7747b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3310:1875954110613760:0@lo:400:kworker.0 00000100:00100000:1.0:1789049461.151550:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789049461.151568:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789049461.151573:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb8f7744380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3310:1875954110613888:0@lo:400:kworker.0 00000100:00100000:1.0:1789049461.151593:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789049461.151620:0:6703:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954110614016 00000100:00100000:1.0:1789049461.151626:0:6703:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954110614016 00000100:00100000:1.0:1789049461.154127:0:6703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1789049461.154151:0:6703:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8f7747480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3308:x1875954110614016:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789049461.154254:0:6703:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8f7747480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3308:x1875954110614016:12345-0@lo:400:kworker.0 Request processed in 114us (2872us total) trans 0 rc 0/0 00000100:00100000:1.0:1789049461.154262:0:6703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1789049461.154306:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954110613632 00000100:00100000:1.0:1789049461.154313:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954110613632 00000100:00100000:1.0:1789049461.154348:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 245 00000100:00100000:1.0:1789049461.154355:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8d6af9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7ef694ec-1ea0-4f02-800c-d1279b4fdf12+19:3308:x1875954110613632:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789049461.154386:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8d6af9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7ef694ec-1ea0-4f02-800c-d1279b4fdf12+19:3308:x1875954110613632:12345-0@lo:400:kworker.0 Request processed in 31us (2930us total) trans 0 rc 0/0 00000100:00100000:1.0:1789049461.154392:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 245 00000100:00100000:1.0:1789049461.154422:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954110614144 00000100:00100000:1.0:1789049461.154426:0:5850:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954110614144 00000100:00100000:1.0:1789049461.154462:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954110613760 00000100:00100000:1.0:1789049461.154465:0:5850:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954110613760 00000100:00100000:1.0:1789049461.154478:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954110613888 00000100:00100000:1.0:1789049461.154481:0:5850:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954110613888 00000100:00100000:1.0:1789049461.154495:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:1.0:1789049461.154501:0:5850:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8f7746d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1875954110614144:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789049461.154532:0:5850:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8f7746d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1875954110614144:12345-0@lo:400:kworker.0 Request processed in 31us (3031us total) trans 0 rc 0/0 00000100:00100000:1.0:1789049461.154538:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:1.0:1789049461.154552:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:1.0:1789049461.154557:0:5850:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8f7744000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1875954110613760:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789049461.154586:0:5850:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8f7744000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1875954110613760:12345-0@lo:400:kworker.0 Request processed in 29us (3036us total) trans 0 rc 0/0 00000100:00100000:1.0:1789049461.154591:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:1.0:1789049461.154600:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:1.0:1789049461.154611:0:5850:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8f7745500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1875954110613888:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789049461.154635:0:5850:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8f7745500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1875954110613888:12345-0@lo:400:kworker.0 Request processed in 24us (3041us total) trans 0 rc 0/0 00000100:00100000:1.0:1789049461.154640:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00080000:1.0:1789049461.154663:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789049461.154694:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb8f7744380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3310:1875954110613888:0@lo:400:kworker.0 00000100:00100000:1.0:1789049461.154703:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb8f7747b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3310:1875954110613760:0@lo:400:kworker.0 00000100:00100000:0.0:1789049461.154878:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb8f7746680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7ef694ec-1ea0-4f02-800c-d1279b4fdf12:3308:1875954110613632:0@lo:400:kworker.0 00000100:00100000:0.0:1789049461.154890:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb8f7746a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3308:1875954110614144:0@lo:400:kworker.0 00010000:00080000:0.0:1789049461.154901:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cb8f7746300 x1875954110614016/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789049477 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789049461.154910:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb8f7746300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1875954110614016:0@lo:400:kworker.0 00010000:00010000:0.0:1789049461.468005:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1789049461.576928:0:11483:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: === sanity-pcc: finish setup 10:10:59 (1789049459) === 00000100:00100000:3.0:1789049461.919333:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.26@tcp (source: 12345-192.168.206.26@tcp) 00000100:00100000:3.0:1789049461.919476:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.26@tcp (source: 12345-192.168.206.26@tcp) 00000100:00100000:2.0:1789049461.919724:0:5859:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954089607296 00000100:00100000:2.0:1789049461.919734:0:5859:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954089607296 00000100:00100000:2.0:1789049461.919806:0:5859:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.26@tcp, seq: 0 00000100:00100000:2.0:1789049461.919817:0:5859:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8c59c9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:e823b53a-3591-475c-8624-c682227e5c13+6:9675:x1875954089607296:12345-192.168.206.26@tcp:700:mkdir.0 00000100:00080000:0.0:1789049461.919907:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789049461.919930:0:5859:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8c59c9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:e823b53a-3591-475c-8624-c682227e5c13+6:9675:x1875954089607296:12345-192.168.206.26@tcp:700:mkdir.0 Request processed in 113us (452us total) trans 0 rc 0/0 00000100:00100000:2.0:1789049461.919938:0:5859:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.26@tcp, seq: 0 00000100:00100000:1.0:1789049461.920709:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954089607168 00000100:00100000:1.0:1789049461.920717:0:5850:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954089607168 00000100:00100000:1.0:1789049461.920769:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.26@tcp, seq: 14 00000100:00100000:1.0:1789049461.920778:0:5850:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8c59c9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e823b53a-3591-475c-8624-c682227e5c13+6:2356:x1875954089607168:12345-192.168.206.26@tcp:41:mkdir.0 00000004:00000024:1.0:1789049461.920810:0:5850:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:1.0:1789049461.921458:0:5850:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8c59c9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e823b53a-3591-475c-8624-c682227e5c13+6:2356:x1875954089607168:12345-192.168.206.26@tcp:41:mkdir.0 Request processed in 678us (2130us total) trans 0 rc 0/0 00000100:00100000:1.0:1789049461.921467:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.26@tcp, seq: 14 00000100:00100000:3.0:1789049461.926104:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.26@tcp (source: 12345-192.168.206.26@tcp) 00000100:00100000:1.0:1789049461.926357:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954089607552 00000100:00100000:1.0:1789049461.926366:0:5851:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954089607552 00000100:00100000:1.0:1789049461.926429:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.26@tcp, seq: 15 00000100:00100000:1.0:1789049461.926439:0:5851:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8c59cad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e823b53a-3591-475c-8624-c682227e5c13+6:9675:x1875954089607552:12345-192.168.206.26@tcp:36:mkdir.0 00010000:00010000:1.0:1789049461.926502:0:5851:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789049461.926531:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6714e00/0xf4f48ce5e1bbed61 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a329c expref: 6 pid: 6841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049461.926552:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8cb8e0130100) 00010000:00010000:1.0:1789049461.926563:0:5851:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789049461.926930:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c146ca00/0xf4f48ce5e1bbee80 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049461.926945:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c146ca00/0xf4f48ce5e1bbee80 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049461.926956:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c146ca00/0xf4f48ce5e1bbee80 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049461.927020:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c146c200/0xf4f48ce5e1bbee87 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049461.927028:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c146c200/0xf4f48ce5e1bbee87 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049461.927036:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c146c200/0xf4f48ce5e1bbee87 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789049461.929914:0:5851:0:(mdt_handler.c:922:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00010000:00010000:1.0:1789049461.929948:0:5851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c146ca00/0xf4f48ce5e1bbee80 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049461.929958:0:5851:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c146ca00/0xf4f48ce5e1bbee80 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049461.929967:0:5851:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c146ca00/0xf4f48ce5e1bbee80 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049461.929974:0:5851:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cb8c146ca00 already unused, calling callback (ffffffffc20ca4f0) 00010000:00010000:1.0:1789049461.929978:0:5851:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c146ca00/0xf4f48ce5e1bbee80 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049461.929986:0:5851:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c146ca00/0xf4f48ce5e1bbee80 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049461.930368:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8cb8c396d900) 00010000:00010000:1.0:1789049461.930371:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789049461.930377:0:5851:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c146ca00/0xf4f48ce5e1bbee80 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049461.930384:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c146ca00/0xf4f48ce5e1bbee80 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789049461.930404:0:5851:0:(mdt_handler.c:4507:mdt_save_lock()) ### save lock request 00000000c3eb0e27 reply state 000000001680971e transno 4294967297 ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c146c200/0xf4f48ce5e1bbee87 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789049461.930413:0:5851:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1789049461.930619:0:5851:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8c59cad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e823b53a-3591-475c-8624-c682227e5c13+7:9675:x1875954089607552:12345-192.168.206.26@tcp:36:mkdir.0 Request processed in 4177us (4519us total) trans 4294967297 rc 0/0 00000100:00100000:1.0:1789049461.930628:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.26@tcp, seq: 15 00010000:00010000:2.0:1789049461.942716:0:3294:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c146c200/0xf4f48ce5e1bbee87 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049461.942733:0:3294:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c146c200/0xf4f48ce5e1bbee87 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049461.942741:0:3294:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c146c200/0xf4f48ce5e1bbee87 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049461.942763:0:3294:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cb8c146c200 already unused, calling callback (ffffffffc20ca4f0) 00010000:00010000:2.0:1789049461.942768:0:3294:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c146c200/0xf4f48ce5e1bbee87 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049461.942775:0:3294:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c146c200/0xf4f48ce5e1bbee87 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049461.942791:0:3294:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff8cb8c396d200) 00010000:00010000:2.0:1789049461.942794:0:3294:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789049461.942798:0:3294:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c146c200/0xf4f48ce5e1bbee87 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049461.942805:0:3294:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c146c200/0xf4f48ce5e1bbee87 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789049461.958524:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.26@tcp (source: 12345-192.168.206.26@tcp) 00000100:00100000:1.0:1789049461.958795:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954089607680 00000100:00100000:1.0:1789049461.958806:0:5852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954089607680 00000100:00100000:1.0:1789049461.958894:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.26@tcp, seq: 16 00000100:00100000:1.0:1789049461.958905:0:5852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8c59ca300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e823b53a-3591-475c-8624-c682227e5c13+6:9677:x1875954089607680:12345-192.168.206.26@tcp:101:chmod.0 00010000:00010000:1.0:1789049461.958936:0:5852:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789049461.958959:0:5852:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c146ca00/0xf4f48ce5e1bbee8e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7fc5e358805a3321 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049461.959023:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c146d800/0xf4f48ce5e1bbee95 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049461.959038:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c146d800/0xf4f48ce5e1bbee95 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049461.959069:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c146d800/0xf4f48ce5e1bbee95 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789049461.959237:0:5852:0:(mdt_handler.c:922:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:1.0:1789049461.959241:0:5852:0:(mdt_handler.c:1587:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1789049461.959283:0:5852:0:(mdt_handler.c:2522:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c146d800/0xf4f48ce5e1bbee95 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049461.959310:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c146ca00/0xf4f48ce5e1bbee8e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a3321 expref: 8 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049461.959326:0:5852:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c146d800/0xf4f48ce5e1bbee95 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a3321 expref: 7 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049461.959334:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8cb8c396d900) 00010000:00010000:1.0:1789049461.959336:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1789049461.959340:0:5852:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cb8c146d800, rc 0) 00000100:00100000:1.0:1789049461.959401:0:5852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8c59ca300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e823b53a-3591-475c-8624-c682227e5c13+7:9677:x1875954089607680:12345-192.168.206.26@tcp:101:chmod.0 Request processed in 498us (887us total) trans 0 rc 0/0 00000100:00100000:1.0:1789049461.959409:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.26@tcp, seq: 16 00000100:00100000:0.0:1789049461.962389:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.26@tcp (source: 12345-192.168.206.26@tcp) 00000100:00100000:2.0:1789049461.962490:0:6841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954089607936 00000100:00100000:2.0:1789049461.962501:0:6841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954089607936 00000100:00100000:2.0:1789049461.962567:0:6841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.26@tcp, seq: 17 00000100:00100000:2.0:1789049461.962577:0:6841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8fcf07100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e823b53a-3591-475c-8624-c682227e5c13+7:9677:x1875954089607936:12345-192.168.206.26@tcp:36:chmod.0 00010000:00010000:2.0:1789049461.962637:0:6841:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789049461.962667:0:6841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c146d800/0xf4f48ce5e1bbee95 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a3321 expref: 7 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049461.962688:0:6841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8cb8c396d900) 00010000:00010000:2.0:1789049461.962699:0:6841:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789049461.962722:0:6841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6715c00/0xf4f48ce5e1bbee9c lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049461.962734:0:6841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6715c00/0xf4f48ce5e1bbee9c lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049461.962757:0:6841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6715c00/0xf4f48ce5e1bbee9c lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6841 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789049461.963379:0:6841:0:(mdt_handler.c:4507:mdt_save_lock()) ### save lock request 000000006da7e478 reply state 00000000c5395206 transno 4294967298 ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6715c00/0xf4f48ce5e1bbee9c lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6841 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789049461.963390:0:6841:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:2.0:1789049461.963399:0:6841:0:(mdt_handler.c:922:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000100:00100000:2.0:1789049461.964193:0:6841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8fcf07100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e823b53a-3591-475c-8624-c682227e5c13+8:9677:x1875954089607936:12345-192.168.206.26@tcp:36:chmod.0 Request processed in 1612us (1807us total) trans 4294967298 rc 0/0 00000100:00100000:2.0:1789049461.964202:0:6841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.26@tcp, seq: 17 00010000:00010000:1.0:1789049461.967614:0:3295:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6715c00/0xf4f48ce5e1bbee9c lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049461.967633:0:3295:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6715c00/0xf4f48ce5e1bbee9c lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049461.967641:0:3295:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6715c00/0xf4f48ce5e1bbee9c lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049461.967664:0:3295:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cb8d6715c00 already unused, calling callback (ffffffffc20ca4f0) 00010000:00010000:1.0:1789049461.967669:0:3295:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6715c00/0xf4f48ce5e1bbee9c lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049461.967676:0:3295:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6715c00/0xf4f48ce5e1bbee9c lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049461.967692:0:3295:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8cb8e0130500) 00010000:00010000:1.0:1789049461.967695:0:3295:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1789049461.967700:0:3295:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6715c00/0xf4f48ce5e1bbee9c lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049461.967707:0:3295:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6715c00/0xf4f48ce5e1bbee9c lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6841 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789049462.001517:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.26@tcp (source: 12345-192.168.206.26@tcp) 00000100:00100000:1.0:1789049462.002053:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954089608064 00000100:00100000:1.0:1789049462.002063:0:5852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954089608064 00000100:00100000:1.0:1789049462.002131:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.26@tcp, seq: 18 00000100:00100000:1.0:1789049462.002141:0:5852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8fcf06300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e823b53a-3591-475c-8624-c682227e5c13+7:9678:x1875954089608064:12345-192.168.206.26@tcp:101:chown.0 00010000:00010000:1.0:1789049462.002165:0:5852:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789049462.002185:0:5852:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c146ca00/0xf4f48ce5e1bbeea3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7fc5e358805a3328 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049462.002249:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c146d800/0xf4f48ce5e1bbeeaa lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049462.002263:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c146d800/0xf4f48ce5e1bbeeaa lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049462.002275:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c146d800/0xf4f48ce5e1bbeeaa lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789049462.002323:0:5852:0:(mdt_handler.c:922:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:1.0:1789049462.002327:0:5852:0:(mdt_handler.c:1587:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1789049462.002363:0:5852:0:(mdt_handler.c:2522:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c146d800/0xf4f48ce5e1bbeeaa lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049462.002386:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c146ca00/0xf4f48ce5e1bbeea3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a3328 expref: 9 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049462.002404:0:5852:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c146d800/0xf4f48ce5e1bbeeaa lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a3328 expref: 8 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049462.002413:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8cb8c396d700) 00010000:00010000:1.0:1789049462.002416:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1789049462.002419:0:5852:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cb8c146d800, rc 0) 00000100:00100000:1.0:1789049462.002486:0:5852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8fcf06300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e823b53a-3591-475c-8624-c682227e5c13+8:9678:x1875954089608064:12345-192.168.206.26@tcp:101:chown.0 Request processed in 346us (978us total) trans 0 rc 0/0 00000100:00100000:1.0:1789049462.002494:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.26@tcp, seq: 18 00000100:00100000:0.0:1789049462.011372:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.26@tcp (source: 12345-192.168.206.26@tcp) 00000100:00100000:1.0:1789049462.011605:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954089608192 00000100:00100000:1.0:1789049462.011616:0:5851:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954089608192 00000100:00100000:1.0:1789049462.012291:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.26@tcp, seq: 19 00000100:00100000:1.0:1789049462.012306:0:5851:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8fcf05f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e823b53a-3591-475c-8624-c682227e5c13+8:9678:x1875954089608192:12345-192.168.206.26@tcp:101:chown.0 00010000:00010000:1.0:1789049462.012326:0:5851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789049462.012345:0:5851:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c146c200/0xf4f48ce5e1bbeeb1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7fc5e358805a332f expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049462.012425:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c146dc00/0xf4f48ce5e1bbeeb8 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049462.012458:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c146dc00/0xf4f48ce5e1bbeeb8 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049462.012471:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c146dc00/0xf4f48ce5e1bbeeb8 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049462.012486:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c146c000/0xf4f48ce5e1bbeebf lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049462.012493:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c146c000/0xf4f48ce5e1bbeebf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049462.012499:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c146c000/0xf4f48ce5e1bbeebf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049462.012586:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d776e200/0xf4f48ce5e1bbeec6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049462.012594:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d776e200/0xf4f48ce5e1bbeec6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049462.012601:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d776e200/0xf4f48ce5e1bbeec6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789049462.012628:0:5851:0:(mdt_handler.c:922:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00000004:00200000:1.0:1789049462.012632:0:5851:0:(mdt_handler.c:1587:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1789049462.012650:0:5851:0:(mdt_handler.c:2522:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d776e200/0xf4f48ce5e1bbeec6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049462.013293:0:5851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c146dc00/0xf4f48ce5e1bbeeb8 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049462.013315:0:5851:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c146dc00/0xf4f48ce5e1bbeeb8 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049462.013321:0:5851:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c146dc00/0xf4f48ce5e1bbeeb8 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049462.013327:0:5851:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cb8c146dc00 already unused, calling callback (ffffffffc20ca4f0) 00010000:00010000:1.0:1789049462.013331:0:5851:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c146dc00/0xf4f48ce5e1bbeeb8 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049462.013339:0:5851:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c146dc00/0xf4f48ce5e1bbeeb8 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049462.013353:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8cb8c396d700) 00010000:00010000:1.0:1789049462.013356:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789049462.013360:0:5851:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c146dc00/0xf4f48ce5e1bbeeb8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049462.013366:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c146dc00/0xf4f48ce5e1bbeeb8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049462.013381:0:5851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c146c000/0xf4f48ce5e1bbeebf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049462.013386:0:5851:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c146c000/0xf4f48ce5e1bbeebf lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049462.013606:0:5851:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c146c000/0xf4f48ce5e1bbeebf lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049462.013613:0:5851:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cb8c146c000 already unused, calling callback (ffffffffc20ca4f0) 00010000:00010000:1.0:1789049462.013622:0:5851:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c146c000/0xf4f48ce5e1bbeebf lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049462.013629:0:5851:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c146c000/0xf4f48ce5e1bbeebf lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049462.013639:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff8cb8c396d500) 00010000:00010000:1.0:1789049462.013642:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789049462.013645:0:5851:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c146c000/0xf4f48ce5e1bbeebf lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049462.013651:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c146c000/0xf4f48ce5e1bbeebf lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049462.013768:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c146c200/0xf4f48ce5e1bbeeb1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a332f expref: 10 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049462.013781:0:5851:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d776e200/0xf4f48ce5e1bbeec6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a332f expref: 9 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049462.013788:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff8cb8c396df00) 00010000:00010000:1.0:1789049462.013790:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1789049462.013792:0:5851:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cb8d776e200, rc 0) 00000100:00100000:1.0:1789049462.015615:0:5851:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8fcf05f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e823b53a-3591-475c-8624-c682227e5c13+9:9678:x1875954089608192:12345-192.168.206.26@tcp:101:chown.0 Request processed in 3306us (4243us total) trans 0 rc 0/0 00000100:00100000:1.0:1789049462.015627:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.26@tcp, seq: 19 00000100:00100000:0.0:1789049462.026616:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.26@tcp (source: 12345-192.168.206.26@tcp) 00000100:00100000:1.0:1789049462.027232:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954089608448 00000100:00100000:1.0:1789049462.027243:0:5852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954089608448 00000100:00100000:1.0:1789049462.027302:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.26@tcp, seq: 20 00000100:00100000:1.0:1789049462.027311:0:5852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb900a5b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e823b53a-3591-475c-8624-c682227e5c13+9:9678:x1875954089608448:12345-192.168.206.26@tcp:36:chown.0 00010000:00010000:1.0:1789049462.027365:0:5852:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789049462.027390:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d776e200/0xf4f48ce5e1bbeec6 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a332f expref: 9 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049462.027991:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff8cb8c396df00) 00010000:00010000:1.0:1789049462.028005:0:5852:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789049462.028031:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d776fa00/0xf4f48ce5e1bbeecd lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049462.028043:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d776fa00/0xf4f48ce5e1bbeecd lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049462.028053:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d776fa00/0xf4f48ce5e1bbeecd lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789049462.085878:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.26@tcp (source: 12345-192.168.206.26@tcp) 00000100:00100000:1.0:1789049462.085908:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.26@tcp (source: 12345-192.168.206.26@tcp) 00000100:00100000:2.0:1789049462.085984:0:6841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954089608704 00000100:00100000:2.0:1789049462.085994:0:6841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954089608704 00000100:00100000:2.0:1789049462.086051:0:6841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.26@tcp, seq: 97 00000100:00100000:2.0:1789049462.086060:0:6841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8f7747b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:59d63492-f1ee-4aa5-bf8c-853a603b0252+5:2358:x1875954089608704:12345-192.168.206.26@tcp:400:kworker.0 00000100:00100000:2.0:1789049462.086142:0:6841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8f7747b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:59d63492-f1ee-4aa5-bf8c-853a603b0252+5:2358:x1875954089608704:12345-192.168.206.26@tcp:400:kworker.0 Request processed in 83us (299us total) trans 0 rc 0/0 00000100:00100000:2.0:1789049462.086149:0:6841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.26@tcp, seq: 97 00000100:00080000:1.0:1789049462.086214:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789049462.086501:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954089608576 00000100:00100000:3.0:1789049462.086507:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954089608576 00000100:00100000:3.0:1789049462.086542:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.26@tcp, seq: 246 00000100:00100000:3.0:1789049462.086548:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8d6afb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:de93d576-ed8d-4d27-ab00-9189a62cea33+13:2358:x1875954089608576:12345-192.168.206.26@tcp:400:kworker.0 00000100:00100000:3.0:1789049462.086578:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8d6afb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:de93d576-ed8d-4d27-ab00-9189a62cea33+13:2358:x1875954089608576:12345-192.168.206.26@tcp:400:kworker.0 Request processed in 30us (669us total) trans 0 rc 0/0 00000100:00100000:3.0:1789049462.086583:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.26@tcp, seq: 246 00000001:00080000:3.0:1789049462.145532:0:5872:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967299 is committed 00000004:00010000:2.0:1789049462.146087:0:5852:0:(mdt_handler.c:4507:mdt_save_lock()) ### save lock request 00000000f4591562 reply state 000000002a771b6c transno 4294967299 ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d776fa00/0xf4f48ce5e1bbeecd lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789049462.146101:0:5852:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:2.0:1789049462.146126:0:5852:0:(mdt_handler.c:922:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00010000:00080000:2.0:1789049462.146265:0:5852:0:(ldlm_lib.c:3491:target_send_reply()) Schedule reply immediately 00000100:00100000:2.0:1789049462.146290:0:5852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb900a5b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e823b53a-3591-475c-8624-c682227e5c13+7:9678:x1875954089608448:12345-192.168.206.26@tcp:36:chown.0 Request processed in 118976us (119679us total) trans 4294967299 rc 0/0 00000100:00100000:2.0:1789049462.146299:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.26@tcp, seq: 20 00010000:00010000:3.0:1789049462.146363:0:3294:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d776fa00/0xf4f48ce5e1bbeecd lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049462.146372:0:3294:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d776fa00/0xf4f48ce5e1bbeecd lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049462.146379:0:3294:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d776fa00/0xf4f48ce5e1bbeecd lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049462.146386:0:3294:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cb8d776fa00 already unused, calling callback (ffffffffc20ca4f0) 00010000:00010000:3.0:1789049462.146405:0:3294:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d776fa00/0xf4f48ce5e1bbeecd lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049462.146413:0:3294:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d776fa00/0xf4f48ce5e1bbeecd lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049462.146440:0:3294:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff8cb8c396d500) 00010000:00010000:3.0:1789049462.146443:0:3294:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1789049462.146448:0:3294:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d776fa00/0xf4f48ce5e1bbeecd lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049462.146564:0:3294:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d776fa00/0xf4f48ce5e1bbeecd lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789049462.166907:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.26@tcp (source: 12345-192.168.206.26@tcp) 00000100:00100000:2.0:1789049462.167151:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954089608832 00000100:00100000:2.0:1789049462.167179:0:5850:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954089608832 00000100:00100000:2.0:1789049462.167371:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.26@tcp, seq: 21 00000100:00100000:2.0:1789049462.167382:0:5850:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb900a5a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e823b53a-3591-475c-8624-c682227e5c13+6:9679:x1875954089608832:12345-192.168.206.26@tcp:101:touch.500 00010000:00010000:2.0:1789049462.167406:0:5850:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789049462.167425:0:5850:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6715a00/0xf4f48ce5e1bbeed4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7fc5e358805a3336 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1789049462.175299:0:5850:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 500, time 7708us 00010000:00010000:1.0:1789049462.212717:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d776e200/0xf4f48ce5e1bbeedb lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049462.212741:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d776e200/0xf4f48ce5e1bbeedb lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049462.212753:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d776e200/0xf4f48ce5e1bbeedb lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049462.212770:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d776fa00/0xf4f48ce5e1bbeee2 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049462.212789:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d776fa00/0xf4f48ce5e1bbeee2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049462.212798:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d776fa00/0xf4f48ce5e1bbeee2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049462.213395:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c146c200/0xf4f48ce5e1bbeee9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049462.213406:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c146c200/0xf4f48ce5e1bbeee9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049462.213414:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c146c200/0xf4f48ce5e1bbeee9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789049462.213437:0:5850:0:(mdt_handler.c:922:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00000004:00200000:1.0:1789049462.213440:0:5850:0:(mdt_handler.c:1587:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1789049462.213478:0:5850:0:(mdt_handler.c:2522:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c146c200/0xf4f48ce5e1bbeee9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049462.213490:0:5850:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d776e200/0xf4f48ce5e1bbeedb lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049462.213496:0:5850:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d776e200/0xf4f48ce5e1bbeedb lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049462.213503:0:5850:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d776e200/0xf4f48ce5e1bbeedb lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049462.213508:0:5850:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cb8d776e200 already unused, calling callback (ffffffffc20ca4f0) 00010000:00010000:1.0:1789049462.213512:0:5850:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d776e200/0xf4f48ce5e1bbeedb lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049462.213526:0:5850:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d776e200/0xf4f48ce5e1bbeedb lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049462.213538:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8cb8c396d700) 00010000:00010000:1.0:1789049462.213541:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789049462.213546:0:5850:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d776e200/0xf4f48ce5e1bbeedb lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049462.213552:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d776e200/0xf4f48ce5e1bbeedb lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049462.213565:0:5850:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d776fa00/0xf4f48ce5e1bbeee2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049462.213572:0:5850:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d776fa00/0xf4f48ce5e1bbeee2 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049462.214278:0:5850:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d776fa00/0xf4f48ce5e1bbeee2 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049462.214289:0:5850:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cb8d776fa00 already unused, calling callback (ffffffffc20ca4f0) 00010000:00010000:1.0:1789049462.214293:0:5850:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d776fa00/0xf4f48ce5e1bbeee2 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049462.214300:0:5850:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d776fa00/0xf4f48ce5e1bbeee2 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049462.214311:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff8cb8c396df00) 00010000:00010000:1.0:1789049462.214314:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789049462.214317:0:5850:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d776fa00/0xf4f48ce5e1bbeee2 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049462.214335:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d776fa00/0xf4f48ce5e1bbeee2 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049462.214383:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6715a00/0xf4f48ce5e1bbeed4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a3336 expref: 8 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049462.214397:0:5850:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c146c200/0xf4f48ce5e1bbeee9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a3336 expref: 7 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049462.214404:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff8cb8c396da00) 00010000:00010000:1.0:1789049462.214406:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:1.0:1789049462.214409:0:5850:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cb8c146c200, rc 0) 00000100:00100000:1.0:1789049462.214486:0:5850:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb900a5a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e823b53a-3591-475c-8624-c682227e5c13+7:9679:x1875954089608832:12345-192.168.206.26@tcp:101:touch.500 Request processed in 47105us (47996us total) trans 0 rc 0/0 00000100:00100000:1.0:1789049462.214496:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.26@tcp, seq: 21 00000100:00100000:1.0:1789049462.221785:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.26@tcp (source: 12345-192.168.206.26@tcp) 00000100:00100000:3.0:1789049462.222060:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954089609088 00000100:00100000:3.0:1789049462.222070:0:5851:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954089609088 00000100:00100000:3.0:1789049462.222152:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.26@tcp, seq: 22 00000100:00100000:3.0:1789049462.222163:0:5851:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8f7744380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e823b53a-3591-475c-8624-c682227e5c13+7:9679:x1875954089609088:12345-192.168.206.26@tcp:101:touch.500 00010000:00010000:3.0:1789049462.222183:0:5851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789049462.222368:0:5851:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c6b34a00/0xf4f48ce5e1bbeef0 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7fc5e358805a333d expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049462.222779:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c6b35600/0xf4f48ce5e1bbeef7 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049462.222794:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c6b35600/0xf4f48ce5e1bbeef7 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049462.222805:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c6b35600/0xf4f48ce5e1bbeef7 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049462.222818:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c6b35400/0xf4f48ce5e1bbeefe lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1:0x0].0xa178ae45 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049462.222833:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c6b35400/0xf4f48ce5e1bbeefe lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0xa178ae45 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049462.222875:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c6b35400/0xf4f48ce5e1bbeefe lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0xa178ae45 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1789049462.226436:0:5851:0:(osp_object.c:1667:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x2:0x0], index 0: 0 00010000:00010000:3.0:1789049462.229196:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c6b35a00/0xf4f48ce5e1bbef05 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049462.229297:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c6b35a00/0xf4f48ce5e1bbef05 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049462.229312:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c6b35a00/0xf4f48ce5e1bbef05 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049462.229354:0:5851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c6b35600/0xf4f48ce5e1bbeef7 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049462.229362:0:5851:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c6b35600/0xf4f48ce5e1bbeef7 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049462.229368:0:5851:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c6b35600/0xf4f48ce5e1bbeef7 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049462.229375:0:5851:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cb8c6b35600 already unused, calling callback (ffffffffc20ca4f0) 00010000:00010000:3.0:1789049462.229380:0:5851:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c6b35600/0xf4f48ce5e1bbeef7 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049462.229389:0:5851:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c6b35600/0xf4f48ce5e1bbeef7 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049462.229420:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff8cb8c396da00) 00010000:00010000:3.0:1789049462.229424:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789049462.229429:0:5851:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c6b35600/0xf4f48ce5e1bbeef7 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049462.229436:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c6b35600/0xf4f48ce5e1bbeef7 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789049462.229449:0:5851:0:(mdt_handler.c:4507:mdt_save_lock()) ### save lock request 000000004dc6d4fc reply state 000000001f71b0cb transno 4294967300 ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c6b35400/0xf4f48ce5e1bbeefe lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0xa178ae45 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789049462.229458:0:5851:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1789049462.229500:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c6b34a00/0xf4f48ce5e1bbeef0 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a333d expref: 10 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049462.229514:0:5851:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c6b35a00/0xf4f48ce5e1bbef05 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a333d expref: 9 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049462.229522:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff8cb8cab67c00) 00010000:00010000:3.0:1789049462.229524:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789049462.229526:0:5851:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cb8c6b35a00, rc 0) 00000100:00100000:3.0:1789049462.229988:0:5851:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8f7744380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e823b53a-3591-475c-8624-c682227e5c13+10:9679:x1875954089609088:12345-192.168.206.26@tcp:101:touch.500 Request processed in 7825us (8210us total) trans 4294967300 rc 0/0 00000100:00100000:3.0:1789049462.229997:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.26@tcp, seq: 22 00010000:00010000:2.0:1789049462.234490:0:3294:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c6b35400/0xf4f48ce5e1bbeefe lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0xa178ae45 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049462.234506:0:3294:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c6b35400/0xf4f48ce5e1bbeefe lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0xa178ae45 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049462.234514:0:3294:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c6b35400/0xf4f48ce5e1bbeefe lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0xa178ae45 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049462.234521:0:3294:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cb8c6b35400 already unused, calling callback (ffffffffc20ca4f0) 00010000:00010000:2.0:1789049462.234525:0:3294:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c6b35400/0xf4f48ce5e1bbeefe lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0xa178ae45 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049462.234533:0:3294:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c6b35400/0xf4f48ce5e1bbeefe lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0xa178ae45 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049462.234549:0:3294:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0xa178ae45 (ffff8cb8cab67700) 00010000:00010000:2.0:1789049462.234553:0:3294:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789049462.234558:0:3294:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c6b35400/0xf4f48ce5e1bbeefe lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0xa178ae45 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049462.234565:0:3294:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c6b35400/0xf4f48ce5e1bbeefe lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0xa178ae45 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789049462.248039:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.26@tcp (source: 12345-192.168.206.26@tcp) 00000100:00100000:2.0:1789049462.248136:0:6841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954089609344 00000100:00100000:2.0:1789049462.248147:0:6841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954089609344 00000100:00100000:2.0:1789049462.248218:0:6841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.26@tcp, seq: 23 00000100:00100000:2.0:1789049462.248230:0:6841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8f7744e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e823b53a-3591-475c-8624-c682227e5c13+9:9679:x1875954089609344:12345-192.168.206.26@tcp:36:touch.500 00010000:00010000:2.0:1789049462.248284:0:6841:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789049462.248311:0:6841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c6b35a00/0xf4f48ce5e1bbef05 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a333d expref: 9 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049462.248332:0:6841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff8cb8cab67c00) 00010000:00010000:2.0:1789049462.248342:0:6841:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789049462.248385:0:6841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6715a00/0xf4f48ce5e1bbef13 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049462.248399:0:6841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6715a00/0xf4f48ce5e1bbef13 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049462.248409:0:6841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6715a00/0xf4f48ce5e1bbef13 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6841 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789049462.248566:0:6841:0:(mdt_handler.c:4507:mdt_save_lock()) ### save lock request 0000000052d79045 reply state 000000007a848005 transno 4294967301 ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6715a00/0xf4f48ce5e1bbef13 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6841 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789049462.248576:0:6841:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1789049462.248686:0:6841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8f7744e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e823b53a-3591-475c-8624-c682227e5c13+10:9679:x1875954089609344:12345-192.168.206.26@tcp:36:touch.500 Request processed in 458us (658us total) trans 4294967301 rc 0/0 00000100:00100000:2.0:1789049462.248694:0:6841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.26@tcp, seq: 23 00010000:00010000:1.0:1789049462.254128:0:3295:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6715a00/0xf4f48ce5e1bbef13 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049462.254146:0:3295:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6715a00/0xf4f48ce5e1bbef13 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049462.254153:0:3295:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6715a00/0xf4f48ce5e1bbef13 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049462.254159:0:3295:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cb8d6715a00 already unused, calling callback (ffffffffc20ca4f0) 00010000:00010000:1.0:1789049462.254164:0:3295:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6715a00/0xf4f48ce5e1bbef13 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049462.254181:0:3295:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6715a00/0xf4f48ce5e1bbef13 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049462.254198:0:3295:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff8cb8e0130800) 00010000:00010000:1.0:1789049462.254200:0:3295:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789049462.254205:0:3295:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6715a00/0xf4f48ce5e1bbef13 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049462.254211:0:3295:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6715a00/0xf4f48ce5e1bbef13 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6841 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789049462.258493:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.26@tcp (source: 12345-192.168.206.26@tcp) 00000100:00100000:2.0:1789049462.258687:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954089609472 00000100:00100000:2.0:1789049462.258709:0:5852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954089609472 00000100:00100000:2.0:1789049462.258779:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.26@tcp, seq: 24 00000100:00100000:2.0:1789049462.258788:0:5852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8f7745c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e823b53a-3591-475c-8624-c682227e5c13+9:9679:x1875954089609472:12345-192.168.206.26@tcp:101:touch.500 00010000:00010000:2.0:1789049462.258811:0:5852:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789049462.258833:0:5852:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6715c00/0xf4f48ce5e1bbef1a lrc: 2/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7fc5e358805a3344 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049462.259141:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6715c00/0xf4f48ce5e1bbef1a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a3344 expref: 10 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049462.259159:0:5852:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6715c00/0xf4f48ce5e1bbef1a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a3344 expref: 10 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049462.259187:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff8cb8e0130300) 00010000:00010000:0.0:1789049462.259191:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1789049462.259195:0:5852:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cb8d6715c00, rc 0) 00000100:00100000:0.0:1789049462.259322:0:5852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8f7745c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e823b53a-3591-475c-8624-c682227e5c13+10:9679:x1875954089609472:12345-192.168.206.26@tcp:101:touch.500 Request processed in 534us (838us total) trans 0 rc 0/0 00000100:00100000:0.0:1789049462.259330:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.26@tcp, seq: 24 00000100:00100000:3.0:1789049462.282060:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.26@tcp (source: 12345-192.168.206.26@tcp) 00000100:00100000:1.0:1789049462.282377:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954089609600 00000100:00100000:1.0:1789049462.282387:0:6704:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954089609600 00000100:00100000:1.0:1789049462.282942:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.26@tcp, seq: 16 00000100:00100000:1.0:1789049462.282951:0:6704:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb9009d4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2354:x1875954089609600:12345-192.168.206.26@tcp:8:touch.500 00010000:00080000:1.0:1789049462.282984:0:6704:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0000: connection from e823b53a-3591-475c-8624-c682227e5c13@192.168.206.26@tcp t0 exp 0000000000000000 cur 288 last 0 00000020:00000080:1.0:1789049462.283091:0:6704:0:(genops.c:1384:class_connect()) connect: client e823b53a-3591-475c-8624-c682227e5c13, cookie 0xf4f48ce5e1bbef21 00002000:00100000:1.0:1789049462.283103:0:6704:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli e823b53a-3591-475c-8624-c682227e5c13/ffff8cb8c6bc5800 ocd_connect_flags: 0xa046faf2e3640038 ocd_version: 2113a28 ocd_grant: 3407872 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1789049462.283139:0:6704:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:1.0:1789049462.283444:0:6704:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:1.0:1789049462.283481:0:6704:0:(import.c:65:import_set_state_nolock()) ffff8cb8c6bc0800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1789049462.283554:0:6704:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb9009d4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e823b53a-3591-475c-8624-c682227e5c13+6:2354:x1875954089609600:12345-192.168.206.26@tcp:8:touch.500 Request processed in 602us (1502us total) trans 0 rc 0/0 00000100:00100000:1.0:1789049462.283563:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.26@tcp, seq: 16 00000100:00100000:1.0:1789049462.300373:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.26@tcp (source: 12345-192.168.206.26@tcp) 00000100:00100000:2.0:1789049462.301455:0:6703:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954089609728 00000100:00100000:2.0:1789049462.301469:0:6703:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954089609728 00000100:00100000:2.0:1789049462.301694:0:6703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.26@tcp, seq: 17 00000100:00100000:2.0:1789049462.301705:0:6703:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8f7746300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e823b53a-3591-475c-8624-c682227e5c13+6:0:x1875954089609728:12345-192.168.206.26@tcp:2:touch.500 00000100:00080000:1.0:1789049462.302387:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:00100000:2.0:1789049462.402710:0:6731:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of e823b53a-3591-475c-8624-c682227e5c13 00000001:00080000:2.0:1789049462.402727:0:6731:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967299 is committed 00000100:00100000:0.0:1789049462.402813:0:6703:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8f7746300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e823b53a-3591-475c-8624-c682227e5c13+5:0:x1875954089609728:12345-192.168.206.26@tcp:2:touch.500 Request processed in 101104us (102441us total) trans 4294967299 rc 0/0 00000100:00100000:0.0:1789049462.402823:0:6703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.26@tcp, seq: 17 00000100:00100000:0.0:1789049462.408653:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.26@tcp (source: 12345-192.168.206.26@tcp) 00000100:00100000:2.0:1789049462.408792:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954089609984 00000100:00100000:2.0:1789049462.408802:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954089609984 00000100:00100000:2.0:1789049462.408890:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.26@tcp, seq: 2 00000100:00100000:2.0:1789049462.408900:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb900a5bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e823b53a-3591-475c-8624-c682227e5c13+10:9679:x1875954089609984:12345-192.168.206.26@tcp:35:touch.500 00000100:00100000:2.0:1789049462.409358:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb900a5bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e823b53a-3591-475c-8624-c682227e5c13+11:9679:x1875954089609984:12345-192.168.206.26@tcp:35:touch.500 Request processed in 458us (718us total) trans 4294967302 rc 0/0 00000100:00100000:2.0:1789049462.409366:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.26@tcp, seq: 2 00000100:00100000:2.0:1789049462.450394:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.26@tcp (source: 12345-192.168.206.26@tcp) 00000100:00100000:1.0:1789049462.450502:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954089610112 00000100:00100000:1.0:1789049462.450512:0:5850:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954089610112 00000100:00100000:1.0:1789049462.450601:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.26@tcp, seq: 25 00000100:00100000:1.0:1789049462.450612:0:5850:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8df480a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e823b53a-3591-475c-8624-c682227e5c13+11:9680:x1875954089610112:12345-192.168.206.26@tcp:101:rm.0 00010000:00010000:1.0:1789049462.450635:0:5850:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789049462.450652:0:5850:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c146dc00/0xf4f48ce5e1bbef28 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7fc5e358805a334b expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049462.450713:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c146c000/0xf4f48ce5e1bbef2f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049462.450727:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c146c000/0xf4f48ce5e1bbef2f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049462.450739:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c146c000/0xf4f48ce5e1bbef2f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789049462.450773:0:5850:0:(mdt_handler.c:922:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00000004:00200000:1.0:1789049462.450777:0:5850:0:(mdt_handler.c:1587:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1789049462.450817:0:5850:0:(mdt_handler.c:2522:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c146c000/0xf4f48ce5e1bbef2f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049462.450880:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c146dc00/0xf4f48ce5e1bbef28 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a334b expref: 13 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049462.450902:0:5850:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c146c000/0xf4f48ce5e1bbef2f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a334b expref: 12 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049462.450911:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff8cb8c396da00) 00010000:00010000:1.0:1789049462.450913:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1789049462.450930:0:5850:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cb8c146c000, rc 0) 00000100:00100000:1.0:1789049462.450981:0:5850:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8df480a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e823b53a-3591-475c-8624-c682227e5c13+12:9680:x1875954089610112:12345-192.168.206.26@tcp:101:rm.0 Request processed in 371us (596us total) trans 0 rc 0/0 00000100:00100000:1.0:1789049462.450988:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.26@tcp, seq: 25 00000100:00100000:0.0:1789049462.453891:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.26@tcp (source: 12345-192.168.206.26@tcp) 00000100:00100000:2.0:1789049462.454782:0:6841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954089610368 00000100:00100000:2.0:1789049462.454793:0:6841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954089610368 00000100:00100000:2.0:1789049462.454869:0:6841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.26@tcp, seq: 26 00000100:00100000:2.0:1789049462.454880:0:6841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb900a58380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e823b53a-3591-475c-8624-c682227e5c13+12:9680:x1875954089610368:12345-192.168.206.26@tcp:101:rm.0 00010000:00010000:2.0:1789049462.454900:0:6841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789049462.454919:0:6841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6714000/0xf4f48ce5e1bbef36 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7fc5e358805a3352 expref: -99 pid: 6841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789049462.455028:0:6841:0:(mdt_handler.c:922:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00010000:00010000:2.0:1789049462.455168:0:6841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6714000/0xf4f48ce5e1bbef36 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a3352 expref: 14 pid: 6841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049462.455182:0:6841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8cb8c396d700) 00010000:00010000:2.0:1789049462.455184:0:6841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1789049462.455189:0:6841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6714000/0xf4f48ce5e1bbef36 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a3352 expref: 14 pid: 6841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049462.455201:0:6841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cb8d6714000, rc 0) 00000100:00100000:2.0:1789049462.455258:0:6841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb900a58380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e823b53a-3591-475c-8624-c682227e5c13+13:9680:x1875954089610368:12345-192.168.206.26@tcp:101:rm.0 Request processed in 381us (1418us total) trans 4294967303 rc 301/301 00000100:00100000:2.0:1789049462.455265:0:6841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.26@tcp, seq: 26 00000100:00100000:0.0:1789049462.461092:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.26@tcp (source: 12345-192.168.206.26@tcp) 00000100:00100000:2.0:1789049462.461305:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954089610496 00000100:00100000:2.0:1789049462.461316:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954089610496 00000100:00100000:2.0:1789049462.461375:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.26@tcp, seq: 3 00000100:00100000:2.0:1789049462.461385:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb900a5a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e823b53a-3591-475c-8624-c682227e5c13+13:9680:x1875954089610496:12345-192.168.206.26@tcp:37:rm.0 00000100:00100000:0.0:1789049462.467321:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb900a5a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e823b53a-3591-475c-8624-c682227e5c13+13:9680:x1875954089610496:12345-192.168.206.26@tcp:37:rm.0 Request processed in 5927us (6228us total) trans 0 rc 0/0 00000100:00100000:0.0:1789049462.467334:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.26@tcp, seq: 3 00000100:00100000:0.0:1789049462.473296:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.26@tcp (source: 12345-192.168.206.26@tcp) 00000100:00100000:3.0:1789049462.473397:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954089610752 00000100:00100000:3.0:1789049462.473407:0:5853:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954089610752 00000100:00100000:3.0:1789049462.473497:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.26@tcp, seq: 4 00000100:00100000:3.0:1789049462.473508:0:5853:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8d1d2f050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e823b53a-3591-475c-8624-c682227e5c13+13:9680:x1875954089610752:12345-192.168.206.26@tcp:35:rm.0 00000100:00100000:3.0:1789049462.473774:0:5853:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8d1d2f050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e823b53a-3591-475c-8624-c682227e5c13+14:9680:x1875954089610752:12345-192.168.206.26@tcp:35:rm.0 Request processed in 266us (484us total) trans 4294967304 rc 0/0 00000100:00100000:3.0:1789049462.473781:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.26@tcp, seq: 4 00000100:00100000:0.0:1789049462.477574:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.26@tcp (source: 12345-192.168.206.26@tcp) 00000100:00100000:2.0:1789049462.478138:0:6841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954089611008 00000100:00100000:2.0:1789049462.478149:0:6841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954089611008 00000100:00100000:2.0:1789049462.478211:0:6841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.26@tcp, seq: 27 00000100:00100000:2.0:1789049462.478221:0:6841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb900a5aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e823b53a-3591-475c-8624-c682227e5c13+14:9680:x1875954089611008:12345-192.168.206.26@tcp:101:rm.0 00010000:00010000:2.0:1789049462.478249:0:6841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789049462.478271:0:6841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6715000/0xf4f48ce5e1bbef44 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7fc5e358805a3359 expref: -99 pid: 6841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049462.478388:0:6841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6714000/0xf4f48ce5e1bbef4b lrc: 3/1,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049462.478402:0:6841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6714000/0xf4f48ce5e1bbef4b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049462.478412:0:6841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6714000/0xf4f48ce5e1bbef4b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6841 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789049462.478423:0:6841:0:(mdt_handler.c:922:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00010000:00010000:2.0:1789049462.478553:0:6841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6715000/0xf4f48ce5e1bbef44 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a3359 expref: 17 pid: 6841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049462.478571:0:6841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6714000/0xf4f48ce5e1bbef4b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a3359 expref: 16 pid: 6841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049462.478591:0:6841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff8cb8c396da00) 00010000:00010000:2.0:1789049462.478594:0:6841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1789049462.478597:0:6841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cb8d6714000, rc 0) 00000100:00100000:2.0:1789049462.479181:0:6841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb900a5aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e823b53a-3591-475c-8624-c682227e5c13+16:9680:x1875954089611008:12345-192.168.206.26@tcp:101:rm.0 Request processed in 958us (1613us total) trans 4294967305 rc 0/0 00000100:00100000:2.0:1789049462.479190:0:6841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.26@tcp, seq: 27 00000100:00100000:2.0:1789049462.490330:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.26@tcp (source: 12345-192.168.206.26@tcp) 00010000:00010000:0.0:1789049462.490994:0:6719:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789049462.491055:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954089611136 00000100:00100000:1.0:1789049462.491065:0:5850:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954089611136 00000100:00100000:1.0:1789049462.491130:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.26@tcp, seq: 28 00000100:00100000:1.0:1789049462.491140:0:5850:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8df481880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e823b53a-3591-475c-8624-c682227e5c13+16:9680:x1875954089611136:12345-192.168.206.26@tcp:41:rm.0 00000004:00000024:1.0:1789049462.491199:0:5850:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 7719616512 avail 7715422208 00000100:00100000:1.0:1789049462.491315:0:5850:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8df481880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e823b53a-3591-475c-8624-c682227e5c13+16:9680:x1875954089611136:12345-192.168.206.26@tcp:41:rm.0 Request processed in 176us (992us total) trans 0 rc 0/0 00000100:00100000:1.0:1789049462.491322:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.26@tcp, seq: 28 00000100:00100000:1.0:1789049462.505156:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.26@tcp (source: 12345-192.168.206.26@tcp) 00000100:00100000:0.0:1789049462.506218:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954089611264 00000100:00100000:0.0:1789049462.506230:0:5852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954089611264 00000100:00100000:0.0:1789049462.506352:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.26@tcp, seq: 29 00000100:00100000:0.0:1789049462.506362:0:5852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8f7746a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e823b53a-3591-475c-8624-c682227e5c13+16:9680:x1875954089611264:12345-192.168.206.26@tcp:101:rm.0 00010000:00010000:0.0:1789049462.506381:0:5852:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789049462.506402:0:5852:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb7c4c38c00/0xf4f48ce5e1bbef59 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7fc5e358805a3360 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049462.506502:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb7c4c38e00/0xf4f48ce5e1bbef60 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049462.506517:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cb7c4c38e00/0xf4f48ce5e1bbef60 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049462.506529:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb7c4c38e00/0xf4f48ce5e1bbef60 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049462.506542:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb7c4c38a00/0xf4f48ce5e1bbef67 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0xa178ae45 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049462.506550:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cb7c4c38a00/0xf4f48ce5e1bbef67 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0xa178ae45 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049462.506556:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb7c4c38a00/0xf4f48ce5e1bbef67 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0xa178ae45 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049462.506714:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb7c4c39e00/0xf4f48ce5e1bbef6e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049462.506724:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cb7c4c39e00/0xf4f48ce5e1bbef6e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049462.506731:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb7c4c39e00/0xf4f48ce5e1bbef6e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789049462.507052:0:5852:0:(mdt_handler.c:922:mdt_pack_attr2body()) [0x200000401:0x2:0x0]: returning size 0 00000004:00200000:0.0:1789049462.507057:0:5852:0:(mdt_handler.c:1587:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1789049462.507077:0:5852:0:(mdt_handler.c:2522:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8cb7c4c39e00/0xf4f48ce5e1bbef6e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049462.507101:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cb7c4c39e00/0xf4f48ce5e1bbef6e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049462.507120:0:5852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb7c4c38e00/0xf4f48ce5e1bbef60 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049462.507126:0:5852:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cb7c4c38e00/0xf4f48ce5e1bbef60 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049462.507132:0:5852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cb7c4c38e00/0xf4f48ce5e1bbef60 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049462.507137:0:5852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cb7c4c38e00 already unused, calling callback (ffffffffc20ca4f0) 00010000:00010000:0.0:1789049462.507141:0:5852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb7c4c38e00/0xf4f48ce5e1bbef60 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049462.507148:0:5852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb7c4c38e00/0xf4f48ce5e1bbef60 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049462.507158:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff8cb8c396da00) 00010000:00010000:0.0:1789049462.507160:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789049462.507164:0:5852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cb7c4c38e00/0xf4f48ce5e1bbef60 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049462.507170:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb7c4c38e00/0xf4f48ce5e1bbef60 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049462.507182:0:5852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb7c4c38a00/0xf4f48ce5e1bbef67 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0xa178ae45 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049462.507187:0:5852:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cb7c4c38a00/0xf4f48ce5e1bbef67 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0xa178ae45 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049462.507198:0:5852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cb7c4c38a00/0xf4f48ce5e1bbef67 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0xa178ae45 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049462.507203:0:5852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cb7c4c38a00 already unused, calling callback (ffffffffc20ca4f0) 00010000:00010000:0.0:1789049462.507206:0:5852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb7c4c38a00/0xf4f48ce5e1bbef67 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0xa178ae45 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049462.507213:0:5852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb7c4c38a00/0xf4f48ce5e1bbef67 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0xa178ae45 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049462.507221:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0xa178ae45 (ffff8cb8ce751100) 00010000:00010000:0.0:1789049462.507223:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789049462.507226:0:5852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cb7c4c38a00/0xf4f48ce5e1bbef67 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0xa178ae45 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049462.507232:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb7c4c38a00/0xf4f48ce5e1bbef67 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0xa178ae45 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049462.507264:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb7c4c38c00/0xf4f48ce5e1bbef59 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a3360 expref: 18 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049462.507278:0:5852:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb7c4c39e00/0xf4f48ce5e1bbef6e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a3360 expref: 17 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049462.507285:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff8cb8e0130300) 00010000:00010000:0.0:1789049462.507287:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789049462.507290:0:5852:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cb7c4c39e00, rc 0) 00000100:00100000:0.0:1789049462.507366:0:5852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8f7746a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e823b53a-3591-475c-8624-c682227e5c13+17:9680:x1875954089611264:12345-192.168.206.26@tcp:101:rm.0 Request processed in 1005us (2218us total) trans 0 rc 0/0 00000100:00100000:0.0:1789049462.507383:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.26@tcp, seq: 29 00000100:00100000:2.0:1789049462.512831:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.26@tcp (source: 12345-192.168.206.26@tcp) 00000100:00100000:0.0:1789049462.512995:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954089611520 00000100:00100000:0.0:1789049462.513004:0:5852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954089611520 00000100:00100000:0.0:1789049462.513065:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.26@tcp, seq: 30 00000100:00100000:0.0:1789049462.513077:0:5852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8df483b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e823b53a-3591-475c-8624-c682227e5c13+17:9680:x1875954089611520:12345-192.168.206.26@tcp:36:rm.0 00010000:00010000:0.0:1789049462.513141:0:5852:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:0.0:1789049462.513167:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb7c4c39e00/0xf4f48ce5e1bbef6e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a3360 expref: 17 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049462.513189:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6715c00/0xf4f48ce5e1bbef1a lrc: 0/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a3344 expref: 16 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049462.513200:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff8cb8e0130300) 00010000:00010000:0.0:1789049462.513741:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c146c000/0xf4f48ce5e1bbef2f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a334b expref: 15 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049462.513757:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff8cb8c396da00) 00010000:00010000:0.0:1789049462.513761:0:5852:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789049462.513779:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb7c4c38000/0xf4f48ce5e1bbef75 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049462.513915:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cb7c4c38000/0xf4f48ce5e1bbef75 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049462.513927:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb7c4c38000/0xf4f48ce5e1bbef75 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049462.513942:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb7c4c39600/0xf4f48ce5e1bbef7c lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1:0x0].0xa178ae45 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049462.513962:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cb7c4c39600/0xf4f48ce5e1bbef7c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0xa178ae45 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049462.513969:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb7c4c39600/0xf4f48ce5e1bbef7c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0xa178ae45 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049462.514065:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb7c4c38800/0xf4f48ce5e1bbef83 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049462.514073:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cb7c4c38800/0xf4f48ce5e1bbef83 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049462.514079:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb7c4c38800/0xf4f48ce5e1bbef83 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1789049462.515092:0:5852:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].2, 64 off8320 00000004:00080000:0.0:1789049462.515185:0:5852:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 288567341171ns, next at 289567338540ns, rc = 0 00010000:00010000:0.0:1789049462.515258:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb7c4c39200/0xf4f48ce5e1bbef8a lrc: 3/0,1 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049462.515272:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cb7c4c39200/0xf4f48ce5e1bbef8a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049462.515281:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb7c4c39200/0xf4f48ce5e1bbef8a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049462.515289:0:5852:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb7c4c39200/0xf4f48ce5e1bbef8a lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049462.515294:0:5852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb7c4c39200/0xf4f48ce5e1bbef8a lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049462.515311:0:5852:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cb7c4c39200/0xf4f48ce5e1bbef8a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049462.515340:0:5852:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789049462.515364:0:5852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb7c4c38800/0xf4f48ce5e1bbef83 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049462.515371:0:5852:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cb7c4c38800/0xf4f48ce5e1bbef83 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049462.515377:0:5852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cb7c4c38800/0xf4f48ce5e1bbef83 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049462.515382:0:5852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cb7c4c38800 already unused, calling callback (ffffffffc20ca4f0) 00010000:00010000:0.0:1789049462.515387:0:5852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb7c4c38800/0xf4f48ce5e1bbef83 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049462.515394:0:5852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb7c4c38800/0xf4f48ce5e1bbef83 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049462.515404:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff8cb8ce751300) 00010000:00010000:0.0:1789049462.515407:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1789049462.515411:0:5852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cb7c4c38800/0xf4f48ce5e1bbef83 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049462.515416:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb7c4c38800/0xf4f48ce5e1bbef83 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049462.515433:0:5852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb7c4c38000/0xf4f48ce5e1bbef75 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049462.515439:0:5852:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cb7c4c38000/0xf4f48ce5e1bbef75 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049462.515451:0:5852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cb7c4c38000/0xf4f48ce5e1bbef75 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049462.515456:0:5852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cb7c4c38000 already unused, calling callback (ffffffffc20ca4f0) 00010000:00010000:0.0:1789049462.515459:0:5852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb7c4c38000/0xf4f48ce5e1bbef75 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049462.515465:0:5852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb7c4c38000/0xf4f48ce5e1bbef75 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049462.515472:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff8cb8c396da00) 00010000:00010000:0.0:1789049462.515475:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789049462.515477:0:5852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cb7c4c38000/0xf4f48ce5e1bbef75 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049462.515483:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb7c4c38000/0xf4f48ce5e1bbef75 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789049462.515493:0:5852:0:(mdt_handler.c:4507:mdt_save_lock()) ### save lock request 0000000083c9d479 reply state 000000007a386c02 transno 4294967306 ns: mdt-lustre-MDT0000_UUID lock: ffff8cb7c4c39600/0xf4f48ce5e1bbef7c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0xa178ae45 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789049462.515501:0:5852:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1789049462.515671:0:5852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8df483b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e823b53a-3591-475c-8624-c682227e5c13+16:9680:x1875954089611520:12345-192.168.206.26@tcp:36:rm.0 Request processed in 2594us (2846us total) trans 4294967306 rc 0/0 00000100:00100000:0.0:1789049462.515680:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.26@tcp, seq: 30 00010000:00010000:1.0:1789049462.515869:0:5838:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789049462.515875:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cb7c4c39200/0xf4f48ce5e1bbef8a lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049462.515881:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cb7c4c39200 already unused, calling callback (ffffffffc166a8f0) 00010000:00010000:1.0:1789049462.515884:0:5838:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb7c4c39200/0xf4f48ce5e1bbef8a lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049462.515890:0:5838:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb7c4c39200/0xf4f48ce5e1bbef8a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049462.515899:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff8cb8ce751300) 00010000:00010000:1.0:1789049462.515901:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1789049462.515904:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cb7c4c39200/0xf4f48ce5e1bbef8a lrc: 1/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049462.515909:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb7c4c39200/0xf4f48ce5e1bbef8a lrc: 0/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049462.515934:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789049462.515936:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789049462.515938:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789049462.518324:0:3294:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb7c4c39600/0xf4f48ce5e1bbef7c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0xa178ae45 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049462.518341:0:3294:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cb7c4c39600/0xf4f48ce5e1bbef7c lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0xa178ae45 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049462.518363:0:3294:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cb7c4c39600/0xf4f48ce5e1bbef7c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0xa178ae45 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049462.518370:0:3294:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cb7c4c39600 already unused, calling callback (ffffffffc20ca4f0) 00010000:00010000:2.0:1789049462.518374:0:3294:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb7c4c39600/0xf4f48ce5e1bbef7c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0xa178ae45 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049462.518382:0:3294:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb7c4c39600/0xf4f48ce5e1bbef7c lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0xa178ae45 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049462.518397:0:3294:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0xa178ae45 (ffff8cb8ce751000) 00010000:00010000:2.0:1789049462.518400:0:3294:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789049462.518404:0:3294:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cb7c4c39600/0xf4f48ce5e1bbef7c lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0xa178ae45 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049462.518411:0:3294:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb7c4c39600/0xf4f48ce5e1bbef7c lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0xa178ae45 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789049462.521405:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.26@tcp (source: 12345-192.168.206.26@tcp) 00000100:00100000:0.0:1789049462.521458:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954089611776 00000100:00100000:0.0:1789049462.521469:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954089611776 00000100:00100000:0.0:1789049462.521648:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.26@tcp, seq: 5 00000100:00100000:0.0:1789049462.521658:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8df480700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e823b53a-3591-475c-8624-c682227e5c13+15:9680:x1875954089611776:12345-192.168.206.26@tcp:35:rm.0 00000100:00100000:0.0:1789049462.521961:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8df480700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e823b53a-3591-475c-8624-c682227e5c13+16:9680:x1875954089611776:12345-192.168.206.26@tcp:35:rm.0 Request processed in 302us (562us total) trans 4294967307 rc 0/0 00000100:00100000:0.0:1789049462.521970:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.26@tcp, seq: 5 00000100:00100000:3.0:1789049462.525491:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.26@tcp (source: 12345-192.168.206.26@tcp) 00000100:00100000:2.0:1789049462.525628:0:6841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954089612032 00000100:00100000:2.0:1789049462.525639:0:6841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954089612032 00000100:00100000:2.0:1789049462.525715:0:6841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.26@tcp, seq: 31 00000100:00100000:2.0:1789049462.525726:0:6841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb9009d4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e823b53a-3591-475c-8624-c682227e5c13+16:9680:x1875954089612032:12345-192.168.206.26@tcp:36:rm.0 00010000:00010000:2.0:1789049462.525795:0:6841:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:2.0:1789049462.525823:0:6841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6714000/0xf4f48ce5e1bbef4b lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a3359 expref: 16 pid: 6841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049462.525912:0:6841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c146c200/0xf4f48ce5e1bbeee9 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a3336 expref: 15 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049462.525942:0:6841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff8cb8c396da00) 00010000:00010000:2.0:1789049462.525961:0:6841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c146d800/0xf4f48ce5e1bbeeaa lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a3328 expref: 14 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049462.525970:0:6841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8cb8c396d700) 00010000:00010000:2.0:1789049462.525976:0:6841:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789049462.525998:0:6841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6714e00/0xf4f48ce5e1bbef91 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049462.526010:0:6841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6714e00/0xf4f48ce5e1bbef91 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049462.526019:0:6841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6714e00/0xf4f48ce5e1bbef91 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049462.526032:0:6841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6715a00/0xf4f48ce5e1bbef98 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049462.526039:0:6841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6715a00/0xf4f48ce5e1bbef98 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049462.526045:0:6841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6715a00/0xf4f48ce5e1bbef98 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049462.526301:0:6841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6715200/0xf4f48ce5e1bbef9f lrc: 3/0,1 mode: --/EX res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049462.526311:0:6841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6715200/0xf4f48ce5e1bbef9f lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049462.526328:0:6841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6715200/0xf4f48ce5e1bbef9f lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6841 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789049462.526949:0:6841:0:(mdt_handler.c:922:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00010000:00010000:2.0:1789049462.526965:0:6841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6715200/0xf4f48ce5e1bbef9f lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049462.526972:0:6841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6715200/0xf4f48ce5e1bbef9f lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049462.526978:0:6841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6715200/0xf4f48ce5e1bbef9f lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049462.526983:0:6841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cb8d6715200 already unused, calling callback (ffffffffc20ca4f0) 00010000:00010000:2.0:1789049462.526986:0:6841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6715200/0xf4f48ce5e1bbef9f lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049462.526993:0:6841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6715200/0xf4f48ce5e1bbef9f lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049462.527003:0:6841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff8cb8e0130400) 00010000:00010000:2.0:1789049462.527006:0:6841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1789049462.527010:0:6841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6715200/0xf4f48ce5e1bbef9f lrc: 2/0,0 mode: --/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049462.527015:0:6841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6715200/0xf4f48ce5e1bbef9f lrc: 0/0,0 mode: --/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049462.527034:0:6841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6714e00/0xf4f48ce5e1bbef91 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049462.527040:0:6841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6714e00/0xf4f48ce5e1bbef91 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049462.527053:0:6841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6714e00/0xf4f48ce5e1bbef91 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049462.527058:0:6841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cb8d6714e00 already unused, calling callback (ffffffffc20ca4f0) 00010000:00010000:2.0:1789049462.527061:0:6841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6714e00/0xf4f48ce5e1bbef91 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049462.527067:0:6841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6714e00/0xf4f48ce5e1bbef91 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049462.527076:0:6841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8cb8e0130b00) 00010000:00010000:2.0:1789049462.527078:0:6841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789049462.527081:0:6841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6714e00/0xf4f48ce5e1bbef91 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049462.527086:0:6841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6714e00/0xf4f48ce5e1bbef91 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6841 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789049462.527099:0:6841:0:(mdt_handler.c:4507:mdt_save_lock()) ### save lock request 000000000b55444a reply state 000000001cfcc79d transno 4294967308 ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6715a00/0xf4f48ce5e1bbef98 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6841 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789049462.527117:0:6841:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1789049462.527208:0:6841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb9009d4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e823b53a-3591-475c-8624-c682227e5c13+15:9680:x1875954089612032:12345-192.168.206.26@tcp:36:rm.0 Request processed in 1481us (1723us total) trans 4294967308 rc 0/0 00000100:00100000:2.0:1789049462.527216:0:6841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.26@tcp, seq: 31 00010000:00010000:1.0:1789049462.530438:0:3295:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6715a00/0xf4f48ce5e1bbef98 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049462.530455:0:3295:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6715a00/0xf4f48ce5e1bbef98 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049462.530463:0:3295:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6715a00/0xf4f48ce5e1bbef98 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049462.530469:0:3295:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cb8d6715a00 already unused, calling callback (ffffffffc20ca4f0) 00010000:00010000:1.0:1789049462.530474:0:3295:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6715a00/0xf4f48ce5e1bbef98 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049462.530482:0:3295:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6715a00/0xf4f48ce5e1bbef98 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049462.530498:0:3295:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff8cb8e0130700) 00010000:00010000:1.0:1789049462.530502:0:3295:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789049462.530507:0:3295:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6715a00/0xf4f48ce5e1bbef98 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049462.530513:0:3295:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6715a00/0xf4f48ce5e1bbef98 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049463.514982:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789049464.542149:0:6719:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:2.0:1789049465.243177:0:6840:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 291295330726ns, next at 292295328505ns, rc = 0 00000100:00100000:1.0:1789049465.243318:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb8df482680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1875954110614272:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789049465.243441:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789049465.243661:0:6706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954110614272 00000100:00100000:0.0:1789049465.243669:0:6706:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954110614272 00000100:00100000:0.0:1789049465.243725:0:6706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1789049465.243733:0:6706:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8f7746680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1875954110614272:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789049465.243761:0:6706:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789049465.243879:0:6706:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8f7746680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1875954110614272:12345-0@lo:13:osp-pre-0-0.0 Request processed in 135us (425us total) trans 0 rc 0/0 00000100:00100000:0.0:1789049465.243891:0:6706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00080000:1.0:1789049465.244494:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1789049465.257874:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cb8df482680 x1875954110614272/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789049481 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789049465.258037:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb8df482680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1875954110614272:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1789049465.563889:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789049466.278681:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb900a1ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:7ef694ec-1ea0-4f02-800c-d1279b4fdf12:3311:1875954110614400:0@lo:400:kworker.0 00000100:00100000:1.0:1789049466.278746:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789049466.278788:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb900a1e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3311:1875954110614912:0@lo:400:kworker.0 00000100:00100000:1.0:1789049466.278811:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789049466.278936:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789049466.278943:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb900a1f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3311:1875954110614784:0@lo:400:kworker.0 00000100:00100000:1.0:1789049466.278978:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789049466.279004:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb900a1df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3308:1875954110614528:0@lo:400:kworker.0 00000100:00100000:1.0:1789049466.279041:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789049466.279057:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb900a1fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1875954110615040:0@lo:400:kworker.0 00000100:00100000:1.0:1789049466.279075:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789049466.279103:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1789049466.279109:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb900a1d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3308:1875954110614656:0@lo:400:kworker.0 00000100:00100000:1.0:1789049466.279128:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789049466.279143:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb900a1c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1875954110615168:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789049466.279161:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789049466.279194:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954110614400 00000100:00100000:1.0:1789049466.279201:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954110614400 00000100:00100000:1.0:1789049466.279598:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 247 00000100:00100000:1.0:1789049466.279608:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8d11e1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7ef694ec-1ea0-4f02-800c-d1279b4fdf12+19:3311:x1875954110614400:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789049466.279657:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8d11e1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7ef694ec-1ea0-4f02-800c-d1279b4fdf12+19:3311:x1875954110614400:12345-0@lo:400:kworker.0 Request processed in 51us (911us total) trans 0 rc 0/0 00000100:00100000:1.0:1789049466.279664:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 247 00000100:00100000:1.0:1789049466.279693:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954110614912 00000100:00100000:1.0:1789049466.279702:0:5851:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954110614912 00000100:00100000:1.0:1789049466.279734:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954110614528 00000100:00100000:1.0:1789049466.279737:0:5851:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954110614528 00000100:00100000:1.0:1789049466.279748:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954110614656 00000100:00100000:1.0:1789049466.279750:0:5851:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954110614656 00000100:00100000:1.0:1789049466.279763:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:1.0:1789049466.279768:0:5851:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb900a1e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1875954110614912:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789049466.279801:0:5851:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb900a1e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1875954110614912:12345-0@lo:400:kworker.0 Request processed in 32us (989us total) trans 0 rc 0/0 00000100:00100000:1.0:1789049466.279806:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:1.0:1789049466.279904:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:1.0:1789049466.279912:0:5851:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb900a1f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1875954110614528:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789049466.279944:0:5851:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb900a1f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1875954110614528:12345-0@lo:400:kworker.0 Request processed in 33us (902us total) trans 0 rc 0/0 00000100:00100000:1.0:1789049466.279949:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:1.0:1789049466.279959:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:1.0:1789049466.279965:0:5851:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb900a1ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1875954110614656:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789049466.280050:0:5851:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb900a1ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1875954110614656:12345-0@lo:400:kworker.0 Request processed in 85us (920us total) trans 0 rc 0/0 00000100:00100000:1.0:1789049466.280056:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:1.0:1789049466.280077:0:6705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954110614784 00000100:00100000:1.0:1789049466.280080:0:6705:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954110614784 00000100:00100000:1.0:1789049466.280114:0:6705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954110615040 00000100:00100000:1.0:1789049466.280118:0:6705:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954110615040 00000100:00100000:1.0:1789049466.280136:0:6705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1789049466.280142:0:6705:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb900a1ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3311:x1875954110614784:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789049466.280170:0:6705:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb900a1ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3311:x1875954110614784:12345-0@lo:400:kworker.0 Request processed in 29us (1201us total) trans 0 rc 0/0 00000100:00100000:1.0:1789049466.280186:0:6705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1789049466.280197:0:6705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1789049466.280203:0:6705:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb900a1dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3308:x1875954110615040:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789049466.280365:0:6705:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb900a1dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3308:x1875954110615040:12345-0@lo:400:kworker.0 Request processed in 161us (1288us total) trans 0 rc 0/0 00000100:00100000:1.0:1789049466.280371:0:6705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1789049466.280511:0:6706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954110615168 00000100:00100000:1.0:1789049466.280515:0:6706:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954110615168 00000100:00100000:1.0:1789049466.280539:0:6706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1789049466.280545:0:6706:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb900a1ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1875954110615168:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789049466.280571:0:6706:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789049466.280599:0:6706:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb900a1ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1875954110615168:12345-0@lo:13:osp-pre-1-0.0 Request processed in 54us (1438us total) trans 0 rc 0/0 00000100:00100000:1.0:1789049466.280605:0:6706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00010000:00080000:1.0:1789049466.280641:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cb900a1f100 x1875954110614784/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789049482 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789049466.280654:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb900a1f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3311:1875954110614784:0@lo:400:kworker.0 00000100:00100000:1.0:1789049466.280665:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb900a1ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:7ef694ec-1ea0-4f02-800c-d1279b4fdf12:3311:1875954110614400:0@lo:400:kworker.0 00000100:00100000:1.0:1789049466.280674:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb900a1e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3311:1875954110614912:0@lo:400:kworker.0 00000100:00080000:1.0:1789049466.280697:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789049466.280702:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789049466.280721:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb900a1d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3308:1875954110614656:0@lo:400:kworker.0 00010000:00080000:1.0:1789049466.280730:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cb900a1c380 x1875954110615168/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789049482 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789049466.280755:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb900a1c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1875954110615168:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789049466.280767:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb900a1df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3308:1875954110614528:0@lo:400:kworker.0 00010000:00080000:1.0:1789049466.280776:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cb900a1fb80 x1875954110615040/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789049482 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789049466.280784:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb900a1fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1875954110615040:0@lo:400:kworker.0 00000001:02000400:0.0:1789049466.466247:0:11635:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: excepting tests: 6 7a 7b 23 35 33 00010000:00010000:0.0:1789049466.587878:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789049467.214256:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.26@tcp (source: 12345-192.168.206.26@tcp) 00000100:00100000:2.0:1789049467.214328:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.26@tcp (source: 12345-192.168.206.26@tcp) 00000100:00100000:2.0:1789049467.214376:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.26@tcp (source: 12345-192.168.206.26@tcp) 00000100:00100000:2.0:1789049467.214402:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.26@tcp (source: 12345-192.168.206.26@tcp) 00000100:00100000:2.0:1789049467.214430:0:6705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954089612416 00000100:00100000:2.0:1789049467.214438:0:6705:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954089612416 00000100:00100000:2.0:1789049467.214495:0:6705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.26@tcp, seq: 47 00000100:00100000:2.0:1789049467.214504:0:6705:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8df483100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e823b53a-3591-475c-8624-c682227e5c13+5:2358:x1875954089612416:12345-192.168.206.26@tcp:400:kworker.0 00000100:00100000:2.0:1789049467.214568:0:6705:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8df483100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e823b53a-3591-475c-8624-c682227e5c13+5:2358:x1875954089612416:12345-192.168.206.26@tcp:400:kworker.0 Request processed in 66us (191us total) trans 0 rc 0/0 00000100:00100000:2.0:1789049467.214574:0:6705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.26@tcp, seq: 47 00000100:00100000:2.0:1789049467.214595:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954089612288 00000100:00100000:2.0:1789049467.214599:0:5852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954089612288 00000100:00100000:2.0:1789049467.214625:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954089612544 00000100:00100000:2.0:1789049467.214628:0:5852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954089612544 00000100:00100000:2.0:1789049467.214664:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.26@tcp, seq: 101 00000100:00100000:2.0:1789049467.214682:0:5852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8df482680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e823b53a-3591-475c-8624-c682227e5c13+14:2357:x1875954089612288:12345-192.168.206.26@tcp:400:kworker.0 00000100:00100000:2.0:1789049467.214752:0:5852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8df482680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e823b53a-3591-475c-8624-c682227e5c13+14:2357:x1875954089612288:12345-192.168.206.26@tcp:400:kworker.0 Request processed in 81us (423us total) trans 0 rc 0/0 00000100:00100000:2.0:1789049467.214759:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.26@tcp, seq: 101 00000100:00100000:2.0:1789049467.214770:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.26@tcp, seq: 102 00000100:00100000:2.0:1789049467.214777:0:5852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8df480000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:59d63492-f1ee-4aa5-bf8c-853a603b0252+5:2357:x1875954089612544:12345-192.168.206.26@tcp:400:kworker.0 00000100:00100000:2.0:1789049467.214801:0:5852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8df480000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:59d63492-f1ee-4aa5-bf8c-853a603b0252+5:2357:x1875954089612544:12345-192.168.206.26@tcp:400:kworker.0 Request processed in 25us (398us total) trans 0 rc 0/0 00000100:00100000:2.0:1789049467.214807:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.26@tcp, seq: 102 00000100:00080000:2.0:1789049467.214838:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789049467.214870:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789049467.219579:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954089612160 00000100:00100000:1.0:1789049467.219593:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954089612160 00000100:00100000:1.0:1789049467.220007:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.26@tcp, seq: 248 00000100:00100000:1.0:1789049467.220018:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8d11e2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:de93d576-ed8d-4d27-ab00-9189a62cea33+13:2358:x1875954089612160:12345-192.168.206.26@tcp:400:kworker.0 00000100:00100000:1.0:1789049467.220548:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8d11e2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:de93d576-ed8d-4d27-ab00-9189a62cea33+13:2358:x1875954089612160:12345-192.168.206.26@tcp:400:kworker.0 Request processed in 528us (6298us total) trans 0 rc 0/0 00000100:00100000:1.0:1789049467.220558:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.26@tcp, seq: 248 00000001:00080000:3.0:1789049467.391247:0:5872:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967307 is committed 00000004:00080000:3.0:1789049467.391264:0:5872:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2 committed 00000004:00080000:3.0:1789049467.391282:0:5872:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 3 committed 00000001:00080000:3.0:1789049467.391288:0:5872:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967308 is committed 00000100:00100000:2.0:1789049467.391747:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb8df482300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1875954110615296:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1789049467.391837:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789049467.391906:0:10560:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954110615296 00000100:00100000:1.0:1789049467.391914:0:10560:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954110615296 00000100:00080000:2.0:1789049467.391961:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789049467.391972:0:10560:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1789049467.391983:0:10560:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8ff3ece00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3310:x1875954110615296:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:1.0:1789049467.392010:0:10560:0:(ofd_dev.c:1868:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:2 count 1 00002000:00010000:1.0:1789049467.392040:0:10560:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x2:0x0] initial LVB size: 0, mtime: 0x18d3fb01a9c4b980, atime: 0x18d3fb01a9c4b980, ctime: 0x18d3fb01a9c4b980, blocks: 0x1 00010000:00010000:1.0:1789049467.392048:0:10560:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000043264bb2/0xf4f48ce5e1bbefa6 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 10560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049467.392063:0:10560:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=293s v=(0 0) 00010000:00010000:1.0:1789049467.392067:0:10560:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789049467.392091:0:10560:0:(ldlm_resource.c:1751:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000043264bb2/0xf4f48ce5e1bbefa6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 10560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049467.392109:0:10560:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000043264bb2/0xf4f48ce5e1bbefa6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 10560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049467.392119:0:10560:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000043264bb2/0xf4f48ce5e1bbefa6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 10560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049467.392127:0:10560:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000043264bb2/0xf4f48ce5e1bbefa6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 10560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049467.392153:0:10560:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1789049467.392712:0:10560:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8ff3ece00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3310:x1875954110615296:12345-0@lo:6:osp-syn-0-0.0 Request processed in 731us (876us total) trans 4294967300 rc 0/0 00000100:00100000:1.0:1789049467.392721:0:10560:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00010000:00010000:2.0:1789049467.392821:0:6719:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789049467.392829:0:6719:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000043264bb2/0xf4f48ce5e1bbefa6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 10560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049467.392839:0:6719:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cb8c146c200 already unused, calling callback (ffffffffc166a8f0) 00010000:00010000:2.0:1789049467.392869:0:6719:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000043264bb2/0xf4f48ce5e1bbefa6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 10560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049467.392879:0:6719:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000043264bb2/0xf4f48ce5e1bbefa6 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 10560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049467.392898:0:6719:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000043264bb2/0xf4f48ce5e1bbefa6 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 10560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049467.392905:0:6719:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000043264bb2/0xf4f48ce5e1bbefa6 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 10560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049467.392923:0:6719:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789049467.392925:0:6719:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789049467.392926:0:6719:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:2.0:1789049467.392958:0:3310:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8cb8df482300/2, rc 0, transno 4294967300 00000100:00100000:2.0:1789049467.392964:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb8df482300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1875954110615296:0@lo:6:osp-syn-0-0.0 00010000:00010000:0.0:1789049467.616934:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1789049467.678594:0:11686:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffdc76474a0 20000000:00000080:3.0:1789049467.678610:0:11686:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff8cb900c1d400 uarg=0000000000000000 20000000:01000000:3.0:1789049467.678647:0:11686:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='lustre' param='mdt.lustre-MDT0000.hsm_control=enabled' 20000000:01000000:3.0:1789049467.678653:0:11686:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'mdt.lustre-MDT0000.hsm_control=enabled' 20000000:01000000:3.0:1789049467.678657:0:11686:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/lustre/mdt.lustre-MDT0000.hsm_control=enabled del=0 00000040:00080000:3.0:1789049467.680237:0:11687:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 20000000:02000000:1.0:1789049467.680831:0:11686:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter lustre.mdt.lustre-MDT0000.hsm_control=enabled in log params 00000040:00080000:2.0:1789049467.687376:0:11686:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9536 00000040:00080000:2.0:1789049467.687443:0:11686:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].8, 128 off9664 00000040:00080000:2.0:1789049467.687499:0:11686:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].9, 224 off9888 10000000:01000000:2.0:1789049467.687515:0:11686:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:2.0:1789049467.687533:0:11686:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8cb8d6715a00/0xf4f48ce5e1bbefad lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049467.687549:0:11686:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8cb8d6714c00/0xf4f48ce5e1bbee4f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf4f48ce5e1bbee48 expref: 18 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049467.687556:0:11686:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8cb8d6715800/0xf4f48ce5e1bbee5d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf4f48ce5e1bbee56 expref: 18 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049467.687562:0:11686:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8cb8d6714a00/0xf4f48ce5e1bbee6b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf4f48ce5e1bbee64 expref: 18 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049467.687571:0:11686:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8cb7c4c39000/0xf4f48ce5e1bbee72 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a3313 expref: 12 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049467.687577:0:11686:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8cb7c4c39a00/0xf4f48ce5e1bbee79 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a331a expref: 12 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049467.687584:0:11686:0:(ldlm_resource.c:1751:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8cb8d6715a00/0xf4f48ce5e1bbefad lrc: 8/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 11686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049467.689410:0:11686:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8cb7c4c39a00/0xf4f48ce5e1bbee79 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a331a expref: 12 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049467.689486:0:11686:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8cb7c4c39a00/0xf4f48ce5e1bbee79 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a331a expref: 12 pid: 5845 timeout: 393 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789049467.689522:0:11686:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb8ff3ec700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11686:1875954110615424:192.168.206.26@tcp:104: 00010000:00010000:2.0:1789049467.689639:0:11686:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8cb7c4c39000/0xf4f48ce5e1bbee72 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a3313 expref: 12 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049467.689649:0:11686:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8cb7c4c39000/0xf4f48ce5e1bbee72 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a3313 expref: 12 pid: 5843 timeout: 393 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789049467.689658:0:11686:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb8ff3ed500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11686:1875954110615552:192.168.206.26@tcp:104: 00010000:00010000:2.0:1789049467.689687:0:11686:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8cb8d6714a00/0xf4f48ce5e1bbee6b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf4f48ce5e1bbee64 expref: 18 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049467.689695:0:11686:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8cb8d6714a00/0xf4f48ce5e1bbee6b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf4f48ce5e1bbee64 expref: 18 pid: 5845 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789049467.689703:0:11686:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb8ff3ed180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11686:1875954110615680:0@lo:104: 00000100:00100000:2.0:1789049467.689737:0:11686:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1789049467.689989:0:11686:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8cb8d6715800/0xf4f48ce5e1bbee5d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf4f48ce5e1bbee56 expref: 18 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049467.689997:0:11686:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8cb8d6715800/0xf4f48ce5e1bbee5d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf4f48ce5e1bbee56 expref: 18 pid: 5845 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789049467.690005:0:11686:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb8ff3ec000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11686:1875954110615808:0@lo:104: 00000100:00100000:2.0:1789049467.690027:0:11686:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789049467.692282:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954110615680 00000100:00100000:0.0:1789049467.692282:0:6718:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954110615808 00000100:00100000:3.0:1789049467.692293:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954110615680 00000100:00100000:0.0:1789049467.692293:0:6718:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954110615808 00000100:00100000:0.0:1789049467.692352:0:6718:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1789049467.692416:0:6718:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8ff3eed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:7ef694ec-1ea0-4f02-800c-d1279b4fdf12+4:11686:x1875954110615808:12345-0@lo:104: 00010000:00010000:0.0:1789049467.692440:0:6718:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.126@tcp lock: ffff8cb8c6b34200/0xf4f48ce5e1bbee56 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xf4f48ce5e1bbee5d expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789049467.692451:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1789049467.692459:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8ff3ef800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:7ef694ec-1ea0-4f02-800c-d1279b4fdf12+4:11686:x1875954110615680:12345-0@lo:104: 00010000:00010000:3.0:1789049467.692467:0:5834:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.126@tcp lock: ffff8cb8c6b35c00/0xf4f48ce5e1bbee64 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xf4f48ce5e1bbee6b expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049467.692534:0:5834:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1789049467.692540:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8ff3ef800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:7ef694ec-1ea0-4f02-800c-d1279b4fdf12+4:11686:x1875954110615680:12345-0@lo:104: Request processed in 83us (2803us total) trans 0 rc 0/0 00000100:00100000:3.0:1789049467.692547:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00010000:00010000:2.0:1789049467.692608:0:11686:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8cb8d6714c00/0xf4f48ce5e1bbee4f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf4f48ce5e1bbee48 expref: 18 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049467.692620:0:11686:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8cb8d6714c00/0xf4f48ce5e1bbee4f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf4f48ce5e1bbee48 expref: 18 pid: 5845 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789049467.692644:0:11686:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb8ff3edf80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11686:1875954110615936:0@lo:104: 00000100:00100000:2.0:1789049467.692677:0:11686:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789049467.692699:0:11686:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cb7c5d58480 going to sleep for 11 seconds 00000100:00100000:2.0:1789049467.692714:0:11686:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb8ff3ed180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11686:1875954110615680:0@lo:104: 00000100:00100000:3.0:1789049467.692783:0:5834:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:3.0:1789049467.692795:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954110615936 00000100:00100000:3.0:1789049467.692799:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954110615936 00000100:00100000:3.0:1789049467.692822:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1789049467.692828:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8df432c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:7ef694ec-1ea0-4f02-800c-d1279b4fdf12+4:11686:x1875954110615936:12345-0@lo:104: 00010000:00010000:3.0:1789049467.692835:0:5834:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.126@tcp lock: ffff8cb8c146d200/0xf4f48ce5e1bbee48 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xf4f48ce5e1bbee4f expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049467.692895:0:5834:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1789049467.692900:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8df432c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:7ef694ec-1ea0-4f02-800c-d1279b4fdf12+4:11686:x1875954110615936:12345-0@lo:104: Request processed in 73us (223us total) trans 0 rc 0/0 00000100:00100000:3.0:1789049467.692905:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00010000:00010000:2.0:1789049467.692957:0:6719:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1789049467.692962:0:6719:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.126@tcp lock: ffff8cb8c6b35c00/0xf4f48ce5e1bbee64 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xf4f48ce5e1bbee6b expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049467.692969:0:6719:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cb8c6b35c00 already unused, calling callback (ffffffffc1ca3c20) 10000000:00010000:2.0:1789049467.692973:0:6719:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.126@tcp lock: ffff8cb8c6b35c00/0xf4f48ce5e1bbee64 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xf4f48ce5e1bbee6b expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049467.692981:0:6719:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.126@tcp lock: ffff8cb8c6b35c00/0xf4f48ce5e1bbee64 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xf4f48ce5e1bbee6b expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789049467.692988:0:6719:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.126@tcp lock: ffff8cb8c6b35c00/0xf4f48ce5e1bbee64 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xf4f48ce5e1bbee6b expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789049467.692993:0:6719:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1789049467.693023:0:6719:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.126@tcp lock: ffff8cb8c6b35c00/0xf4f48ce5e1bbee64 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf4f48ce5e1bbee6b expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049467.693029:0:6719:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:3.0:1789049467.693355:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb8ff3ed880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:7ef694ec-1ea0-4f02-800c-d1279b4fdf12:3311:1875954110616064:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789049467.693383:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1789049467.693439:0:6719:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.126@tcp lock: ffff8cb8c6b35c00/0xf4f48ce5e1bbee64 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf4f48ce5e1bbee6b expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049467.693447:0:6719:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.126@tcp lock: ffff8cb8c6b35c00/0xf4f48ce5e1bbee64 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf4f48ce5e1bbee6b expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049467.693469:0:6719:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789049467.693472:0:6719:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.126@tcp lock: ffff8cb8c146d200/0xf4f48ce5e1bbee48 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xf4f48ce5e1bbee4f expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049467.693477:0:6719:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cb8c146d200 already unused, calling callback (ffffffffc1ca3c20) 10000000:00010000:2.0:1789049467.693480:0:6719:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.126@tcp lock: ffff8cb8c146d200/0xf4f48ce5e1bbee48 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xf4f48ce5e1bbee4f expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049467.693488:0:6719:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.126@tcp lock: ffff8cb8c146d200/0xf4f48ce5e1bbee48 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xf4f48ce5e1bbee4f expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789049467.693494:0:6719:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.126@tcp lock: ffff8cb8c146d200/0xf4f48ce5e1bbee48 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xf4f48ce5e1bbee4f expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789049467.693499:0:6719:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1789049467.693518:0:6719:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.126@tcp lock: ffff8cb8c146d200/0xf4f48ce5e1bbee48 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf4f48ce5e1bbee4f expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049467.693524:0:6719:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789049467.693552:0:6719:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.126@tcp lock: ffff8cb8c146d200/0xf4f48ce5e1bbee48 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf4f48ce5e1bbee4f expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049467.693560:0:6719:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.126@tcp lock: ffff8cb8c146d200/0xf4f48ce5e1bbee48 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf4f48ce5e1bbee4f expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049467.693569:0:6719:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789049467.693571:0:6719:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789049467.693572:0:6719:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789049467.693581:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1789049467.693595:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb8ff3ef100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:7ef694ec-1ea0-4f02-800c-d1279b4fdf12:3309:1875954110616192:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789049467.693616:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789049467.693652:0:11686:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb8ff3ec700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11686:1875954110615424:192.168.206.26@tcp:104: 00000100:00100000:2.0:1789049467.693659:0:11686:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb8ff3ed500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11686:1875954110615552:192.168.206.26@tcp:104: 00000100:00100000:2.0:1789049467.693666:0:11686:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb8ff3edf80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11686:1875954110615936:0@lo:104: 00000100:00100000:2.0:1789049467.693689:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954110616064 00000100:00100000:2.0:1789049467.693692:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954110616064 00010000:00010000:2.0:1789049467.693711:0:5837:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8cb8d6714a00/0xf4f48ce5e1bbee6b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf4f48ce5e1bbee64 expref: 19 pid: 5845 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789049467.693727:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954110616192 00000100:00100000:2.0:1789049467.693729:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954110616192 00010000:00010000:2.0:1789049467.693737:0:5837:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8cb8d6714c00/0xf4f48ce5e1bbee4f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf4f48ce5e1bbee48 expref: 20 pid: 5845 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789049467.693750:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1789049467.693755:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8f73c5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7ef694ec-1ea0-4f02-800c-d1279b4fdf12+20:3311:x1875954110616064:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789049467.693763:0:5837:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789049467.693767:0:5837:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8cb8d6714a00/0xf4f48ce5e1bbee6b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf4f48ce5e1bbee64 expref: 20 pid: 5845 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049467.693776:0:5837:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8cb8d6714a00/0xf4f48ce5e1bbee6b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf4f48ce5e1bbee64 expref: 20 pid: 5845 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049467.693788:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cb8d6714a00/0xf4f48ce5e1bbee6b lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf4f48ce5e1bbee64 expref: 20 pid: 5845 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049467.693798:0:5837:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789049467.693879:0:6718:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1789049467.693888:0:6718:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8ff3eed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:7ef694ec-1ea0-4f02-800c-d1279b4fdf12+3:11686:x1875954110615808:12345-0@lo:104: Request processed in 1473us (3859us total) trans 0 rc 0/0 00000100:00100000:0.0:1789049467.693895:0:6718:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00010000:00010000:0.0:1789049467.694054:0:5839:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789049467.694063:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.126@tcp lock: ffff8cb8c6b34200/0xf4f48ce5e1bbee56 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xf4f48ce5e1bbee5d expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049467.694070:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cb8c6b34200 already unused, calling callback (ffffffffc1ca3c20) 10000000:00010000:0.0:1789049467.694073:0:5839:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.126@tcp lock: ffff8cb8c6b34200/0xf4f48ce5e1bbee56 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xf4f48ce5e1bbee5d expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049467.694089:0:5839:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.126@tcp lock: ffff8cb8c6b34200/0xf4f48ce5e1bbee56 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xf4f48ce5e1bbee5d expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789049467.694096:0:5839:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.126@tcp lock: ffff8cb8c6b34200/0xf4f48ce5e1bbee56 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xf4f48ce5e1bbee5d expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789049467.694101:0:5839:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1789049467.694123:0:5839:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.126@tcp lock: ffff8cb8c6b34200/0xf4f48ce5e1bbee56 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf4f48ce5e1bbee5d expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049467.694129:0:5839:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789049467.694141:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.126@tcp lock: ffff8cb8c6b34200/0xf4f48ce5e1bbee56 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf4f48ce5e1bbee5d expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049467.694147:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.126@tcp lock: ffff8cb8c6b34200/0xf4f48ce5e1bbee56 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf4f48ce5e1bbee5d expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049467.694158:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789049467.694159:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789049467.694161:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789049467.694172:0:6720:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1789049467.694178:0:6720:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8ff3ee680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7ef694ec-1ea0-4f02-800c-d1279b4fdf12+19:3309:x1875954110616192:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789049467.694185:0:6720:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789049467.694194:0:6720:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8cb8d6714c00/0xf4f48ce5e1bbee4f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf4f48ce5e1bbee48 expref: 19 pid: 5845 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049467.694202:0:6720:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8cb8d6714c00/0xf4f48ce5e1bbee4f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf4f48ce5e1bbee48 expref: 19 pid: 5845 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049467.694265:0:6720:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cb8d6714c00/0xf4f48ce5e1bbee4f lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf4f48ce5e1bbee48 expref: 19 pid: 5845 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049467.694276:0:6720:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789049467.694305:0:6720:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8ff3ee680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7ef694ec-1ea0-4f02-800c-d1279b4fdf12+18:3309:x1875954110616192:12345-0@lo:103:ldlm_bl.0 Request processed in 124us (685us total) trans 0 rc 0/0 00000100:00100000:0.0:1789049467.694311:0:6720:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00010000:00010000:0.0:1789049467.694333:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789049467.694338:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789049467.694348:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb900a5b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7ef694ec-1ea0-4f02-800c-d1279b4fdf12:3308:1875954110616320:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789049467.694376:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789049467.694419:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb8ff3ef100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:7ef694ec-1ea0-4f02-800c-d1279b4fdf12:3309:1875954110616192:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789049467.694573:0:6720:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954110616320 00000100:00100000:1.0:1789049467.694582:0:6720:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954110616320 00010000:00010000:1.0:1789049467.694604:0:6720:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8cb8d6715800/0xf4f48ce5e1bbee5d lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf4f48ce5e1bbee56 expref: 18 pid: 5845 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789049467.694637:0:6720:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1789049467.694643:0:6720:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8c7dee050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7ef694ec-1ea0-4f02-800c-d1279b4fdf12+18:3308:x1875954110616320:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789049467.694651:0:6720:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789049467.694659:0:6720:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8cb8d6715800/0xf4f48ce5e1bbee5d lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf4f48ce5e1bbee56 expref: 18 pid: 5845 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049467.694681:0:6720:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8cb8d6715800/0xf4f48ce5e1bbee5d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf4f48ce5e1bbee56 expref: 18 pid: 5845 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049467.694691:0:6720:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789049467.694725:0:6720:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8c7dee050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7ef694ec-1ea0-4f02-800c-d1279b4fdf12+18:3308:x1875954110616320:12345-0@lo:103:ldlm_bl.0 Request processed in 80us (345us total) trans 0 rc 0/0 00000100:00100000:1.0:1789049467.694732:0:6720:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1789049467.694860:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb900a5b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7ef694ec-1ea0-4f02-800c-d1279b4fdf12:3308:1875954110616320:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789049467.695242:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb8ff3ed880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:7ef694ec-1ea0-4f02-800c-d1279b4fdf12:3311:1875954110616064:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789049467.695278:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8f73c5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7ef694ec-1ea0-4f02-800c-d1279b4fdf12+17:3311:x1875954110616064:12345-0@lo:103:ldlm_bl.0 Request processed in 1521us (1893us total) trans 0 rc 0/0 00000100:00100000:2.0:1789049467.695291:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00010000:00010000:2.0:1789049467.695346:0:11686:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cb8d6715800/0xf4f48ce5e1bbee5d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf4f48ce5e1bbee56 expref: 16 pid: 5845 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789049467.695356:0:11686:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb8ff3ec000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11686:1875954110615808:0@lo:104: 00010000:00010000:2.0:1789049467.695377:0:11686:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8cb8d6715a00/0xf4f48ce5e1bbefad lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 11686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789049467.702206:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.26@tcp (source: 12345-192.168.206.26@tcp) 00000100:00100000:0.0:1789049467.702237:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.26@tcp (source: 12345-192.168.206.26@tcp) 00000100:00100000:2.0:1789049467.702309:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954089612672 00000100:00100000:2.0:1789049467.702319:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954089612672 00010000:00010000:2.0:1789049467.702355:0:5835:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8cb7c4c39a00/0xf4f48ce5e1bbee79 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a331a expref: 13 pid: 5845 timeout: 393 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789049467.702393:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954089612800 00000100:00100000:2.0:1789049467.702396:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954089612800 00010000:00010000:2.0:1789049467.702408:0:5835:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8cb7c4c39000/0xf4f48ce5e1bbee72 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a3313 expref: 14 pid: 5843 timeout: 393 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789049467.702442:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.26@tcp, seq: 33 00000100:00100000:2.0:1789049467.702451:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb900a5b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:de93d576-ed8d-4d27-ab00-9189a62cea33+14:2358:x1875954089612672:12345-192.168.206.26@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789049467.702464:0:5835:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789049467.702470:0:5835:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8cb7c4c39a00/0xf4f48ce5e1bbee79 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a331a expref: 14 pid: 5845 timeout: 393 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049467.702482:0:5835:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8cb7c4c39a00/0xf4f48ce5e1bbee79 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a331a expref: 14 pid: 5845 timeout: 393 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049467.702498:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cb7c4c39a00/0xf4f48ce5e1bbee79 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a331a expref: 14 pid: 5845 timeout: 393 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049467.702529:0:5835:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789049467.702590:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb900a5b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:de93d576-ed8d-4d27-ab00-9189a62cea33+13:2358:x1875954089612672:12345-192.168.206.26@tcp:103:ldlm_bl.0 Request processed in 140us (392us total) trans 0 rc 0/0 00000100:00100000:2.0:1789049467.702598:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.26@tcp, seq: 33 00000100:00100000:2.0:1789049467.702615:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.26@tcp, seq: 34 00000100:00100000:2.0:1789049467.702620:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb900a59c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:de93d576-ed8d-4d27-ab00-9189a62cea33+12:2358:x1875954089612800:12345-192.168.206.26@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789049467.702628:0:5835:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789049467.702632:0:5835:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8cb7c4c39000/0xf4f48ce5e1bbee72 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a3313 expref: 12 pid: 5843 timeout: 393 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049467.702641:0:5835:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8cb7c4c39000/0xf4f48ce5e1bbee72 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a3313 expref: 12 pid: 5843 timeout: 393 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049467.702655:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cb7c4c39000/0xf4f48ce5e1bbee72 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a3313 expref: 12 pid: 5843 timeout: 393 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049467.702666:0:5835:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8cb8d6715a00/0xf4f48ce5e1bbefad lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 11686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049467.702673:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cb8d6715a00/0xf4f48ce5e1bbefad lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 11686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049467.702693:0:5835:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8cb8d6715a00/0xf4f48ce5e1bbefad lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 11686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049467.702699:0:5835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8cb8d6715a00/0xf4f48ce5e1bbefad lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049467.702714:0:5835:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8cb8d6715a00/0xf4f48ce5e1bbefad lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049467.702720:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8cb8d6715a00/0xf4f48ce5e1bbefad lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049467.702726:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cb8d6715a00 already unused, calling callback (ffffffffc166a8f0) 00010000:00010000:2.0:1789049467.702729:0:5835:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8cb8d6715a00/0xf4f48ce5e1bbefad lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049467.702737:0:5835:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8cb8d6715a00/0xf4f48ce5e1bbefad lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 11686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049467.702751:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8cb8d6715a00/0xf4f48ce5e1bbefad lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049467.702760:0:5835:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789049467.702782:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb900a59c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:de93d576-ed8d-4d27-ab00-9189a62cea33+11:2358:x1875954089612800:12345-192.168.206.26@tcp:103:ldlm_bl.0 Request processed in 160us (544us total) trans 0 rc 0/0 00000100:00100000:2.0:1789049467.702787:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.26@tcp, seq: 34 00010000:00010000:2.0:1789049467.702929:0:11686:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8cb8d6715a00/0xf4f48ce5e1bbefad lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049467.702938:0:11686:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8cb8d6715a00/0xf4f48ce5e1bbefad lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049467.702944:0:11686:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cb8d6715a00/0xf4f48ce5e1bbefad lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789049467.844959:0:6731:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967300 is committed 00010000:00010000:2.0:1789049468.635902:0:6719:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789049469.315596:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.26@tcp (source: 12345-192.168.206.26@tcp) 00000100:00100000:3.0:1789049469.315687:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954089612928 00000100:00100000:3.0:1789049469.315697:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954089612928 00000100:00100000:3.0:1789049469.315753:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.26@tcp, seq: 249 00000100:00100000:3.0:1789049469.315763:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8d11e0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:de93d576-ed8d-4d27-ab00-9189a62cea33+11:5598:x1875954089612928:12345-192.168.206.26@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789049469.315794:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789049469.315812:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cb8c6b35600/0xf4f48ce5e1bbefb4 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x7fc5e358805a3367 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049469.315838:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cb8c6b35600/0xf4f48ce5e1bbefb4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a3367 expref: 12 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049469.316478:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cb8c6b35600/0xf4f48ce5e1bbefb4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a3367 expref: 12 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049469.316489:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cb8c6b35600, rc 0) 00000100:00100000:3.0:1789049469.316566:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8d11e0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:de93d576-ed8d-4d27-ab00-9189a62cea33+12:5598:x1875954089612928:12345-192.168.206.26@tcp:101:ll_cfg_requeue.0 Request processed in 804us (979us total) trans 0 rc 0/0 00000100:00100000:3.0:1789049469.316575:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.26@tcp, seq: 249 00000100:00100000:2.0:1789049469.324522:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.26@tcp (source: 12345-192.168.206.26@tcp) 00000100:00100000:1.0:1789049469.324765:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954089613056 00000100:00100000:1.0:1789049469.324774:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954089613056 00000100:00100000:1.0:1789049469.324837:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.26@tcp, seq: 250 00000100:00100000:1.0:1789049469.324871:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8d11e1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:de93d576-ed8d-4d27-ab00-9189a62cea33+12:5598:x1875954089613056:12345-192.168.206.26@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789049469.325162:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8d11e1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:de93d576-ed8d-4d27-ab00-9189a62cea33+12:5598:x1875954089613056:12345-192.168.206.26@tcp:501:ll_cfg_requeue.0 Request processed in 292us (647us total) trans 0 rc 0/0 00000100:00100000:1.0:1789049469.325169:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.26@tcp, seq: 250 00000100:00100000:0.0:1789049469.334280:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.26@tcp (source: 12345-192.168.206.26@tcp) 00000100:00100000:1.0:1789049469.334572:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954089613184 00000100:00100000:1.0:1789049469.334581:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954089613184 00000100:00100000:1.0:1789049469.334640:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.26@tcp, seq: 251 00000100:00100000:1.0:1789049469.334650:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8d11e2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:de93d576-ed8d-4d27-ab00-9189a62cea33+12:5598:x1875954089613184:12345-192.168.206.26@tcp:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789049469.334901:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8d11e2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:de93d576-ed8d-4d27-ab00-9189a62cea33+12:5598:x1875954089613184:12345-192.168.206.26@tcp:503:ll_cfg_requeue.0 Request processed in 252us (640us total) trans 0 rc 0/0 00000100:00100000:1.0:1789049469.334910:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.26@tcp, seq: 251 00000100:00100000:2.0:1789049469.340120:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.26@tcp (source: 12345-192.168.206.26@tcp) 00000100:00100000:1.0:1789049469.340481:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954089613312 00000100:00100000:1.0:1789049469.340490:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954089613312 00000100:00100000:1.0:1789049469.340554:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.26@tcp, seq: 252 00000100:00100000:1.0:1789049469.340563:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8d11e2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:de93d576-ed8d-4d27-ab00-9189a62cea33+12:9950:x1875954089613312:12345-192.168.206.26@tcp:502:llog_process_th.0 00000100:00100000:1.0:1789049469.340810:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8d11e2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:de93d576-ed8d-4d27-ab00-9189a62cea33+12:9950:x1875954089613312:12345-192.168.206.26@tcp:502:llog_process_th.0 Request processed in 247us (699us total) trans 0 rc 0/0 00000100:00100000:1.0:1789049469.340818:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.26@tcp, seq: 252 10000000:01000000:3.0:1789049469.340975:0:5848:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1789049469.340979:0:5848:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8cb8c631b800 from 7 10000000:01000000:3.0:1789049469.340982:0:5848:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1789049469.341017:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.126@tcp lock: ffff8cb8c6b34a00/0xf4f48ce5e1bbefbb lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049469.341038:0:5848:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.126@tcp lock: ffff8cb8c6b34a00/0xf4f48ce5e1bbefbb lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049469.341049:0:5848:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.126@tcp lock: ffff8cb8c6b34a00/0xf4f48ce5e1bbefbb lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789049469.341080:0:5848:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb8f73c4700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7ef694ec-1ea0-4f02-800c-d1279b4fdf12:5848:1875954110616448:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1789049469.341123:0:5848:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789049469.341180:0:5848:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cb8c7c97840 going to sleep for 11 seconds 00000100:00100000:1.0:1789049469.341502:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954110616448 00000100:00100000:1.0:1789049469.341508:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954110616448 00000100:00100000:1.0:1789049469.341554:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 253 00000100:00100000:1.0:1789049469.341563:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8d11e3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7ef694ec-1ea0-4f02-800c-d1279b4fdf12+16:5848:x1875954110616448:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789049469.341572:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789049469.341585:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cb8c146dc00/0xf4f48ce5e1bbefc2 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xf4f48ce5e1bbefbb expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049469.341605:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cb8c146dc00/0xf4f48ce5e1bbefc2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf4f48ce5e1bbefbb expref: 17 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049469.341616:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cb8c146dc00/0xf4f48ce5e1bbefc2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf4f48ce5e1bbefbb expref: 17 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049469.341625:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cb8c146dc00, rc 0) 00000100:00100000:1.0:1789049469.341666:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8d11e3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7ef694ec-1ea0-4f02-800c-d1279b4fdf12+17:5848:x1875954110616448:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 105us (543us total) trans 0 rc 0/0 00000100:00100000:1.0:1789049469.341672:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 253 00000100:00100000:3.0:1789049469.341729:0:5848:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb8f73c4700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7ef694ec-1ea0-4f02-800c-d1279b4fdf12:5848:1875954110616448:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789049469.341743:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.126@tcp lock: ffff8cb8c6b34a00/0xf4f48ce5e1bbefbb lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf4f48ce5e1bbefc2 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049469.341752:0:5848:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.126@tcp lock: ffff8cb8c6b34a00/0xf4f48ce5e1bbefbb lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xf4f48ce5e1bbefc2 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789049469.341818:0:5848:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb8f73c4700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7ef694ec-1ea0-4f02-800c-d1279b4fdf12:5848:1875954110616576:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789049469.341866:0:5848:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789049469.341898:0:5848:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cb8c7c97840 going to sleep for 11 seconds 00000100:00100000:2.0:1789049469.341951:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954110616576 00000100:00100000:2.0:1789049469.341956:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954110616576 00000100:00100000:2.0:1789049469.341986:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 254 00000100:00100000:2.0:1789049469.341992:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8d11e0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7ef694ec-1ea0-4f02-800c-d1279b4fdf12+17:5848:x1875954110616576:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789049469.342229:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8d11e0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7ef694ec-1ea0-4f02-800c-d1279b4fdf12+17:5848:x1875954110616576:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 236us (361us total) trans 0 rc 0/0 00000100:00100000:2.0:1789049469.342236:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 254 00000100:00100000:3.0:1789049469.342581:0:5848:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb8f73c4700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7ef694ec-1ea0-4f02-800c-d1279b4fdf12:5848:1875954110616576:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789049469.342623:0:5848:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb8f73c4700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7ef694ec-1ea0-4f02-800c-d1279b4fdf12:5848:1875954110616704:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789049469.342660:0:5848:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789049469.342686:0:5848:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cb8c7c97840 going to sleep for 11 seconds 00000100:00100000:2.0:1789049469.342805:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954110616704 00000100:00100000:2.0:1789049469.342811:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954110616704 00000100:00100000:2.0:1789049469.342867:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 255 00000100:00100000:2.0:1789049469.342885:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8d11e0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7ef694ec-1ea0-4f02-800c-d1279b4fdf12+17:5848:x1875954110616704:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789049469.343039:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8d11e0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7ef694ec-1ea0-4f02-800c-d1279b4fdf12+17:5848:x1875954110616704:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 165us (378us total) trans 0 rc 0/0 00000100:00100000:2.0:1789049469.343047:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 255 00000100:00100000:0.0:1789049469.343535:0:5848:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb8f73c4700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7ef694ec-1ea0-4f02-800c-d1279b4fdf12:5848:1875954110616704:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789049469.344352:0:11700:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb8f73c4700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7ef694ec-1ea0-4f02-800c-d1279b4fdf12:11700:1875954110616832:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789049469.344414:0:11700:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789049469.344506:0:11700:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cb8c7c976c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789049469.348307:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954110616832 00000100:00100000:1.0:1789049469.348322:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954110616832 00000100:00100000:1.0:1789049469.348454:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 256 00000100:00100000:1.0:1789049469.348465:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8c6b82050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7ef694ec-1ea0-4f02-800c-d1279b4fdf12+17:11700:x1875954110616832:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789049469.348728:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8c6b82050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7ef694ec-1ea0-4f02-800c-d1279b4fdf12+17:11700:x1875954110616832:12345-0@lo:502:llog_process_th.0 Request processed in 264us (4313us total) trans 0 rc 0/0 00000100:00100000:1.0:1789049469.348746:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 256 00000100:00100000:0.0:1789049469.348871:0:11700:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb8f73c4700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7ef694ec-1ea0-4f02-800c-d1279b4fdf12:11700:1875954110616832:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1789049469.349425:0:11700:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789049469.349435:0:11700:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789049469.349438:0:11700:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1789049469.349452:0:11700:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8cb8c631b800 00000020:00000080:0.0:1789049469.349455:0:11700:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:0.0:1789049469.349561:0:11700:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb900a58a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7ef694ec-1ea0-4f02-800c-d1279b4fdf12:11700:1875954110616960:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789049469.349610:0:11700:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789049469.353858:0:11700:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cb8c79e03c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789049469.354791:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.26@tcp (source: 12345-192.168.206.26@tcp) 00000100:00100000:3.0:1789049469.356282:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954110616960 00000100:00100000:3.0:1789049469.356295:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954110616960 00000100:00100000:3.0:1789049469.356348:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 257 00000100:00100000:3.0:1789049469.356359:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8c6b83050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7ef694ec-1ea0-4f02-800c-d1279b4fdf12+17:11700:x1875954110616960:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789049469.359682:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8c6b83050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7ef694ec-1ea0-4f02-800c-d1279b4fdf12+17:11700:x1875954110616960:12345-0@lo:502:llog_process_th.0 Request processed in 3317us (10063us total) trans 0 rc 0/0 00000100:00100000:3.0:1789049469.359694:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 257 00000100:00100000:3.0:1789049469.359790:0:11700:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb900a58a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7ef694ec-1ea0-4f02-800c-d1279b4fdf12:11700:1875954110616960:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1789049469.360488:0:11700:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789049469.360499:0:11700:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789049469.360501:0:11700:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:3.0:1789049469.360506:0:11700:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:3.0:1789049469.360737:0:5848:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-9 (rc=0) 10000000:01000000:3.0:1789049469.360756:0:5848:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.126@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1789049469.360766:0:5848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.126@tcp lock: ffff8cb8c6b34a00/0xf4f48ce5e1bbefbb lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf4f48ce5e1bbefc2 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049469.360777:0:5848:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.126@tcp lock: ffff8cb8c6b34a00/0xf4f48ce5e1bbefbb lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf4f48ce5e1bbefc2 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789049469.360787:0:5848:0:(mgc_request.c:611:do_requeue()) updating log params 00000100:00100000:1.0:1789049469.361348:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954089613440 00000100:00100000:1.0:1789049469.361357:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954089613440 00000100:00100000:1.0:1789049469.361406:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.26@tcp, seq: 258 00000100:00100000:1.0:1789049469.361620:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8c6b80050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:de93d576-ed8d-4d27-ab00-9189a62cea33+12:9950:x1875954089613440:12345-192.168.206.26@tcp:502:llog_process_th.0 10000000:01000000:3.0:1789049469.361970:0:5848:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8cb8d1c83000 from 7 10000000:01000000:3.0:1789049469.361975:0:5848:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1789049469.362007:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.126@tcp lock: ffff8cb8c6b35000/0xf4f48ce5e1bbefc9 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049469.362302:0:5848:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.126@tcp lock: ffff8cb8c6b35000/0xf4f48ce5e1bbefc9 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049469.362312:0:5848:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.126@tcp lock: ffff8cb8c6b35000/0xf4f48ce5e1bbefc9 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789049469.369578:0:5848:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb8f73c5f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7ef694ec-1ea0-4f02-800c-d1279b4fdf12:5848:1875954110617088:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1789049469.369651:0:5848:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789049469.369701:0:5848:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cb8c79e0840 going to sleep for 11 seconds 00000100:00100000:3.0:1789049469.370241:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954110617088 00000100:00100000:3.0:1789049469.370252:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954110617088 00000100:00100000:3.0:1789049469.370315:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 259 00000100:00100000:3.0:1789049469.370324:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8c6b80c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7ef694ec-1ea0-4f02-800c-d1279b4fdf12+17:5848:x1875954110617088:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789049469.370339:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789049469.370366:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cb8c6b34400/0xf4f48ce5e1bbefd0 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xf4f48ce5e1bbefc9 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049469.370393:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cb8c6b34400/0xf4f48ce5e1bbefd0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf4f48ce5e1bbefc9 expref: 18 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049469.370404:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cb8c6b34400/0xf4f48ce5e1bbefd0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf4f48ce5e1bbefc9 expref: 18 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049469.370413:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cb8c6b34400, rc 0) 00000100:00100000:3.0:1789049469.370460:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8c6b80c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7ef694ec-1ea0-4f02-800c-d1279b4fdf12+18:5848:x1875954110617088:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 137us (809us total) trans 0 rc 0/0 00000100:00100000:3.0:1789049469.370466:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 259 00000100:00100000:3.0:1789049469.370512:0:5848:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb8f73c5f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7ef694ec-1ea0-4f02-800c-d1279b4fdf12:5848:1875954110617088:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789049469.370536:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.126@tcp lock: ffff8cb8c6b35000/0xf4f48ce5e1bbefc9 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf4f48ce5e1bbefd0 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049469.370546:0:5848:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.126@tcp lock: ffff8cb8c6b35000/0xf4f48ce5e1bbefc9 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xf4f48ce5e1bbefd0 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789049469.370605:0:5848:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb8f73c5f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7ef694ec-1ea0-4f02-800c-d1279b4fdf12:5848:1875954110617216:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789049469.370633:0:5848:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789049469.370647:0:5848:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cb8c7c97f00 going to sleep for 11 seconds 00000100:00100000:3.0:1789049469.370660:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954110617216 00000100:00100000:3.0:1789049469.370663:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954110617216 00000100:00100000:3.0:1789049469.370683:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 260 00000100:00100000:3.0:1789049469.370689:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8c6b82450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7ef694ec-1ea0-4f02-800c-d1279b4fdf12+18:5848:x1875954110617216:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789049469.370942:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8c6b82450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7ef694ec-1ea0-4f02-800c-d1279b4fdf12+18:5848:x1875954110617216:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 252us (308us total) trans 0 rc 0/0 00000100:00100000:3.0:1789049469.370950:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 260 00000100:00100000:3.0:1789049469.370988:0:5848:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb8f73c5f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7ef694ec-1ea0-4f02-800c-d1279b4fdf12:5848:1875954110617216:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789049469.372462:0:5848:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb8f73c5f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7ef694ec-1ea0-4f02-800c-d1279b4fdf12:5848:1875954110617344:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789049469.372524:0:5848:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789049469.372568:0:5848:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cb8c7c97f00 going to sleep for 11 seconds 00000100:00100000:0.0:1789049469.372631:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954110617344 00000100:00100000:0.0:1789049469.372638:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954110617344 00000100:00100000:0.0:1789049469.372681:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 261 00000100:00100000:0.0:1789049469.372689:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8c624b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7ef694ec-1ea0-4f02-800c-d1279b4fdf12+18:5848:x1875954110617344:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789049469.372886:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8c624b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7ef694ec-1ea0-4f02-800c-d1279b4fdf12+18:5848:x1875954110617344:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 197us (361us total) trans 0 rc 0/0 00000100:00100000:0.0:1789049469.372894:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 261 00000100:00100000:3.0:1789049469.373116:0:5848:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb8f73c5f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7ef694ec-1ea0-4f02-800c-d1279b4fdf12:5848:1875954110617344:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789049469.374748:0:11703:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb8f73c5f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7ef694ec-1ea0-4f02-800c-d1279b4fdf12:11703:1875954110617472:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789049469.375017:0:11703:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789049469.376168:0:11703:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cb8c7c97cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1789049469.377011:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8c6b80050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:de93d576-ed8d-4d27-ab00-9189a62cea33+12:9950:x1875954089613440:12345-192.168.206.26@tcp:502:llog_process_th.0 Request processed in 15588us (22218us total) trans 0 rc 0/0 00000100:00100000:1.0:1789049469.377024:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.26@tcp, seq: 258 00000100:00100000:1.0:1789049469.377056:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954110617472 00000100:00100000:1.0:1789049469.377062:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954110617472 00000040:00080000:2.0:1789049469.377379:0:11704:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:0.0:1789049469.380344:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 262 00000100:00100000:0.0:1789049469.380365:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8c6248050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7ef694ec-1ea0-4f02-800c-d1279b4fdf12+18:11703:x1875954110617472:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789049469.380753:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8c6248050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7ef694ec-1ea0-4f02-800c-d1279b4fdf12+18:11703:x1875954110617472:12345-0@lo:502:llog_process_th.0 Request processed in 396us (5735us total) trans 0 rc 0/0 00000100:00100000:0.0:1789049469.380761:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 262 00000100:00100000:3.0:1789049469.381014:0:11703:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb8f73c5f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7ef694ec-1ea0-4f02-800c-d1279b4fdf12:11703:1875954110617472:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1789049469.381056:0:11703:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789049469.381065:0:11703:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789049469.381067:0:11703:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1789049469.381084:0:11703:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8cb8d1c83000 00000020:00000080:3.0:1789049469.381086:0:11703:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1789049469.381174:0:11703:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb8f73c5f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7ef694ec-1ea0-4f02-800c-d1279b4fdf12:11703:1875954110617600:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789049469.381219:0:11703:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789049469.381245:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954110617600 00000100:00100000:3.0:1789049469.381251:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954110617600 00000100:00100000:3.0:1789049469.381283:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 263 00000100:00100000:3.0:1789049469.381291:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8c6248c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7ef694ec-1ea0-4f02-800c-d1279b4fdf12+18:11703:x1875954110617600:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789049469.381535:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8c6248c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7ef694ec-1ea0-4f02-800c-d1279b4fdf12+18:11703:x1875954110617600:12345-0@lo:502:llog_process_th.0 Request processed in 126us (196us total) trans 0 rc 0/0 00000100:00100000:3.0:1789049469.381552:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 263 00000100:00100000:3.0:1789049469.381595:0:11703:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cb8c7c97cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1789049469.381609:0:11703:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb8f73c5f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7ef694ec-1ea0-4f02-800c-d1279b4fdf12:11703:1875954110617600:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1789049469.381628:0:11703:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789049469.381633:0:11703:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789049469.381634:0:11703:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:3.0:1789049469.381637:0:11703:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:0.0:1789049469.383016:0:5848:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-9 (rc=0) 10000000:01000000:0.0:1789049469.383047:0:5848:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.126@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1789049469.383057:0:5848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.126@tcp lock: ffff8cb8c6b35000/0xf4f48ce5e1bbefc9 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf4f48ce5e1bbefd0 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049469.383080:0:5848:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.126@tcp lock: ffff8cb8c6b35000/0xf4f48ce5e1bbefc9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf4f48ce5e1bbefd0 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789049469.383103:0:5848:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1789049469.383106:0:5848:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8cb8e01c3000 from 7 10000000:01000000:0.0:1789049469.383108:0:5848:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1789049469.383136:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.126@tcp lock: ffff8cb7c4c39600/0xf4f48ce5e1bbefd7 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049469.383154:0:5848:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.126@tcp lock: ffff8cb7c4c39600/0xf4f48ce5e1bbefd7 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049469.383164:0:5848:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.126@tcp lock: ffff8cb7c4c39600/0xf4f48ce5e1bbefd7 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789049469.383183:0:5848:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb900a58e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7ef694ec-1ea0-4f02-800c-d1279b4fdf12:5848:1875954110617728:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1789049469.383230:0:5848:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789049469.383270:0:5848:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cb8c79e0840 going to sleep for 11 seconds 00000100:00100000:1.0:1789049469.385267:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954110617728 00000100:00100000:1.0:1789049469.385282:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954110617728 00000100:00100000:1.0:1789049469.385328:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 264 00000100:00100000:1.0:1789049469.385337:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8c624a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7ef694ec-1ea0-4f02-800c-d1279b4fdf12+18:5848:x1875954110617728:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789049469.385353:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789049469.385368:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cb8c146c000/0xf4f48ce5e1bbefde lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xf4f48ce5e1bbefd7 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049469.385394:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cb8c146c000/0xf4f48ce5e1bbefde lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf4f48ce5e1bbefd7 expref: 19 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049469.385405:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cb8c146c000/0xf4f48ce5e1bbefde lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf4f48ce5e1bbefd7 expref: 19 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049469.385424:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cb8c146c000, rc 0) 00000100:00100000:1.0:1789049469.385500:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8c624a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7ef694ec-1ea0-4f02-800c-d1279b4fdf12+19:5848:x1875954110617728:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 163us (2268us total) trans 0 rc 0/0 00000100:00100000:1.0:1789049469.385516:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 264 00000100:00100000:1.0:1789049469.385569:0:5848:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb900a58e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7ef694ec-1ea0-4f02-800c-d1279b4fdf12:5848:1875954110617728:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789049469.385588:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.126@tcp lock: ffff8cb7c4c39600/0xf4f48ce5e1bbefd7 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf4f48ce5e1bbefde expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049469.385597:0:5848:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.126@tcp lock: ffff8cb7c4c39600/0xf4f48ce5e1bbefd7 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xf4f48ce5e1bbefde expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789049469.385659:0:5848:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb900a1fb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7ef694ec-1ea0-4f02-800c-d1279b4fdf12:5848:1875954110617856:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789049469.385690:0:5848:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789049469.385716:0:5848:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cb8fcba6a80 going to sleep for 11 seconds 00000100:00100000:1.0:1789049469.385729:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954110617856 00000100:00100000:1.0:1789049469.385734:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954110617856 00000100:00100000:1.0:1789049469.385751:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 265 00000100:00100000:1.0:1789049469.385756:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8c624b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7ef694ec-1ea0-4f02-800c-d1279b4fdf12+19:5848:x1875954110617856:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789049469.386043:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8c624b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7ef694ec-1ea0-4f02-800c-d1279b4fdf12+19:5848:x1875954110617856:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 285us (352us total) trans 0 rc 0/0 00000100:00100000:1.0:1789049469.386049:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 265 00000100:00100000:1.0:1789049469.386096:0:5848:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb900a1fb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7ef694ec-1ea0-4f02-800c-d1279b4fdf12:5848:1875954110617856:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789049469.386123:0:5848:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb900a1fb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7ef694ec-1ea0-4f02-800c-d1279b4fdf12:5848:1875954110617984:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789049469.386171:0:5848:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789049469.386185:0:5848:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cb8fcba6a80 going to sleep for 11 seconds 00000100:00100000:1.0:1789049469.386197:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954110617984 00000100:00100000:1.0:1789049469.386200:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954110617984 00000100:00100000:1.0:1789049469.386218:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 266 00000100:00100000:1.0:1789049469.386229:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8c624bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7ef694ec-1ea0-4f02-800c-d1279b4fdf12+19:5848:x1875954110617984:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789049469.386359:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8c624bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7ef694ec-1ea0-4f02-800c-d1279b4fdf12+19:5848:x1875954110617984:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 129us (187us total) trans 0 rc 0/0 00000100:00100000:1.0:1789049469.386365:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 266 00000100:00100000:1.0:1789049469.386401:0:5848:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb900a1fb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7ef694ec-1ea0-4f02-800c-d1279b4fdf12:5848:1875954110617984:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789049469.398699:0:11706:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb8ff3ec000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7ef694ec-1ea0-4f02-800c-d1279b4fdf12:11706:1875954110618112:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789049469.399273:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.26@tcp (source: 12345-192.168.206.26@tcp) 00000100:00100000:3.0:1789049469.399620:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954089613568 00000100:00100000:3.0:1789049469.399628:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954089613568 00000100:00100000:3.0:1789049469.400276:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.26@tcp, seq: 267 00000100:00100000:3.0:1789049469.400290:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8c6249050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:de93d576-ed8d-4d27-ab00-9189a62cea33+12:5598:x1875954089613568:12345-192.168.206.26@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789049469.400306:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789049469.400322:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cb8c6b34c00/0xf4f48ce5e1bbefe5 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x7fc5e358805a336e expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049469.400362:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cb8c6b34c00/0xf4f48ce5e1bbefe5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a336e expref: 13 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049469.400375:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cb8c6b34c00/0xf4f48ce5e1bbefe5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a336e expref: 13 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049469.400383:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cb8c6b34c00, rc 0) 00000100:00100000:2.0:1789049469.401024:0:11706:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789049469.402001:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8c6249050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:de93d576-ed8d-4d27-ab00-9189a62cea33+13:5598:x1875954089613568:12345-192.168.206.26@tcp:101:ll_cfg_requeue.0 Request processed in 1705us (2720us total) trans 0 rc 0/0 00000100:00100000:3.0:1789049469.402015:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.26@tcp, seq: 267 00000100:00100000:2.0:1789049469.402116:0:11706:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cb8fc9b6480 going to sleep for 11 seconds 00000100:00100000:3.0:1789049469.404976:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954110618112 00000100:00100000:3.0:1789049469.404984:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954110618112 00000100:00100000:3.0:1789049469.407120:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 268 00000100:00100000:3.0:1789049469.407151:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8c6249850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7ef694ec-1ea0-4f02-800c-d1279b4fdf12+19:11706:x1875954110618112:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789049469.407398:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8c6249850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7ef694ec-1ea0-4f02-800c-d1279b4fdf12+19:11706:x1875954110618112:12345-0@lo:502:llog_process_th.0 Request processed in 265us (8603us total) trans 0 rc 0/0 00000100:00100000:3.0:1789049469.407406:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 268 00000100:00100000:3.0:1789049469.407488:0:11706:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb8ff3ec000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7ef694ec-1ea0-4f02-800c-d1279b4fdf12:11706:1875954110618112:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1789049469.407524:0:11706:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789049469.407534:0:11706:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789049469.407537:0:11706:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1789049469.407557:0:11706:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8cb8e01c3000 00000020:00000080:3.0:1789049469.407560:0:11706:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1789049469.407643:0:11706:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb8f73c5f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7ef694ec-1ea0-4f02-800c-d1279b4fdf12:11706:1875954110618240:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789049469.407686:0:11706:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789049469.407714:0:11706:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cb8c7c97cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1789049469.409314:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954110618240 00000100:00100000:1.0:1789049469.409328:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954110618240 00000100:00100000:1.0:1789049469.409378:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 269 00000100:00100000:1.0:1789049469.409387:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8c624b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7ef694ec-1ea0-4f02-800c-d1279b4fdf12+19:11706:x1875954110618240:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789049469.409766:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.26@tcp (source: 12345-192.168.206.26@tcp) 00000100:00100000:1.0:1789049469.409790:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8c624b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7ef694ec-1ea0-4f02-800c-d1279b4fdf12+19:11706:x1875954110618240:12345-0@lo:502:llog_process_th.0 Request processed in 403us (2104us total) trans 0 rc 0/0 00000100:00100000:1.0:1789049469.409799:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 269 00000100:00100000:3.0:1789049469.409837:0:11706:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb8f73c5f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7ef694ec-1ea0-4f02-800c-d1279b4fdf12:11706:1875954110618240:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1789049469.410046:0:11706:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789049469.410054:0:11706:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789049469.410056:0:11706:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:3.0:1789049469.410060:0:11706:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000100:00100000:3.0:1789049469.410192:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954089613696 00000100:00100000:3.0:1789049469.410197:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954089613696 00000100:00100000:3.0:1789049469.410220:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.26@tcp, seq: 270 00000100:00100000:3.0:1789049469.410227:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8c6248850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:de93d576-ed8d-4d27-ab00-9189a62cea33+13:5598:x1875954089613696:12345-192.168.206.26@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789049469.410489:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8c6248850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:de93d576-ed8d-4d27-ab00-9189a62cea33+13:5598:x1875954089613696:12345-192.168.206.26@tcp:501:ll_cfg_requeue.0 Request processed in 259us (723us total) trans 0 rc 0/0 00000100:00100000:3.0:1789049469.410497:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.26@tcp, seq: 270 00000020:01000000:1.0:1789049469.410877:0:5848:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-9 (rc=0) 10000000:01000000:1.0:1789049469.410899:0:5848:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.126@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1789049469.410909:0:5848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.126@tcp lock: ffff8cb7c4c39600/0xf4f48ce5e1bbefd7 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf4f48ce5e1bbefde expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049469.410922:0:5848:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.126@tcp lock: ffff8cb7c4c39600/0xf4f48ce5e1bbefd7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf4f48ce5e1bbefde expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789049469.414593:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.26@tcp (source: 12345-192.168.206.26@tcp) 00000100:00100000:0.0:1789049469.415093:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954089613824 00000100:00100000:0.0:1789049469.415103:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954089613824 00000100:00100000:0.0:1789049469.415156:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.26@tcp, seq: 271 00000100:00100000:0.0:1789049469.415165:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8c6249c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:de93d576-ed8d-4d27-ab00-9189a62cea33+13:5598:x1875954089613824:12345-192.168.206.26@tcp:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789049469.415381:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8c6249c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:de93d576-ed8d-4d27-ab00-9189a62cea33+13:5598:x1875954089613824:12345-192.168.206.26@tcp:503:ll_cfg_requeue.0 Request processed in 216us (796us total) trans 0 rc 0/0 00000100:00100000:0.0:1789049469.415389:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.26@tcp, seq: 271 00000100:00100000:1.0:1789049469.424642:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.26@tcp (source: 12345-192.168.206.26@tcp) 00000100:00100000:0.0:1789049469.425094:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954089613952 00000100:00100000:0.0:1789049469.425104:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954089613952 00000100:00100000:0.0:1789049469.425155:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.26@tcp, seq: 272 00000100:00100000:0.0:1789049469.425165:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8c624ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:de93d576-ed8d-4d27-ab00-9189a62cea33+13:9953:x1875954089613952:12345-192.168.206.26@tcp:502:llog_process_th.0 00000100:00100000:0.0:1789049469.425376:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8c624ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:de93d576-ed8d-4d27-ab00-9189a62cea33+13:9953:x1875954089613952:12345-192.168.206.26@tcp:502:llog_process_th.0 Request processed in 212us (743us total) trans 0 rc 0/0 00000100:00100000:0.0:1789049469.425384:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.26@tcp, seq: 272 00000100:00100000:3.0:1789049469.433302:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.26@tcp (source: 12345-192.168.206.26@tcp) 00000100:00100000:1.0:1789049469.433488:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954089614080 00000100:00100000:1.0:1789049469.433498:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954089614080 00000100:00100000:1.0:1789049469.444535:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.26@tcp, seq: 273 00000100:00100000:1.0:1789049469.444554:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8c6248450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:de93d576-ed8d-4d27-ab00-9189a62cea33+13:9953:x1875954089614080:12345-192.168.206.26@tcp:502:llog_process_th.0 00000100:00100000:1.0:1789049469.444800:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8c6248450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:de93d576-ed8d-4d27-ab00-9189a62cea33+13:9953:x1875954089614080:12345-192.168.206.26@tcp:502:llog_process_th.0 Request processed in 253us (11506us total) trans 0 rc 0/0 00000100:00100000:1.0:1789049469.444809:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.26@tcp, seq: 273 00010000:00010000:0.0:1789049469.659817:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789049470.363247:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb8ff3edf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1875954110618368:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789049470.363313:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789049470.363561:0:6706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954110618368 00000100:00100000:1.0:1789049470.363569:0:6706:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954110618368 00000100:00100000:1.0:1789049470.363723:0:6706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1789049470.363744:0:6706:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb900a58700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1875954110618368:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789049470.363778:0:6706:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00080000:2.0:1789049470.363982:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789049470.364672:0:6706:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb900a58700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1875954110618368:12345-0@lo:13:osp-pre-0-0.0 Request processed in 938us (1356us total) trans 0 rc 0/0 00000100:00100000:0.0:1789049470.364673:0:3310:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967300 gen 2 00000004:00080000:0.0:1789049470.364678:0:3310:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8cb8df482300, transno 4294967300 00000100:00100000:1.0:1789049470.364681:0:6706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1789049470.364701:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb8ff3edf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1875954110618368:0@lo:13:osp-pre-0-0.0 00000040:00080000:2.0:1789049470.428017:0:11704:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1789049470.683107:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789049471.387288:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789049471.387327:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb900a1fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1875954110618496:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789049471.387392:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789049471.387536:0:6707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954110618496 00000100:00100000:2.0:1789049471.387544:0:6707:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954110618496 00000100:00100000:2.0:1789049471.387600:0:6707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1789049471.387609:0:6707:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb900a1df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1875954110618496:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1789049471.387640:0:6707:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789049471.387694:0:6707:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb900a1df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1875954110618496:12345-0@lo:13:osp-pre-1-0.0 Request processed in 86us (302us total) trans 0 rc 0/0 00000100:00100000:2.0:1789049471.387701:0:6707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1789049471.387988:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb900a59180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3309:1875954110618752:0@lo:400:kworker.0 00000100:00100000:0.0:1789049471.388020:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789049471.388041:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:0.0:1789049471.388048:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb900a59500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:7ef694ec-1ea0-4f02-800c-d1279b4fdf12:3309:1875954110618624:0@lo:400:kworker.0 00000100:00100000:2.0:1789049471.388093:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954110618752 00000100:00100000:0.0:1789049471.388094:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789049471.388101:0:5852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954110618752 00000100:00100000:0.0:1789049471.388124:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb900a5ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3309:1875954110619136:0@lo:400:kworker.0 00000100:00100000:2.0:1789049471.388140:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:2.0:1789049471.388153:0:5852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb900a59f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1875954110618752:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789049471.388153:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789049471.388196:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954110619136 00000100:00100000:0.0:1789049471.388201:0:5850:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954110619136 00000100:00100000:2.0:1789049471.388206:0:5852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb900a59f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1875954110618752:12345-0@lo:400:kworker.0 Request processed in 57us (185us total) trans 0 rc 0/0 00000100:00100000:2.0:1789049471.388213:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:2.0:1789049471.388228:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:2.0:1789049471.388235:0:5852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb900a59880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1875954110619136:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789049471.388264:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb900a59180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3309:1875954110618752:0@lo:400:kworker.0 00000100:00100000:2.0:1789049471.388269:0:5852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb900a59880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1875954110619136:12345-0@lo:400:kworker.0 Request processed in 32us (116us total) trans 0 rc 0/0 00000100:00100000:2.0:1789049471.388277:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:0.0:1789049471.388292:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb900a5ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3309:1875954110619136:0@lo:400:kworker.0 00000100:00100000:3.0:1789049471.388365:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb900a58000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3311:1875954110619008:0@lo:400:kworker.0 00000100:00100000:3.0:1789049471.388396:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789049471.388436:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00080000:1.0:1789049471.388440:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789049471.388445:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb900a5b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3311:1875954110618880:0@lo:400:kworker.0 00000100:00080000:1.0:1789049471.388447:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789049471.388470:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954110618624 00000100:00100000:3.0:1789049471.388474:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789049471.388476:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954110618624 00000100:00100000:1.0:1789049471.388512:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 274 00000100:00100000:2.0:1789049471.388517:0:6705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954110619008 00000100:00100000:2.0:1789049471.388523:0:6705:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954110619008 00000100:00100000:1.0:1789049471.388523:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8c6249450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7ef694ec-1ea0-4f02-800c-d1279b4fdf12+19:3309:x1875954110618624:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789049471.388556:0:6705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1789049471.388564:0:6705:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8f73c5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3311:x1875954110619008:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789049471.388617:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954110618880 00000100:00100000:0.0:1789049471.388622:0:5850:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954110618880 00000100:00100000:0.0:1789049471.388656:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:0.0:1789049471.388664:0:5850:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8f73c4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1875954110618880:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789049471.388667:0:6705:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8f73c5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3311:x1875954110619008:12345-0@lo:400:kworker.0 Request processed in 102us (267us total) trans 0 rc 0/0 00000100:00100000:2.0:1789049471.388676:0:6705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1789049471.388714:0:5850:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8f73c4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1875954110618880:12345-0@lo:400:kworker.0 Request processed in 51us (241us total) trans 0 rc 0/0 00000100:00100000:0.0:1789049471.388721:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00010000:00080000:0.0:1789049471.388762:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cb900a1fb80 x1875954110618496/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789049487 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789049471.388783:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb900a1fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1875954110618496:0@lo:13:osp-pre-1-0.0 00000100:00080000:0.0:1789049471.388821:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789049471.390107:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb900a58000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3311:1875954110619008:0@lo:400:kworker.0 00000100:00100000:3.0:1789049471.390131:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb900a5b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3311:1875954110618880:0@lo:400:kworker.0 00000100:00100000:1.0:1789049471.391169:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8c6249450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7ef694ec-1ea0-4f02-800c-d1279b4fdf12+19:3309:x1875954110618624:12345-0@lo:400:kworker.0 Request processed in 2646us (3072us total) trans 0 rc 0/0 00000100:00100000:1.0:1789049471.391180:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 274 00000100:00100000:0.0:1789049471.391265:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb900a59500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:7ef694ec-1ea0-4f02-800c-d1279b4fdf12:3309:1875954110618624:0@lo:400:kworker.0 00010000:00010000:2.0:1789049471.707142:0:6719:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789049472.322693:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.26@tcp (source: 12345-192.168.206.26@tcp) 00000100:00100000:3.0:1789049472.322732:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.26@tcp (source: 12345-192.168.206.26@tcp) 00000100:00100000:1.0:1789049472.322886:0:6841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954089614336 00000100:00100000:1.0:1789049472.322896:0:6841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954089614336 00000100:00100000:1.0:1789049472.322962:0:6841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954089614592 00000100:00100000:1.0:1789049472.322966:0:6841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954089614592 00000100:00100000:1.0:1789049472.323009:0:6841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.26@tcp, seq: 106 00000100:00100000:1.0:1789049472.323019:0:6841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8c6323800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e823b53a-3591-475c-8624-c682227e5c13+5:2357:x1875954089614336:12345-192.168.206.26@tcp:400:kworker.0 00000100:00100000:1.0:1789049472.323103:0:6841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8c6323800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e823b53a-3591-475c-8624-c682227e5c13+5:2357:x1875954089614336:12345-192.168.206.26@tcp:400:kworker.0 Request processed in 84us (418us total) trans 0 rc 0/0 00000100:00100000:1.0:1789049472.323109:0:6841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.26@tcp, seq: 106 00000100:00100000:1.0:1789049472.323128:0:6841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.26@tcp, seq: 107 00000100:00100000:1.0:1789049472.323135:0:6841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8c6322a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:59d63492-f1ee-4aa5-bf8c-853a603b0252+5:2357:x1875954089614592:12345-192.168.206.26@tcp:400:kworker.0 00000100:00100000:1.0:1789049472.323160:0:6841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8c6322a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:59d63492-f1ee-4aa5-bf8c-853a603b0252+5:2357:x1875954089614592:12345-192.168.206.26@tcp:400:kworker.0 Request processed in 26us (428us total) trans 0 rc 0/0 00000100:00100000:1.0:1789049472.323166:0:6841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.26@tcp, seq: 107 00000100:00080000:3.0:1789049472.323583:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789049472.334572:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.26@tcp (source: 12345-192.168.206.26@tcp) 00000100:00100000:3.0:1789049472.334707:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.26@tcp (source: 12345-192.168.206.26@tcp) 00000100:00100000:0.0:1789049472.334885:0:10560:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954089614464 00000100:00100000:0.0:1789049472.334896:0:10560:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954089614464 00000100:00100000:0.0:1789049472.334957:0:10560:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.26@tcp, seq: 49 00000100:00100000:0.0:1789049472.334976:0:10560:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8c6320a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e823b53a-3591-475c-8624-c682227e5c13+5:2358:x1875954089614464:12345-192.168.206.26@tcp:400:kworker.0 00000100:00080000:2.0:1789049472.335080:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789049472.335300:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954089614208 00000100:00100000:1.0:1789049472.335305:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954089614208 00000100:00100000:1.0:1789049472.335379:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.26@tcp, seq: 275 00000100:00100000:1.0:1789049472.335387:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8c624a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:de93d576-ed8d-4d27-ab00-9189a62cea33+13:2358:x1875954089614208:12345-192.168.206.26@tcp:400:kworker.0 00000100:00100000:0.0:1789049472.335466:0:10560:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8c6320a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e823b53a-3591-475c-8624-c682227e5c13+5:2358:x1875954089614464:12345-192.168.206.26@tcp:400:kworker.0 Request processed in 499us (757us total) trans 0 rc 0/0 00000100:00100000:0.0:1789049472.335474:0:10560:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.26@tcp, seq: 49 00000100:00100000:1.0:1789049472.338101:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8c624a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:de93d576-ed8d-4d27-ab00-9189a62cea33+13:2358:x1875954089614208:12345-192.168.206.26@tcp:400:kworker.0 Request processed in 2703us (3527us total) trans 0 rc 0/0 00000100:00100000:1.0:1789049472.338117:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.26@tcp, seq: 275 00010000:00010000:0.0:1789049472.731159:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789049473.755869:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789049474.779069:0:6719:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789049475.483167:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789049475.483190:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb8ff3ed500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1875954110619264:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789049475.483274:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789049475.483379:0:6707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954110619264 00000100:00100000:1.0:1789049475.483389:0:6707:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954110619264 00000100:00080000:2.0:1789049475.483444:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789049475.483633:0:6707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1789049475.483644:0:6707:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8ff3ec700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1875954110619264:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789049475.483682:0:6707:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789049475.483743:0:6707:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8ff3ec700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1875954110619264:12345-0@lo:13:osp-pre-0-0.0 Request processed in 101us (468us total) trans 0 rc 0/0 00000100:00100000:1.0:1789049475.483750:0:6707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1789049475.483886:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb8ff3ed500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1875954110619264:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1789049475.803711:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789049476.507279:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb900a1c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1875954110619392:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789049476.507361:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789049476.507426:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789049476.507433:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb8c6320000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7ef694ec-1ea0-4f02-800c-d1279b4fdf12:3310:1875954110619520:0@lo:400:kworker.0 00000100:00100000:0.0:1789049476.507461:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789049476.507632:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954110619520 00000100:00100000:1.0:1789049476.507641:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954110619520 00000100:00100000:1.0:1789049476.507694:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 276 00000100:00100000:1.0:1789049476.507704:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8c624a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7ef694ec-1ea0-4f02-800c-d1279b4fdf12+19:3310:x1875954110619520:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789049476.507765:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8c624a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7ef694ec-1ea0-4f02-800c-d1279b4fdf12+19:3310:x1875954110619520:12345-0@lo:400:kworker.0 Request processed in 62us (302us total) trans 0 rc 0/0 00000100:00100000:1.0:1789049476.507772:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 276 00000100:00100000:1.0:1789049476.507804:0:6706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954110619392 00000100:00100000:1.0:1789049476.507808:0:6706:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954110619392 00000100:00100000:1.0:1789049476.507865:0:6706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1789049476.507873:0:6706:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb900a59500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1875954110619392:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789049476.507899:0:6706:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789049476.507932:0:6706:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb900a59500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1875954110619392:12345-0@lo:13:osp-pre-1-0.0 Request processed in 60us (571us total) trans 0 rc 0/0 00000100:00100000:1.0:1789049476.507938:0:6706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00080000:1.0:1789049476.507956:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789049476.508227:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb8c6320000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7ef694ec-1ea0-4f02-800c-d1279b4fdf12:3310:1875954110619520:0@lo:400:kworker.0 00010000:00080000:0.0:1789049476.508260:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cb900a1c380 x1875954110619392/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789049492 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789049476.508276:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb900a1c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1875954110619392:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789049476.512894:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb8c6322d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3308:1875954110619648:0@lo:400:kworker.0 00000100:00100000:2.0:1789049476.513007:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789049476.513241:0:6841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954110619648 00000100:00100000:1.0:1789049476.513250:0:6841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954110619648 00000100:00100000:0.0:1789049476.513267:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb8c6323100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3309:1875954110619776:0@lo:400:kworker.0 00000100:00100000:1.0:1789049476.513304:0:6841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:1.0:1789049476.513314:0:6841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8ff3ed500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1875954110619648:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789049476.513326:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789049476.513391:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954110619776 00000100:00100000:0.0:1789049476.513395:0:5851:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954110619776 00000100:00100000:0.0:1789049476.513444:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:0.0:1789049476.513453:0:5851:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb900a5ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1875954110619776:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789049476.513491:0:5851:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb900a5ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1875954110619776:12345-0@lo:400:kworker.0 Request processed in 40us (166us total) trans 0 rc 0/0 00000100:00100000:0.0:1789049476.513498:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00080000:0.0:1789049476.513520:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789049476.513546:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb8c6323100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3309:1875954110619776:0@lo:400:kworker.0 00000100:00100000:3.0:1789049476.514763:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb8c6320000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3311:1875954110620032:0@lo:400:kworker.0 00000100:00100000:3.0:1789049476.514810:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789049476.514833:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789049476.514839:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb8c6323100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3311:1875954110619904:0@lo:400:kworker.0 00000100:00100000:3.0:1789049476.514882:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789049476.514910:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954110619904 00000100:00100000:3.0:1789049476.514915:0:6704:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954110619904 00000100:00100000:3.0:1789049476.514954:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1789049476.514962:0:6704:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8fc99a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3311:x1875954110619904:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789049476.515003:0:6704:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8fc99a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3311:x1875954110619904:12345-0@lo:400:kworker.0 Request processed in 41us (120us total) trans 0 rc 0/0 00000100:00100000:3.0:1789049476.515009:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1789049476.515058:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb8c6323100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3311:1875954110619904:0@lo:400:kworker.0 00000100:00100000:0.0:1789049476.515904:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954110620032 00000100:00100000:0.0:1789049476.515911:0:5851:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954110620032 00000100:00100000:0.0:1789049476.515973:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:0.0:1789049476.515981:0:5851:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8fc999880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1875954110620032:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789049476.516048:0:5851:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8fc999880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1875954110620032:12345-0@lo:400:kworker.0 Request processed in 67us (1237us total) trans 0 rc 0/0 00000100:00100000:0.0:1789049476.516055:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:0.0:1789049476.516094:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb8c6320000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3311:1875954110620032:0@lo:400:kworker.0 00000100:00080000:3.0:1789049476.516168:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789049476.516228:0:6841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8ff3ed500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1875954110619648:12345-0@lo:400:kworker.0 Request processed in 2913us (3218us total) trans 0 rc 0/0 00000100:00100000:1.0:1789049476.516239:0:6841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:2.0:1789049476.516243:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb8c6322d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3308:1875954110619648:0@lo:400:kworker.0 00010000:00010000:0.0:1789049476.826997:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789049477.445276:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.26@tcp (source: 12345-192.168.206.26@tcp) 00000100:00100000:3.0:1789049477.445319:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.26@tcp (source: 12345-192.168.206.26@tcp) 00000100:00100000:1.0:1789049477.445437:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954089614720 00000100:00100000:1.0:1789049477.445447:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954089614720 00000100:00100000:1.0:1789049477.445509:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.26@tcp, seq: 277 00000100:00100000:1.0:1789049477.445519:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8c6297050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:de93d576-ed8d-4d27-ab00-9189a62cea33+13:2356:x1875954089614720:12345-192.168.206.26@tcp:400:kworker.0 00000100:00100000:1.0:1789049477.445662:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8c6297050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:de93d576-ed8d-4d27-ab00-9189a62cea33+13:2356:x1875954089614720:12345-192.168.206.26@tcp:400:kworker.0 Request processed in 143us (393us total) trans 0 rc 0/0 00000100:00100000:1.0:1789049477.445670:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.26@tcp, seq: 277 00000100:00100000:3.0:1789049477.446664:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.26@tcp (source: 12345-192.168.206.26@tcp) 00000100:00100000:3.0:1789049477.446750:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.26@tcp (source: 12345-192.168.206.26@tcp) 00000100:00100000:0.0:1789049477.447019:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954089614848 00000100:00100000:0.0:1789049477.447034:0:5850:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954089614848 00000100:00100000:0.0:1789049477.447096:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954089615104 00000100:00100000:0.0:1789049477.447100:0:5850:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954089615104 00000100:00100000:0.0:1789049477.447129:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.26@tcp, seq: 111 00000100:00080000:3.0:1789049477.447131:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789049477.447141:0:5850:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8fc99b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e823b53a-3591-475c-8624-c682227e5c13+5:2355:x1875954089614848:12345-192.168.206.26@tcp:400:kworker.0 00000100:00100000:3.0:1789049477.447168:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.26@tcp, seq: 112 00000100:00100000:0.0:1789049477.447201:0:5850:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8fc99b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e823b53a-3591-475c-8624-c682227e5c13+5:2355:x1875954089614848:12345-192.168.206.26@tcp:400:kworker.0 Request processed in 62us (539us total) trans 0 rc 0/0 00000100:00100000:0.0:1789049477.447208:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.26@tcp, seq: 111 00000100:00100000:3.0:1789049477.447416:0:5851:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8fc99bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:59d63492-f1ee-4aa5-bf8c-853a603b0252+5:2355:x1875954089615104:12345-192.168.206.26@tcp:400:kworker.0 00000100:00100000:3.0:1789049477.447462:0:5851:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8fc99bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:59d63492-f1ee-4aa5-bf8c-853a603b0252+5:2355:x1875954089615104:12345-192.168.206.26@tcp:400:kworker.0 Request processed in 285us (716us total) trans 0 rc 0/0 00000100:00100000:3.0:1789049477.447468:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.26@tcp, seq: 112 00000100:00100000:2.0:1789049477.448367:0:6703:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954089614976 00000100:00100000:2.0:1789049477.448374:0:6703:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954089614976 00000100:00080000:3.0:1789049477.448467:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789049477.448493:0:6703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.26@tcp, seq: 51 00000100:00100000:2.0:1789049477.448504:0:6703:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8fc999500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e823b53a-3591-475c-8624-c682227e5c13+5:2356:x1875954089614976:12345-192.168.206.26@tcp:400:kworker.0 00000100:00100000:2.0:1789049477.448555:0:6703:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8fc999500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e823b53a-3591-475c-8624-c682227e5c13+5:2356:x1875954089614976:12345-192.168.206.26@tcp:400:kworker.0 Request processed in 54us (3235us total) trans 0 rc 0/0 00000100:00100000:2.0:1789049477.448562:0:6703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.26@tcp, seq: 51 00010000:00010000:2.0:1789049477.855243:0:6719:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789049478.875059:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789049479.899898:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789049480.604995:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1789049480.605026:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb8ff3ed180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3309:1875954110620160:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789049480.605102:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789049480.605476:0:6706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954110620160 00000100:00100000:2.0:1789049480.605484:0:6706:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954110620160 00000100:00100000:2.0:1789049480.605573:0:6706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1789049480.605583:0:6706:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb900a1d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1875954110620160:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789049480.605631:0:6706:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789049480.605692:0:6706:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb900a1d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1875954110620160:12345-0@lo:13:osp-pre-0-0.0 Request processed in 110us (589us total) trans 0 rc 0/0 00000100:00100000:2.0:1789049480.605699:0:6706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1789049480.605785:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb8ff3ed180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3309:1875954110620160:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1789049480.605865:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000040:00080000:2.0:1789049480.667585:0:11704:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1789049480.923077:0:6719:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789049481.627188:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb8d0ab7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1875954110620672:0@lo:400:kworker.0 00000100:00100000:2.0:1789049481.627289:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789049481.627551:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954110620672 00000100:00100000:3.0:1789049481.627562:0:6704:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954110620672 00000100:00100000:3.0:1789049481.627625:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1789049481.627635:0:6704:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8ff3ee680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3308:x1875954110620672:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789049481.627684:0:6704:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8ff3ee680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3308:x1875954110620672:12345-0@lo:400:kworker.0 Request processed in 51us (395us total) trans 0 rc 0/0 00000100:00100000:3.0:1789049481.627691:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1789049481.628093:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb8d0ab7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1875954110620672:0@lo:400:kworker.0 00000100:00100000:2.0:1789049481.628110:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1789049481.628116:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb8c6322d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7ef694ec-1ea0-4f02-800c-d1279b4fdf12:3308:1875954110620288:0@lo:400:kworker.0 00000100:00100000:2.0:1789049481.628144:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789049481.628167:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb8d0ab6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3308:1875954110620800:0@lo:400:kworker.0 00000100:00100000:2.0:1789049481.628189:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789049481.628373:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb8c6320000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3310:1875954110620416:0@lo:400:kworker.0 00000100:00100000:1.0:1789049481.628402:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789049481.628478:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb8d0ab5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1875954110620928:0@lo:400:kworker.0 00000100:00100000:1.0:1789049481.628499:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789049481.628514:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789049481.628518:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb8c6323100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3310:1875954110620544:0@lo:400:kworker.0 00000100:00100000:1.0:1789049481.628533:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789049481.628555:0:6841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954110620800 00000100:00100000:1.0:1789049481.628559:0:6841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954110620800 00000100:00100000:1.0:1789049481.628592:0:6841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954110620416 00000100:00100000:1.0:1789049481.628595:0:6841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954110620416 00000100:00100000:1.0:1789049481.628618:0:6841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954110620544 00000100:00100000:1.0:1789049481.628621:0:6841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954110620544 00000100:00100000:1.0:1789049481.628634:0:6841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:1.0:1789049481.628641:0:6841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8ff3efb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1875954110620800:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789049481.628675:0:6841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8ff3efb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1875954110620800:12345-0@lo:400:kworker.0 Request processed in 35us (485us total) trans 0 rc 0/0 00000100:00100000:1.0:1789049481.628682:0:6841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:1.0:1789049481.628694:0:6841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:1.0:1789049481.628699:0:6841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb900a1e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1875954110620416:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789049481.628737:0:6841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb900a1e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1875954110620416:12345-0@lo:400:kworker.0 Request processed in 38us (335us total) trans 0 rc 0/0 00000100:00100000:1.0:1789049481.628743:0:6841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:1.0:1789049481.628759:0:6841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:1.0:1789049481.628765:0:6841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb900a1f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1875954110620544:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789049481.628790:0:6841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb900a1f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1875954110620544:12345-0@lo:400:kworker.0 Request processed in 25us (255us total) trans 0 rc 0/0 00000100:00100000:1.0:1789049481.628796:0:6841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00100000:0.0:1789049481.628833:0:10560:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954110620928 00000100:00100000:0.0:1789049481.628839:0:10560:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954110620928 00000100:00100000:0.0:1789049481.628885:0:10560:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1789049481.628892:0:10560:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb900a1ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3310:x1875954110620928:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789049481.628929:0:10560:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb900a1ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3310:x1875954110620928:12345-0@lo:400:kworker.0 Request processed in 38us (430us total) trans 0 rc 0/0 00000100:00100000:0.0:1789049481.628935:0:10560:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00080000:0.0:1789049481.628968:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789049481.628972:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789049481.628992:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb8d0ab6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3308:1875954110620800:0@lo:400:kworker.0 00000100:00100000:1.0:1789049481.628994:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb900a1c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3311:1875954110621056:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789049481.629042:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb8c6323100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3310:1875954110620544:0@lo:400:kworker.0 00000100:00100000:1.0:1789049481.629043:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789049481.629059:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb8c6320000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3310:1875954110620416:0@lo:400:kworker.0 00000100:00100000:1.0:1789049481.629079:0:6706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954110621056 00000100:00100000:1.0:1789049481.629083:0:6706:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954110621056 00000100:00100000:1.0:1789049481.629104:0:6706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1789049481.629110:0:6706:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb900a1d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1875954110621056:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789049481.629134:0:6706:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789049481.629166:0:6706:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb900a1d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1875954110621056:12345-0@lo:13:osp-pre-1-0.0 Request processed in 55us (126us total) trans 0 rc 0/0 00000100:00100000:1.0:1789049481.629177:0:6706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00010000:00080000:1.0:1789049481.629210:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cb900a1c700 x1875954110621056/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789049497 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789049481.629226:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb900a1c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3311:1875954110621056:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789049481.629248:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954110620288 00000100:00100000:3.0:1789049481.629254:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954110620288 00000100:00100000:3.0:1789049481.629290:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 278 00000100:00100000:3.0:1789049481.629299:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8c6294050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7ef694ec-1ea0-4f02-800c-d1279b4fdf12+19:3308:x1875954110620288:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789049481.629340:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8c6294050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7ef694ec-1ea0-4f02-800c-d1279b4fdf12+19:3308:x1875954110620288:12345-0@lo:400:kworker.0 Request processed in 43us (1196us total) trans 0 rc 0/0 00000100:00100000:3.0:1789049481.629347:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 278 00000100:00100000:3.0:1789049481.629458:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb8c6322d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7ef694ec-1ea0-4f02-800c-d1279b4fdf12:3308:1875954110620288:0@lo:400:kworker.0 00010000:00080000:0.0:1789049481.631102:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cb8d0ab5180 x1875954110620928/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789049497 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789049481.631117:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb8d0ab5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1875954110620928:0@lo:400:kworker.0 00010000:00010000:0.0:1789049481.949418:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789049482.565961:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.26@tcp (source: 12345-192.168.206.26@tcp) 00000100:00100000:1.0:1789049482.566017:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.26@tcp (source: 12345-192.168.206.26@tcp) 00000100:00100000:0.0:1789049482.566034:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954089615232 00000100:00100000:0.0:1789049482.566044:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954089615232 00000100:00100000:0.0:1789049482.566099:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.26@tcp, seq: 279 00000100:00100000:2.0:1789049482.566109:0:6841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954089615360 00000100:00100000:0.0:1789049482.566110:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8c6294c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:de93d576-ed8d-4d27-ab00-9189a62cea33+13:2356:x1875954089615232:12345-192.168.206.26@tcp:400:kworker.0 00000100:00100000:2.0:1789049482.566113:0:6841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954089615360 00000100:00100000:2.0:1789049482.566160:0:6841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.26@tcp, seq: 116 00000100:00100000:2.0:1789049482.566167:0:6841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb900a1c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e823b53a-3591-475c-8624-c682227e5c13+5:2356:x1875954089615360:12345-192.168.206.26@tcp:400:kworker.0 00000100:00100000:0.0:1789049482.566180:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8c6294c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:de93d576-ed8d-4d27-ab00-9189a62cea33+13:2356:x1875954089615232:12345-192.168.206.26@tcp:400:kworker.0 Request processed in 72us (229us total) trans 0 rc 0/0 00000100:00100000:0.0:1789049482.566187:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.26@tcp, seq: 279 00000100:00100000:2.0:1789049482.566194:0:6841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb900a1c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e823b53a-3591-475c-8624-c682227e5c13+5:2356:x1875954089615360:12345-192.168.206.26@tcp:400:kworker.0 Request processed in 29us (179us total) trans 0 rc 0/0 00000100:00100000:2.0:1789049482.566200:0:6841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.26@tcp, seq: 116 00000100:00080000:1.0:1789049482.566266:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789049482.579870:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.26@tcp (source: 12345-192.168.206.26@tcp) 00000100:00100000:3.0:1789049482.579971:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.26@tcp (source: 12345-192.168.206.26@tcp) 00000100:00100000:1.0:1789049482.583639:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954089615616 00000100:00100000:1.0:1789049482.583674:0:5850:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954089615616 00000100:00100000:1.0:1789049482.583788:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.26@tcp, seq: 117 00000100:00100000:1.0:1789049482.583800:0:5850:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8d0ab4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:59d63492-f1ee-4aa5-bf8c-853a603b0252+5:2355:x1875954089615616:12345-192.168.206.26@tcp:400:kworker.0 00000100:00100000:1.0:1789049482.583902:0:5850:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8d0ab4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:59d63492-f1ee-4aa5-bf8c-853a603b0252+5:2355:x1875954089615616:12345-192.168.206.26@tcp:400:kworker.0 Request processed in 104us (3930us total) trans 0 rc 0/0 00000100:00100000:1.0:1789049482.583909:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.26@tcp, seq: 117 00000100:00100000:0.0:1789049482.584246:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954089615488 00000100:00100000:0.0:1789049482.584252:0:6704:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954089615488 00000100:00100000:0.0:1789049482.584302:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.26@tcp, seq: 19 00000100:00100000:0.0:1789049482.584310:0:6704:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8d0ab4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e823b53a-3591-475c-8624-c682227e5c13+5:2354:x1875954089615488:12345-192.168.206.26@tcp:9:kworker.0 00000020:00000080:0.0:1789049482.584330:0:6704:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xf4f48ce5e1bbef21 00000100:00080000:0.0:1789049482.584338:0:6704:0:(import.c:65:import_set_state_nolock()) ffff8cb8c6bc0800 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1789049482.584386:0:6704:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967300 00000100:00100000:0.0:1789049482.584952:0:6704:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8d0ab4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e823b53a-3591-475c-8624-c682227e5c13+2:2354:x1875954089615488:12345-192.168.206.26@tcp:9:kworker.0 Request processed in 641us (5118us total) trans 0 rc 0/0 00000100:00100000:0.0:1789049482.584961:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.26@tcp, seq: 19 00010000:00010000:0.0:1789049482.584985:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1789049482.585773:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1789049482.585780:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1789049482.971120:0:6719:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1789049483.271806:0:6731:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of e823b53a-3591-475c-8624-c682227e5c13 00000020:00000080:2.0:1789049483.271826:0:6731:0:(genops.c:885:class_export_put()) final put ffff8cb8c6bc5800/e823b53a-3591-475c-8624-c682227e5c13 00000020:00000080:0.0:1789049483.272035:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8cb8c6bc5800/e823b53a-3591-475c-8624-c682227e5c13 for lustre-OST0000 00000020:00000080:0.0:1789049483.272133:0:8:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8cb8c6bc0800 for lustre-OST0000 00010000:00010000:0.0:1789049483.996651:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789049485.019114:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789049485.723574:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1789049485.723600:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb8ff3ec380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3309:1875954110621184:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789049485.723671:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789049485.723823:0:6706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954110621184 00000100:00100000:1.0:1789049485.723832:0:6706:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954110621184 00000100:00100000:1.0:1789049485.723964:0:6706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1789049485.723975:0:6706:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb900a59180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1875954110621184:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789049485.724018:0:6706:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789049485.724071:0:6706:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb900a59180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1875954110621184:12345-0@lo:13:osp-pre-0-0.0 Request processed in 99us (400us total) trans 0 rc 0/0 00000100:00100000:1.0:1789049485.724079:0:6706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00080000:2.0:1789049485.724133:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789049485.724191:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb8ff3ec380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3309:1875954110621184:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1789049486.043247:0:6719:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789049486.747466:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb900a1d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3309:1875954110621312:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789049486.747540:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789049486.750582:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb900a1c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3311:1875954110621568:0@lo:400:kworker.0 00000100:00100000:3.0:1789049486.750665:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789049486.750757:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:3.0:1789049486.750764:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb900a1f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:7ef694ec-1ea0-4f02-800c-d1279b4fdf12:3311:1875954110621440:0@lo:400:kworker.0 00000100:00100000:3.0:1789049486.750805:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789049486.750830:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb8ff3cad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3311:1875954110621952:0@lo:400:kworker.0 00000100:00100000:3.0:1789049486.750877:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789049486.750949:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb900a1fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3309:1875954110621824:0@lo:400:kworker.0 00000100:00100000:2.0:1789049486.750996:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789049486.751026:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1789049486.751042:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb900a1c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3309:1875954110621696:0@lo:400:kworker.0 00000100:00100000:2.0:1789049486.751098:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954110621440 00000100:00100000:2.0:1789049486.751105:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954110621440 00000100:00100000:2.0:1789049486.751149:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 280 00000100:00100000:2.0:1789049486.751157:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8c6296450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7ef694ec-1ea0-4f02-800c-d1279b4fdf12+19:3311:x1875954110621440:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789049486.751206:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8c6296450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7ef694ec-1ea0-4f02-800c-d1279b4fdf12+19:3311:x1875954110621440:12345-0@lo:400:kworker.0 Request processed in 50us (404us total) trans 0 rc 0/0 00000100:00100000:2.0:1789049486.751213:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 280 00000100:00100000:2.0:1789049486.751254:0:10560:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954110621824 00000100:00100000:2.0:1789049486.751258:0:10560:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954110621824 00000100:00100000:2.0:1789049486.751286:0:10560:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1789049486.751292:0:10560:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8ff3ee300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3309:x1875954110621824:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789049486.751327:0:10560:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8ff3ee300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3309:x1875954110621824:12345-0@lo:400:kworker.0 Request processed in 35us (331us total) trans 0 rc 0/0 00000100:00100000:2.0:1789049486.751334:0:10560:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1789049486.756363:0:6707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954110621312 00000100:00100000:0.0:1789049486.756379:0:6707:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954110621312 00000100:00100000:0.0:1789049486.756514:0:6706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1789049486.756525:0:6706:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8ff3ec380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1875954110621312:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1789049486.756564:0:6706:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789049486.756641:0:6706:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8ff3ec380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1875954110621312:12345-0@lo:13:osp-pre-1-0.0 Request processed in 117us (9101us total) trans 0 rc 0/0 00000100:00100000:0.0:1789049486.756647:0:6706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00080000:2.0:1789049486.757212:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789049486.758417:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb900a1f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:7ef694ec-1ea0-4f02-800c-d1279b4fdf12:3311:1875954110621440:0@lo:400:kworker.0 00000100:00100000:2.0:1789049486.758418:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789049486.758644:0:6841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954110621568 00000100:00100000:1.0:1789049486.758718:0:6841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954110621568 00000100:00100000:1.0:1789049486.758820:0:6841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954110621952 00000100:00100000:1.0:1789049486.758824:0:6841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954110621952 00000100:00100000:3.0:1789049486.758969:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:3.0:1789049486.758991:0:5850:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8d0ab7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1875954110621568:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789049486.759031:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb900a1fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3309:1875954110621824:0@lo:400:kworker.0 00010000:00080000:2.0:1789049486.759048:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cb900a1d180 x1875954110621312/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789049502 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789049486.759066:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb900a1d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3309:1875954110621312:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789049486.759072:0:5850:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8d0ab7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1875954110621568:12345-0@lo:400:kworker.0 Request processed in 84us (8406us total) trans 0 rc 0/0 00000100:00100000:3.0:1789049486.759081:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00080000:2.0:1789049486.759090:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789049486.759100:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954110621696 00000100:00100000:3.0:1789049486.759105:0:5850:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954110621696 00000100:00100000:2.0:1789049486.759118:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:2.0:1789049486.759127:0:5852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8d0ab6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1875954110621952:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789049486.759137:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:3.0:1789049486.759146:0:5850:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8ff3eea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1875954110621696:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789049486.759167:0:5852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8d0ab6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1875954110621952:12345-0@lo:400:kworker.0 Request processed in 41us (8288us total) trans 0 rc 0/0 00000100:00100000:2.0:1789049486.759184:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00000100:00100000:3.0:1789049486.759190:0:5850:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8ff3eea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1875954110621696:12345-0@lo:400:kworker.0 Request processed in 45us (774us total) trans 0 rc 0/0 00000100:00100000:3.0:1789049486.759198:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00000100:00080000:2.0:1789049486.759214:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789049486.759235:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb900a1c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3309:1875954110621696:0@lo:400:kworker.0 00000100:00100000:2.0:1789049486.759243:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb8ff3cad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3311:1875954110621952:0@lo:400:kworker.0 00000100:00100000:2.0:1789049486.759258:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb900a1c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3311:1875954110621568:0@lo:400:kworker.0 00010000:00010000:0.0:1789049487.068202:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789049487.682828:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.26@tcp (source: 12345-192.168.206.26@tcp) 00000100:00100000:3.0:1789049487.682905:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.26@tcp (source: 12345-192.168.206.26@tcp) 00000100:00100000:3.0:1789049487.682949:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.26@tcp (source: 12345-192.168.206.26@tcp) 00000100:00100000:1.0:1789049487.683112:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954089616000 00000100:00100000:1.0:1789049487.683122:0:5850:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954089616000 00000100:00100000:1.0:1789049487.683187:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954089615872 00000100:00100000:1.0:1789049487.683191:0:5850:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954089615872 00000100:00100000:1.0:1789049487.683215:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.26@tcp, seq: 121 00000100:00100000:1.0:1789049487.683226:0:5850:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8d0ab6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:59d63492-f1ee-4aa5-bf8c-853a603b0252+5:2358:x1875954089616000:12345-192.168.206.26@tcp:400:kworker.0 00000100:00100000:1.0:1789049487.683301:0:5850:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8d0ab6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:59d63492-f1ee-4aa5-bf8c-853a603b0252+5:2358:x1875954089616000:12345-192.168.206.26@tcp:400:kworker.0 Request processed in 77us (394us total) trans 0 rc 0/0 00000100:00100000:1.0:1789049487.683308:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.26@tcp, seq: 121 00000100:00100000:1.0:1789049487.683343:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.26@tcp, seq: 122 00000100:00100000:1.0:1789049487.683365:0:5850:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8d0ab5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e823b53a-3591-475c-8624-c682227e5c13+5:2358:x1875954089615872:12345-192.168.206.26@tcp:400:kworker.0 00000100:00100000:1.0:1789049487.683391:0:5850:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8d0ab5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e823b53a-3591-475c-8624-c682227e5c13+5:2358:x1875954089615872:12345-192.168.206.26@tcp:400:kworker.0 Request processed in 27us (442us total) trans 0 rc 0/0 00000100:00100000:1.0:1789049487.683397:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.26@tcp, seq: 122 00000100:00100000:2.0:1789049487.684093:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954089615744 00000100:00100000:2.0:1789049487.684100:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954089615744 00000100:00100000:2.0:1789049487.684146:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.26@tcp, seq: 281 00000100:00100000:2.0:1789049487.684154:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8c6297450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:de93d576-ed8d-4d27-ab00-9189a62cea33+13:2358:x1875954089615744:12345-192.168.206.26@tcp:400:kworker.0 00000100:00100000:2.0:1789049487.684200:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8c6297450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:de93d576-ed8d-4d27-ab00-9189a62cea33+13:2358:x1875954089615744:12345-192.168.206.26@tcp:400:kworker.0 Request processed in 46us (1382us total) trans 0 rc 0/0 00000100:00100000:2.0:1789049487.684207:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.26@tcp, seq: 281 00000100:00080000:3.0:1789049487.685360:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1789049488.095789:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789049489.115076:0:6719:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789049490.140065:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789049490.843169:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789049490.843191:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb8ff3ef480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1875954110622080:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789049490.843265:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789049490.843439:0:6706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954110622080 00000100:00100000:2.0:1789049490.843448:0:6706:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954110622080 00000100:00100000:2.0:1789049490.843516:0:6706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1789049490.843525:0:6706:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8ff3c9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1875954110622080:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789049490.843562:0:6706:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789049490.843614:0:6706:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8ff3c9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1875954110622080:12345-0@lo:13:osp-pre-0-0.0 Request processed in 90us (349us total) trans 0 rc 0/0 00000100:00100000:2.0:1789049490.843622:0:6706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1789049490.843651:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb8ff3ef480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1875954110622080:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1789049490.843697:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000040:00080000:3.0:1789049490.907638:0:11704:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1789049491.163469:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789049491.867284:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb8ff3edc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7ef694ec-1ea0-4f02-800c-d1279b4fdf12:3308:1875954110622208:0@lo:400:kworker.0 00000100:00100000:1.0:1789049491.867426:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb8ff3ef480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3310:1875954110622464:0@lo:400:kworker.0 00000100:00100000:1.0:1789049491.867492:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789049491.867540:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb8ff3c9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1875954110622976:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789049491.867566:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789049491.867592:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789049491.867599:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb8ff3ed180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1875954110622592:0@lo:400:kworker.0 00000100:00100000:1.0:1789049491.867623:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789049491.867656:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb8ff3eca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3309:1875954110622336:0@lo:400:kworker.0 00000100:00100000:1.0:1789049491.867679:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789049491.867697:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb8ff3ec000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3309:1875954110622848:0@lo:400:kworker.0 00000100:00100000:1.0:1789049491.867717:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789049491.867746:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954110622464 00000100:00100000:1.0:1789049491.867753:0:5850:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954110622464 00000100:00100000:1.0:1789049491.867799:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954110622336 00000100:00100000:1.0:1789049491.867803:0:5850:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954110622336 00000100:00100000:1.0:1789049491.867825:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 123 00000100:00100000:1.0:1789049491.867834:0:5850:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8ff3cb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1875954110622464:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789049491.868007:0:5850:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8ff3cb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1875954110622464:12345-0@lo:400:kworker.0 Request processed in 173us (514us total) trans 0 rc 0/0 00000100:00100000:1.0:1789049491.868025:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 123 00000100:00100000:1.0:1789049491.868046:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 124 00000100:00100000:1.0:1789049491.868052:0:5850:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8ff3c8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1875954110622336:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789049491.868088:0:5850:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8ff3c8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1875954110622336:12345-0@lo:400:kworker.0 Request processed in 36us (408us total) trans 0 rc 0/0 00000100:00100000:1.0:1789049491.868094:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 124 00000100:00100000:1.0:1789049491.868117:0:6705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954110622592 00000100:00100000:1.0:1789049491.868121:0:6705:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954110622592 00000100:00100000:1.0:1789049491.868145:0:6705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954110622848 00000100:00100000:1.0:1789049491.868148:0:6705:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954110622848 00000100:00100000:1.0:1789049491.868169:0:6705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1789049491.868176:0:6705:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8ff3cbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3310:x1875954110622592:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789049491.868208:0:6705:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8ff3cbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3310:x1875954110622592:12345-0@lo:400:kworker.0 Request processed in 32us (584us total) trans 0 rc 0/0 00000100:00100000:1.0:1789049491.868214:0:6705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1789049491.868226:0:6705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1789049491.868233:0:6705:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8ff3ca300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3309:x1875954110622848:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789049491.868262:0:6705:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8ff3ca300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3309:x1875954110622848:12345-0@lo:400:kworker.0 Request processed in 30us (544us total) trans 0 rc 0/0 00000100:00100000:1.0:1789049491.868268:0:6705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00080000:1.0:1789049491.868284:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789049491.868289:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789049491.869467:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789049491.869514:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb8ff3edf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3308:1875954110622720:0@lo:400:kworker.0 00000100:00100000:2.0:1789049491.869543:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789049491.869600:0:6706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954110622976 00000100:00100000:2.0:1789049491.869606:0:6706:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954110622976 00000100:00100000:2.0:1789049491.869645:0:6706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1789049491.869652:0:6706:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8ff3ca680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1875954110622976:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1789049491.869682:0:6706:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789049491.869718:0:6706:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8ff3ca680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1875954110622976:12345-0@lo:13:osp-pre-1-0.0 Request processed in 66us (2150us total) trans 0 rc 0/0 00000100:00100000:2.0:1789049491.869725:0:6706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1789049491.869751:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954110622208 00000100:00100000:2.0:1789049491.869755:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954110622208 00000100:00100000:2.0:1789049491.869779:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 282 00000100:00100000:2.0:1789049491.869784:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8c6297c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7ef694ec-1ea0-4f02-800c-d1279b4fdf12+19:3308:x1875954110622208:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789049491.869817:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8c6297c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7ef694ec-1ea0-4f02-800c-d1279b4fdf12+19:3308:x1875954110622208:12345-0@lo:400:kworker.0 Request processed in 32us (354us total) trans 0 rc 0/0 00000100:00100000:2.0:1789049491.869823:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 282 00000100:00100000:2.0:1789049491.869893:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb8ff3edc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7ef694ec-1ea0-4f02-800c-d1279b4fdf12:3308:1875954110622208:0@lo:400:kworker.0 00000100:00100000:2.0:1789049491.869916:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954110622720 00000100:00100000:2.0:1789049491.869920:0:5850:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954110622720 00000100:00100000:1.0:1789049491.872504:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb8ff3eca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3309:1875954110622336:0@lo:400:kworker.0 00010000:00080000:1.0:1789049491.872525:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cb8ff3ec000 x1875954110622848/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789049507 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789049491.872535:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb8ff3ec000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3309:1875954110622848:0@lo:400:kworker.0 00000100:00100000:1.0:1789049491.872595:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb8ff3ed180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1875954110622592:0@lo:400:kworker.0 00000100:00100000:1.0:1789049491.872606:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb8ff3ef480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3310:1875954110622464:0@lo:400:kworker.0 00010000:00080000:1.0:1789049491.872615:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cb8ff3c9880 x1875954110622976/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789049507 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789049491.872631:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb8ff3c9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1875954110622976:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789049491.873526:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 125 00000100:00100000:2.0:1789049491.873538:0:5850:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8ff3ed880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1875954110622720:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789049491.873618:0:5850:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8ff3ed880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1875954110622720:12345-0@lo:400:kworker.0 Request processed in 83us (4073us total) trans 0 rc 0/0 00000100:00100000:2.0:1789049491.873624:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 125 00000100:00100000:2.0:1789049491.873667:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb8ff3edf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3308:1875954110622720:0@lo:400:kworker.0 00000100:00080000:1.0:1789049491.873761:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000001:02000400:3.0:1789049491.980504:0:11867:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1a: Test manual lfs pcc attach with manual HSM restore ========================================================== 10:11:29 (1789049489) 00010000:00010000:2.0:1789049492.191135:0:6719:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789049492.808466:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.26@tcp (source: 12345-192.168.206.26@tcp) 00000100:00100000:3.0:1789049492.808519:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.26@tcp (source: 12345-192.168.206.26@tcp) 00000100:00100000:3.0:1789049492.808570:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.26@tcp (source: 12345-192.168.206.26@tcp) 00000100:00100000:0.0:1789049492.808939:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954089616128 00000100:00100000:0.0:1789049492.808959:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954089616128 00000100:00100000:0.0:1789049492.809020:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.26@tcp, seq: 283 00000100:00100000:0.0:1789049492.809031:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8c6295850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:de93d576-ed8d-4d27-ab00-9189a62cea33+13:2356:x1875954089616128:12345-192.168.206.26@tcp:400:kworker.0 00000100:00100000:0.0:1789049492.809099:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8c6295850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:de93d576-ed8d-4d27-ab00-9189a62cea33+13:2356:x1875954089616128:12345-192.168.206.26@tcp:400:kworker.0 Request processed in 70us (579us total) trans 0 rc 0/0 00000100:00100000:0.0:1789049492.809107:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.26@tcp, seq: 283 00000100:00100000:2.0:1789049492.814307:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954089616256 00000100:00100000:2.0:1789049492.814337:0:5851:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954089616256 00000100:00100000:2.0:1789049492.814422:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954089616384 00000100:00100000:2.0:1789049492.814426:0:5851:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954089616384 00000100:00100000:2.0:1789049492.814461:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.26@tcp, seq: 126 00000100:00100000:2.0:1789049492.814470:0:5851:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8d0ab6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e823b53a-3591-475c-8624-c682227e5c13+5:2356:x1875954089616256:12345-192.168.206.26@tcp:400:kworker.0 00000100:00100000:2.0:1789049492.814555:0:5851:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8d0ab6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e823b53a-3591-475c-8624-c682227e5c13+5:2356:x1875954089616256:12345-192.168.206.26@tcp:400:kworker.0 Request processed in 85us (6100us total) trans 0 rc 0/0 00000100:00080000:0.0:1789049492.814827:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789049492.815021:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.26@tcp, seq: 127 00000100:00100000:0.0:1789049492.815031:0:5852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8d0ab7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:59d63492-f1ee-4aa5-bf8c-853a603b0252+5:2356:x1875954089616384:12345-192.168.206.26@tcp:400:kworker.0 00000100:00100000:0.0:1789049492.815067:0:5852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8d0ab7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:59d63492-f1ee-4aa5-bf8c-853a603b0252+5:2356:x1875954089616384:12345-192.168.206.26@tcp:400:kworker.0 Request processed in 39us (6510us total) trans 0 rc 0/0 00000100:00100000:0.0:1789049492.815074:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.26@tcp, seq: 127 00000100:00100000:2.0:1789049492.815584:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.26@tcp, seq: 126 00010000:00010000:0.0:1789049493.220483:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789049494.032044:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.26@tcp (source: 12345-192.168.206.26@tcp) 00000100:00100000:2.0:1789049494.032131:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954089616512 00000100:00100000:2.0:1789049494.032142:0:5852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954089616512 00000100:00100000:2.0:1789049494.032235:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.26@tcp, seq: 32 00000100:00100000:2.0:1789049494.032246:0:5852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb900a5b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e823b53a-3591-475c-8624-c682227e5c13+5:10221:x1875954089616512:12345-192.168.206.26@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789049494.032267:0:5852:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789049494.032357:0:5852:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6714a00/0xf4f48ce5e1bbefec lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7fc5e358805a3375 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049494.032418:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6715a00/0xf4f48ce5e1bbeff3 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049494.032432:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6715a00/0xf4f48ce5e1bbeff3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049494.032452:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6715a00/0xf4f48ce5e1bbeff3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789049494.032489:0:5852:0:(mdt_handler.c:922:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:2.0:1789049494.032492:0:5852:0:(mdt_handler.c:1587:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1789049494.032527:0:5852:0:(mdt_handler.c:2522:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6715a00/0xf4f48ce5e1bbeff3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049494.032569:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6714a00/0xf4f48ce5e1bbefec lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a3375 expref: 7 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049494.032587:0:5852:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6715a00/0xf4f48ce5e1bbeff3 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a3375 expref: 6 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049494.032596:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8cb8e0130f00) 00010000:00010000:2.0:1789049494.032598:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789049494.032601:0:5852:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cb8d6715a00, rc 0) 00000100:00100000:2.0:1789049494.032668:0:5852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb900a5b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e823b53a-3591-475c-8624-c682227e5c13+6:10221:x1875954089616512:12345-192.168.206.26@tcp:101:lhsmtool_posix.0 Request processed in 424us (633us total) trans 0 rc 0/0 00000100:00100000:2.0:1789049494.032675:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.26@tcp, seq: 32 00000100:00080000:0.0:1789049494.033061:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789049494.046806:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.26@tcp (source: 12345-192.168.206.26@tcp) 00000100:00100000:1.0:1789049494.048491:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954089616640 00000100:00100000:1.0:1789049494.048504:0:5851:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954089616640 00000100:00100000:1.0:1789049494.048576:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.26@tcp, seq: 33 00000100:00100000:1.0:1789049494.048587:0:5851:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb900a1c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e823b53a-3591-475c-8624-c682227e5c13+6:10222:x1875954089616640:12345-192.168.206.26@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1789049494.048608:0:5851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789049494.048628:0:5851:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c146c200/0xf4f48ce5e1bbeffa lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7fc5e358805a337c expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049494.048689:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c146d200/0xf4f48ce5e1bbf001 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049494.048703:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c146d200/0xf4f48ce5e1bbf001 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049494.048715:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c146d200/0xf4f48ce5e1bbf001 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049494.048729:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c146d800/0xf4f48ce5e1bbf008 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049494.048735:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c146d800/0xf4f48ce5e1bbf008 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049494.048756:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c146d800/0xf4f48ce5e1bbf008 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049494.048999:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c146ca00/0xf4f48ce5e1bbf00f lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049494.049008:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c146ca00/0xf4f48ce5e1bbf00f lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049494.049015:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c146ca00/0xf4f48ce5e1bbf00f lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789049494.049040:0:5851:0:(mdt_handler.c:922:mdt_pack_attr2body()) [0x200000002:0x1:0x0]: returning size 16384 00000004:00200000:1.0:1789049494.049044:0:5851:0:(mdt_handler.c:1587:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1789049494.049064:0:5851:0:(mdt_handler.c:2522:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c146ca00/0xf4f48ce5e1bbf00f lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049494.049075:0:5851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c146d200/0xf4f48ce5e1bbf001 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049494.049083:0:5851:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c146d200/0xf4f48ce5e1bbf001 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049494.049090:0:5851:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c146d200/0xf4f48ce5e1bbf001 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049494.049096:0:5851:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cb8c146d200 already unused, calling callback (ffffffffc20ca4f0) 00010000:00010000:1.0:1789049494.049101:0:5851:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c146d200/0xf4f48ce5e1bbf001 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049494.049109:0:5851:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c146d200/0xf4f48ce5e1bbf001 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049494.049128:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8cb8e0130f00) 00010000:00010000:1.0:1789049494.049131:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789049494.049136:0:5851:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c146d200/0xf4f48ce5e1bbf001 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049494.050155:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c146d200/0xf4f48ce5e1bbf001 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049494.050177:0:5851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c146d800/0xf4f48ce5e1bbf008 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049494.050185:0:5851:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c146d800/0xf4f48ce5e1bbf008 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049494.050192:0:5851:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c146d800/0xf4f48ce5e1bbf008 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049494.050199:0:5851:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cb8c146d800 already unused, calling callback (ffffffffc20ca4f0) 00010000:00010000:1.0:1789049494.050202:0:5851:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c146d800/0xf4f48ce5e1bbf008 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049494.050210:0:5851:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c146d800/0xf4f48ce5e1bbf008 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049494.050221:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b979c7a (ffff8cb8c396d600) 00010000:00010000:1.0:1789049494.050224:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789049494.050228:0:5851:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c146d800/0xf4f48ce5e1bbf008 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049494.050233:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c146d800/0xf4f48ce5e1bbf008 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049494.053285:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c146c200/0xf4f48ce5e1bbeffa lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a337c expref: 8 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049494.053327:0:5851:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c146ca00/0xf4f48ce5e1bbf00f lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a337c expref: 7 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049494.053336:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff8cb8c396d700) 00010000:00010000:1.0:1789049494.053338:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1789049494.053341:0:5851:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cb8c146ca00, rc 0) 00000100:00100000:1.0:1789049494.053417:0:5851:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb900a1c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e823b53a-3591-475c-8624-c682227e5c13+7:10222:x1875954089616640:12345-192.168.206.26@tcp:101:lhsmtool_posix.0 Request processed in 4830us (6618us total) trans 0 rc 0/0 00000100:00100000:1.0:1789049494.053427:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.26@tcp, seq: 33 00000100:00100000:1.0:1789049494.065148:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.26@tcp (source: 12345-192.168.206.26@tcp) 00000100:00100000:2.0:1789049494.065322:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954089616896 00000100:00100000:2.0:1789049494.065332:0:5852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954089616896 00000100:00100000:2.0:1789049494.065389:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.26@tcp, seq: 34 00000100:00100000:2.0:1789049494.065398:0:5852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8ff3c9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e823b53a-3591-475c-8624-c682227e5c13+7:10222:x1875954089616896:12345-192.168.206.26@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789049494.065416:0:5852:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789049494.065435:0:5852:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6715200/0xf4f48ce5e1bbf016 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7fc5e358805a3383 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049494.065499:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6714000/0xf4f48ce5e1bbf01d lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049494.065511:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6714000/0xf4f48ce5e1bbf01d lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049494.065522:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6714000/0xf4f48ce5e1bbf01d lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049494.065597:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6715c00/0xf4f48ce5e1bbf024 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049494.065606:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6715c00/0xf4f48ce5e1bbf024 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049494.065612:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6715c00/0xf4f48ce5e1bbf024 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049494.065950:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6715000/0xf4f48ce5e1bbf02b lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049494.065961:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6715000/0xf4f48ce5e1bbf02b lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049494.065969:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6715000/0xf4f48ce5e1bbf02b lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789049494.065979:0:5852:0:(mdt_handler.c:922:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 16384 00010000:00010000:2.0:1789049494.066373:0:5852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6714000/0xf4f48ce5e1bbf01d lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049494.066381:0:5852:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6714000/0xf4f48ce5e1bbf01d lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049494.066387:0:5852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6714000/0xf4f48ce5e1bbf01d lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049494.066393:0:5852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cb8d6714000 already unused, calling callback (ffffffffc20ca4f0) 00010000:00010000:2.0:1789049494.066396:0:5852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6714000/0xf4f48ce5e1bbf01d lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049494.066416:0:5852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6714000/0xf4f48ce5e1bbf01d lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049494.066465:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff8cb8c396d700) 00010000:00010000:2.0:1789049494.066468:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789049494.066473:0:5852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6714000/0xf4f48ce5e1bbf01d lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049494.066480:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6714000/0xf4f48ce5e1bbf01d lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049494.066493:0:5852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6715c00/0xf4f48ce5e1bbf024 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049494.066499:0:5852:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6715c00/0xf4f48ce5e1bbf024 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049494.066504:0:5852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6715c00/0xf4f48ce5e1bbf024 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049494.066509:0:5852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cb8d6715c00 already unused, calling callback (ffffffffc20ca4f0) 00010000:00010000:2.0:1789049494.066511:0:5852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6715c00/0xf4f48ce5e1bbf024 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049494.066516:0:5852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6715c00/0xf4f48ce5e1bbf024 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049494.066523:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff8cb8e0130900) 00010000:00010000:2.0:1789049494.066525:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789049494.066528:0:5852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6715c00/0xf4f48ce5e1bbf024 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049494.066570:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6715c00/0xf4f48ce5e1bbf024 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049494.069023:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6715200/0xf4f48ce5e1bbf016 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a3383 expref: 10 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049494.069049:0:5852:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6715000/0xf4f48ce5e1bbf02b lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a3383 expref: 9 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049494.069057:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8cb8e0130a00) 00010000:00010000:2.0:1789049494.069067:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789049494.069070:0:5852:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cb8d6715000, rc 0) 00000100:00100000:2.0:1789049494.069983:0:5852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8ff3c9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e823b53a-3591-475c-8624-c682227e5c13+9:10222:x1875954089616896:12345-192.168.206.26@tcp:101:lhsmtool_posix.0 Request processed in 4579us (4836us total) trans 4294967309 rc 0/0 00000100:00100000:2.0:1789049494.069993:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.26@tcp, seq: 34 00000100:00100000:2.0:1789049494.080367:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.26@tcp (source: 12345-192.168.206.26@tcp) 00000100:00100000:3.0:1789049494.080703:0:6841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954089617024 00000100:00100000:3.0:1789049494.080724:0:6841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954089617024 00000100:00100000:3.0:1789049494.080780:0:6841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.26@tcp, seq: 35 00000100:00100000:3.0:1789049494.080790:0:6841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8ff3edf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e823b53a-3591-475c-8624-c682227e5c13+9:10222:x1875954089617024:12345-192.168.206.26@tcp:59:lhsmtool_posix.0 00000100:00100000:3.0:1789049494.081150:0:6841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8ff3edf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e823b53a-3591-475c-8624-c682227e5c13+9:10222:x1875954089617024:12345-192.168.206.26@tcp:59:lhsmtool_posix.0 Request processed in 360us (789us total) trans 0 rc 0/0 00000100:00100000:3.0:1789049494.081159:0:6841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.26@tcp, seq: 35 00010000:00010000:2.0:1789049494.235134:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1789049495.003577:0:11704:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1789049495.260898:0:6719:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789049495.975246:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789049495.975268:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb8ff3edc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1875954110623104:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789049495.975330:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789049495.975394:0:6706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954110623104 00000100:00100000:2.0:1789049495.975402:0:6706:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954110623104 00000100:00100000:2.0:1789049495.975461:0:6706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1789049495.975470:0:6706:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8ff3ef100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1875954110623104:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789049495.975504:0:6706:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789049495.975546:0:6706:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8ff3ef100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1875954110623104:12345-0@lo:13:osp-pre-0-0.0 Request processed in 78us (216us total) trans 0 rc 0/0 00000100:00100000:2.0:1789049495.975562:0:6706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00080000:2.0:1789049495.975585:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789049495.975620:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb8ff3edc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1875954110623104:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789049496.196864:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.26@tcp (source: 12345-192.168.206.26@tcp) 00000100:00100000:0.0:1789049496.196902:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954089617152 00000100:00100000:0.0:1789049496.196910:0:5850:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954089617152 00000100:00100000:0.0:1789049496.196986:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.26@tcp, seq: 36 00000100:00100000:0.0:1789049496.196997:0:5850:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb900a58000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e823b53a-3591-475c-8624-c682227e5c13+9:10264:x1875954089617152:12345-192.168.206.26@tcp:101:lfs.0 00010000:00010000:0.0:1789049496.199764:0:5850:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789049496.202582:0:5850:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb7c4c39000/0xf4f48ce5e1bbf039 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7fc5e358805a338a expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049496.202689:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb7c4c39200/0xf4f48ce5e1bbf040 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049496.202703:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cb7c4c39200/0xf4f48ce5e1bbf040 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049496.202716:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb7c4c39200/0xf4f48ce5e1bbf040 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049496.202731:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb7c4c39a00/0xf4f48ce5e1bbf047 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049496.202737:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cb7c4c39a00/0xf4f48ce5e1bbf047 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049496.202744:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb7c4c39a00/0xf4f48ce5e1bbf047 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049496.203108:0:5850:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb7c4c39200/0xf4f48ce5e1bbf040 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049496.203124:0:5850:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cb7c4c39200/0xf4f48ce5e1bbf040 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049496.203131:0:5850:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cb7c4c39200/0xf4f48ce5e1bbf040 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049496.203137:0:5850:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cb7c4c39200 already unused, calling callback (ffffffffc20ca4f0) 00010000:00010000:0.0:1789049496.203141:0:5850:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb7c4c39200/0xf4f48ce5e1bbf040 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049496.203148:0:5850:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb7c4c39200/0xf4f48ce5e1bbf040 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049496.203161:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8cb8e0130f00) 00010000:00010000:0.0:1789049496.203164:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789049496.203168:0:5850:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cb7c4c39200/0xf4f48ce5e1bbf040 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049496.203174:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb7c4c39200/0xf4f48ce5e1bbf040 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049496.203186:0:5850:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb7c4c39a00/0xf4f48ce5e1bbf047 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049496.203192:0:5850:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cb7c4c39a00/0xf4f48ce5e1bbf047 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049496.203197:0:5850:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cb7c4c39a00/0xf4f48ce5e1bbf047 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049496.203202:0:5850:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cb7c4c39a00 already unused, calling callback (ffffffffc20ca4f0) 00010000:00010000:0.0:1789049496.203211:0:5850:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb7c4c39a00/0xf4f48ce5e1bbf047 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049496.203218:0:5850:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb7c4c39a00/0xf4f48ce5e1bbf047 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049496.203227:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff8cb8ce751200) 00010000:00010000:0.0:1789049496.203229:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789049496.203232:0:5850:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cb7c4c39a00/0xf4f48ce5e1bbf047 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049496.203238:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb7c4c39a00/0xf4f48ce5e1bbf047 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049496.203272:0:5850:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb7c4c39000/0xf4f48ce5e1bbf039 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a338a expref: 10 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049496.203282:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8cb8e0130f00) 00010000:00010000:0.0:1789049496.203285:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789049496.203288:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb7c4c39000/0xf4f48ce5e1bbf039 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a338a expref: 10 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049496.203297:0:5850:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cb7c4c39000, rc 0) 00000100:00100000:0.0:1789049496.203378:0:5850:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb900a58000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e823b53a-3591-475c-8624-c682227e5c13+9:10264:x1875954089617152:12345-192.168.206.26@tcp:101:lfs.0 Request processed in 6382us (6519us total) trans 0 rc 301/301 00000100:00100000:0.0:1789049496.203387:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.26@tcp, seq: 36 00000100:00080000:0.0:1789049496.203420:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789049496.210000:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.26@tcp (source: 12345-192.168.206.26@tcp) 00000100:00100000:3.0:1789049496.214310:0:6841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954089617408 00000100:00100000:3.0:1789049496.214324:0:6841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954089617408 00000100:00100000:3.0:1789049496.214381:0:6841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.26@tcp, seq: 37 00000100:00100000:3.0:1789049496.214391:0:6841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb900a58e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e823b53a-3591-475c-8624-c682227e5c13+9:10264:x1875954089617408:12345-192.168.206.26@tcp:36:lfs.0 00010000:00010000:3.0:1789049496.214442:0:6841:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789049496.214467:0:6841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6715a00/0xf4f48ce5e1bbeff3 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a3375 expref: 9 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049496.214485:0:6841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8cb8e0130f00) 00010000:00010000:3.0:1789049496.214495:0:6841:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789049496.214693:0:6841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c6b35800/0xf4f48ce5e1bbf04e lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049496.214706:0:6841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c6b35800/0xf4f48ce5e1bbf04e lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049496.214717:0:6841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c6b35800/0xf4f48ce5e1bbf04e lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049496.214730:0:6841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c6b34e00/0xf4f48ce5e1bbf055 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049496.214748:0:6841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c6b34e00/0xf4f48ce5e1bbf055 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049496.214755:0:6841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c6b34e00/0xf4f48ce5e1bbf055 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6841 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789049496.215597:0:6841:0:(mdt_handler.c:922:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00010000:00010000:3.0:1789049496.215609:0:6841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c6b35800/0xf4f48ce5e1bbf04e lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049496.215616:0:6841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c6b35800/0xf4f48ce5e1bbf04e lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049496.215622:0:6841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c6b35800/0xf4f48ce5e1bbf04e lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049496.215627:0:6841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cb8c6b35800 already unused, calling callback (ffffffffc20ca4f0) 00010000:00010000:3.0:1789049496.215631:0:6841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c6b35800/0xf4f48ce5e1bbf04e lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049496.215637:0:6841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c6b35800/0xf4f48ce5e1bbf04e lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049496.215647:0:6841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8cb8cab67d00) 00010000:00010000:3.0:1789049496.215650:0:6841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789049496.215654:0:6841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c6b35800/0xf4f48ce5e1bbf04e lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049496.215661:0:6841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c6b35800/0xf4f48ce5e1bbf04e lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6841 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789049496.215688:0:6841:0:(mdt_handler.c:4507:mdt_save_lock()) ### save lock request 00000000ac68225a reply state 000000000aeaa675 transno 4294967310 ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c6b34e00/0xf4f48ce5e1bbf055 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6841 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789049496.215697:0:6841:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1789049496.215800:0:6841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb900a58e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e823b53a-3591-475c-8624-c682227e5c13+10:10264:x1875954089617408:12345-192.168.206.26@tcp:36:lfs.0 Request processed in 1409us (5810us total) trans 4294967310 rc 0/0 00000100:00100000:3.0:1789049496.215809:0:6841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.26@tcp, seq: 37 00010000:00010000:2.0:1789049496.220830:0:3294:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c6b34e00/0xf4f48ce5e1bbf055 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049496.220999:0:3294:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c6b34e00/0xf4f48ce5e1bbf055 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049496.221007:0:3294:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c6b34e00/0xf4f48ce5e1bbf055 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049496.221013:0:3294:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cb8c6b34e00 already unused, calling callback (ffffffffc20ca4f0) 00010000:00010000:2.0:1789049496.221018:0:3294:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c6b34e00/0xf4f48ce5e1bbf055 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049496.221025:0:3294:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c6b34e00/0xf4f48ce5e1bbf055 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049496.221040:0:3294:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff8cb8cab67100) 00010000:00010000:2.0:1789049496.221043:0:3294:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789049496.221048:0:3294:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c6b34e00/0xf4f48ce5e1bbf055 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049496.221054:0:3294:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c6b34e00/0xf4f48ce5e1bbf055 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049496.284116:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789049496.337391:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.26@tcp (source: 12345-192.168.206.26@tcp) 00000100:00100000:3.0:1789049496.337493:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954089617536 00000100:00100000:3.0:1789049496.337502:0:5850:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954089617536 00000100:00100000:3.0:1789049496.337557:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.26@tcp, seq: 38 00000100:00100000:3.0:1789049496.337567:0:5850:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb900a58a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e823b53a-3591-475c-8624-c682227e5c13+9:10272:x1875954089617536:12345-192.168.206.26@tcp:101:lctl.0 00010000:00010000:3.0:1789049496.337590:0:5850:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789049496.337651:0:5850:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c6b35800/0xf4f48ce5e1bbf05c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7fc5e358805a3391 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049496.337715:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c6b35e00/0xf4f48ce5e1bbf063 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049496.337728:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c6b35e00/0xf4f48ce5e1bbf063 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049496.337739:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c6b35e00/0xf4f48ce5e1bbf063 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789049496.337772:0:5850:0:(mdt_handler.c:922:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:3.0:1789049496.337776:0:5850:0:(mdt_handler.c:1587:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1789049496.337811:0:5850:0:(mdt_handler.c:2522:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c6b35e00/0xf4f48ce5e1bbf063 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049496.338201:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c6b35800/0xf4f48ce5e1bbf05c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a3391 expref: 11 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049496.338220:0:5850:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c6b35e00/0xf4f48ce5e1bbf063 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a3391 expref: 10 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049496.338229:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8cb8cab67d00) 00010000:00010000:3.0:1789049496.338232:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1789049496.338235:0:5850:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cb8c6b35e00, rc 0) 00000100:00100000:2.0:1789049496.345640:0:5850:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb900a58a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e823b53a-3591-475c-8624-c682227e5c13+10:10272:x1875954089617536:12345-192.168.206.26@tcp:101:lctl.0 Request processed in 8064us (8245us total) trans 0 rc 0/0 00000100:00100000:2.0:1789049496.345653:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.26@tcp, seq: 38 00000100:00100000:3.0:1789049496.437127:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.26@tcp (source: 12345-192.168.206.26@tcp) 00000100:00100000:1.0:1789049496.437235:0:6841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954089617664 00000100:00100000:1.0:1789049496.437246:0:6841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954089617664 00000100:00100000:1.0:1789049496.437310:0:6841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.26@tcp, seq: 39 00000100:00100000:1.0:1789049496.437318:0:6841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb900a1c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e823b53a-3591-475c-8624-c682227e5c13+10:10278:x1875954089617664:12345-192.168.206.26@tcp:101:bash.0 00010000:00010000:1.0:1789049496.437337:0:6841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789049496.437357:0:6841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c146d800/0xf4f48ce5e1bbf06a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7fc5e358805a3398 expref: -99 pid: 6841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049496.437427:0:6841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c146d200/0xf4f48ce5e1bbf071 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049496.437441:0:6841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c146d200/0xf4f48ce5e1bbf071 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049496.437470:0:6841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c146d200/0xf4f48ce5e1bbf071 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049496.437487:0:6841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c146c200/0xf4f48ce5e1bbf078 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049496.437495:0:6841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c146c200/0xf4f48ce5e1bbf078 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049496.437501:0:6841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c146c200/0xf4f48ce5e1bbf078 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049496.437590:0:6841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d776fa00/0xf4f48ce5e1bbf07f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049496.437598:0:6841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d776fa00/0xf4f48ce5e1bbf07f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049496.437604:0:6841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d776fa00/0xf4f48ce5e1bbf07f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6841 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789049496.437631:0:6841:0:(mdt_handler.c:922:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00000004:00200000:1.0:1789049496.437635:0:6841:0:(mdt_handler.c:1587:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1789049496.437684:0:6841:0:(mdt_handler.c:2522:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d776fa00/0xf4f48ce5e1bbf07f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049496.437696:0:6841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c146d200/0xf4f48ce5e1bbf071 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049496.437703:0:6841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c146d200/0xf4f48ce5e1bbf071 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049496.437719:0:6841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c146d200/0xf4f48ce5e1bbf071 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049496.437725:0:6841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cb8c146d200 already unused, calling callback (ffffffffc20ca4f0) 00010000:00010000:1.0:1789049496.437729:0:6841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c146d200/0xf4f48ce5e1bbf071 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049496.437736:0:6841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c146d200/0xf4f48ce5e1bbf071 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049496.437746:0:6841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8cb8cab67d00) 00010000:00010000:1.0:1789049496.437749:0:6841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789049496.437753:0:6841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c146d200/0xf4f48ce5e1bbf071 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049496.437760:0:6841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c146d200/0xf4f48ce5e1bbf071 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049496.437773:0:6841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c146c200/0xf4f48ce5e1bbf078 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049496.437778:0:6841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c146c200/0xf4f48ce5e1bbf078 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049496.437783:0:6841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c146c200/0xf4f48ce5e1bbf078 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049496.437788:0:6841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cb8c146c200 already unused, calling callback (ffffffffc20ca4f0) 00010000:00010000:1.0:1789049496.437790:0:6841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c146c200/0xf4f48ce5e1bbf078 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049496.437806:0:6841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c146c200/0xf4f48ce5e1bbf078 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049496.437814:0:6841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff8cb8c396da00) 00010000:00010000:1.0:1789049496.437816:0:6841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789049496.437819:0:6841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c146c200/0xf4f48ce5e1bbf078 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049496.437825:0:6841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c146c200/0xf4f48ce5e1bbf078 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049496.437912:0:6841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c146d800/0xf4f48ce5e1bbf06a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a3398 expref: 12 pid: 6841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049496.437939:0:6841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d776fa00/0xf4f48ce5e1bbf07f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a3398 expref: 11 pid: 6841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049496.437946:0:6841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8cb8c396df00) 00010000:00010000:1.0:1789049496.437948:0:6841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:1.0:1789049496.437950:0:6841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cb8d776fa00, rc 0) 00000100:00100000:1.0:1789049496.438026:0:6841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb900a1c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e823b53a-3591-475c-8624-c682227e5c13+11:10278:x1875954089617664:12345-192.168.206.26@tcp:101:bash.0 Request processed in 708us (907us total) trans 0 rc 0/0 00000100:00100000:1.0:1789049496.438033:0:6841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.26@tcp, seq: 39 00000100:00100000:0.0:1789049496.442257:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.26@tcp (source: 12345-192.168.206.26@tcp) 00000100:00100000:2.0:1789049496.442394:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954089617920 00000100:00100000:2.0:1789049496.442403:0:5852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954089617920 00000100:00100000:2.0:1789049496.442462:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.26@tcp, seq: 40 00000100:00100000:2.0:1789049496.442472:0:5852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb900a5bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e823b53a-3591-475c-8624-c682227e5c13+11:10278:x1875954089617920:12345-192.168.206.26@tcp:101:bash.0 00010000:00010000:2.0:1789049496.442491:0:5852:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789049496.442510:0:5852:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6714c00/0xf4f48ce5e1bbf086 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7fc5e358805a339f expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049496.442633:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6715a00/0xf4f48ce5e1bbf08d lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049496.442659:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6715a00/0xf4f48ce5e1bbf08d lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049496.442672:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6715a00/0xf4f48ce5e1bbf08d lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049496.442734:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6715800/0xf4f48ce5e1bbf094 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049496.442742:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6715800/0xf4f48ce5e1bbf094 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049496.442749:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6715800/0xf4f48ce5e1bbf094 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1789049496.444271:0:5852:0:(osp_object.c:1667:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x2:0x0], index 1: 0 00010000:00010000:2.0:1789049496.444467:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6714e00/0xf4f48ce5e1bbf09b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049496.444480:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6714e00/0xf4f48ce5e1bbf09b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049496.444499:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6714e00/0xf4f48ce5e1bbf09b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049496.444534:0:5852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6715a00/0xf4f48ce5e1bbf08d lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049496.444541:0:5852:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6715a00/0xf4f48ce5e1bbf08d lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049496.444547:0:5852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6715a00/0xf4f48ce5e1bbf08d lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049496.444552:0:5852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cb8d6715a00 already unused, calling callback (ffffffffc20ca4f0) 00010000:00010000:2.0:1789049496.444556:0:5852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6715a00/0xf4f48ce5e1bbf08d lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049496.444563:0:5852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6715a00/0xf4f48ce5e1bbf08d lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049496.444574:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8cb8c396df00) 00010000:00010000:2.0:1789049496.444576:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789049496.444581:0:5852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6715a00/0xf4f48ce5e1bbf08d lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049496.444587:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6715a00/0xf4f48ce5e1bbf08d lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789049496.444599:0:5852:0:(mdt_handler.c:4507:mdt_save_lock()) ### save lock request 000000007733d0eb reply state 00000000048b7a5c transno 4294967311 ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6715800/0xf4f48ce5e1bbf094 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789049496.444608:0:5852:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1789049496.446169:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6714c00/0xf4f48ce5e1bbf086 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a339f expref: 14 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049496.446201:0:5852:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6714e00/0xf4f48ce5e1bbf09b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a339f expref: 13 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049496.446209:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8cb8e0130000) 00010000:00010000:2.0:1789049496.446212:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789049496.446215:0:5852:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cb8d6714e00, rc 0) 00000100:00100000:2.0:1789049496.446331:0:5852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb900a5bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e823b53a-3591-475c-8624-c682227e5c13+14:10278:x1875954089617920:12345-192.168.206.26@tcp:101:bash.0 Request processed in 3859us (4083us total) trans 4294967311 rc 0/0 00000100:00100000:2.0:1789049496.446339:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.26@tcp, seq: 40 00010000:00010000:1.0:1789049496.451591:0:3295:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6715800/0xf4f48ce5e1bbf094 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049496.451608:0:3295:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6715800/0xf4f48ce5e1bbf094 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049496.451633:0:3295:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6715800/0xf4f48ce5e1bbf094 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049496.451638:0:3295:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cb8d6715800 already unused, calling callback (ffffffffc20ca4f0) 00010000:00010000:1.0:1789049496.451643:0:3295:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6715800/0xf4f48ce5e1bbf094 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049496.451659:0:3295:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6715800/0xf4f48ce5e1bbf094 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049496.451676:0:3295:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8cb8e0130e00) 00010000:00010000:1.0:1789049496.451680:0:3295:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789049496.451685:0:3295:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6715800/0xf4f48ce5e1bbf094 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049496.451691:0:3295:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6715800/0xf4f48ce5e1bbf094 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789049496.460470:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.26@tcp (source: 12345-192.168.206.26@tcp) 00000100:00100000:1.0:1789049496.460897:0:6705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954089618048 00000100:00100000:1.0:1789049496.460908:0:6705:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954089618048 00000100:00100000:1.0:1789049496.460959:0:6705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.26@tcp, seq: 20 00000100:00100000:1.0:1789049496.460967:0:6705:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb900a5a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2354:x1875954089618048:12345-192.168.206.26@tcp:8:bash.0 00010000:00080000:1.0:1789049496.460999:0:6705:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0001: connection from e823b53a-3591-475c-8624-c682227e5c13@192.168.206.26@tcp t0 exp 0000000000000000 cur 322 last 0 00000020:00000080:1.0:1789049496.461028:0:6705:0:(genops.c:1384:class_connect()) connect: client e823b53a-3591-475c-8624-c682227e5c13, cookie 0xf4f48ce5e1bbf0a9 00002000:00100000:1.0:1789049496.461041:0:6705:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli e823b53a-3591-475c-8624-c682227e5c13/ffff8cb8df3d6800 ocd_connect_flags: 0xa046faf2e3640038 ocd_version: 2113a28 ocd_grant: 3407872 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1789049496.461071:0:6705:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:1.0:1789049496.461307:0:6705:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:1.0:1789049496.461348:0:6705:0:(import.c:65:import_set_state_nolock()) ffff8cb8df3d3000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1789049496.462749:0:6705:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb900a5a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e823b53a-3591-475c-8624-c682227e5c13+6:2354:x1875954089618048:12345-192.168.206.26@tcp:8:bash.0 Request processed in 1772us (2277us total) trans 0 rc 0/0 00000100:00100000:1.0:1789049496.462762:0:6705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.26@tcp, seq: 20 00000100:00100000:2.0:1789049496.471635:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.26@tcp (source: 12345-192.168.206.26@tcp) 00000100:00100000:0.0:1789049496.471803:0:6703:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954089618176 00000100:00100000:0.0:1789049496.471813:0:6703:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954089618176 00000100:00100000:0.0:1789049496.471957:0:6703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.26@tcp, seq: 21 00000100:00100000:0.0:1789049496.471967:0:6703:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8ff3edc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e823b53a-3591-475c-8624-c682227e5c13+6:0:x1875954089618176:12345-192.168.206.26@tcp:101:bash.0 00010000:00010000:0.0:1789049496.471984:0:6703:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789049496.472004:0:6703:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f535ea4e/0xf4f48ce5e1bbf0b0 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x7fc5e358805a33a6 expref: -99 pid: 6703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789049496.472029:0:6703:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x2:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1789049496.472045:0:6703:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=322s v=(0 0) 00010000:00010000:0.0:1789049496.472049:0:6703:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789049496.472067:0:6703:0:(ldlm_resource.c:1751:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f535ea4e/0xf4f48ce5e1bbf0b0 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a33a6 expref: 7 pid: 6703 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049496.472087:0:6703:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000f535ea4e/0xf4f48ce5e1bbf0b0 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a33a6 expref: 7 pid: 6703 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049496.472105:0:6703:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cb7c4c39a00, rc 0) 00000100:00100000:0.0:1789049496.472163:0:6703:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8ff3edc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e823b53a-3591-475c-8624-c682227e5c13+7:0:x1875954089618176:12345-192.168.206.26@tcp:101:bash.0 Request processed in 197us (539us total) trans 0 rc 0/0 00000100:00100000:0.0:1789049496.472169:0:6703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.26@tcp, seq: 21 00000100:00080000:2.0:1789049496.475632:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789049496.479956:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.26@tcp (source: 12345-192.168.206.26@tcp) 00000100:00100000:0.0:1789049496.480217:0:10560:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954089618304 00000100:00100000:0.0:1789049496.480228:0:10560:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954089618304 00000100:00100000:0.0:1789049496.480344:0:10560:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.26@tcp, seq: 22 00000100:00100000:0.0:1789049496.480354:0:10560:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8ff3ef800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e823b53a-3591-475c-8624-c682227e5c13+7:10278:x1875954089618304:12345-192.168.206.26@tcp:101:bash.0 00010000:00010000:0.0:1789049496.480386:0:10560:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789049496.480418:0:10560:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000216359a7/0xf4f48ce5e1bbf0b7 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x7fc5e358805a33ad expref: -99 pid: 10560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049496.480450:0:10560:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000f535ea4e/0xf4f48ce5e1bbf0b0 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a33a6 expref: 8 pid: 6703 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049496.480460:0:10560:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789049496.480464:0:10560:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789049496.480470:0:10560:0:(ldlm_resource.c:1751:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000216359a7/0xf4f48ce5e1bbf0b7 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a33ad expref: 8 pid: 10560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049496.480506:0:10560:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000f535ea4e/0xf4f48ce5e1bbf0b0 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a33a6 expref: 8 pid: 6703 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049496.480520:0:10560:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000f535ea4e/0xf4f48ce5e1bbf0b0 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a33a6 expref: 8 pid: 6703 timeout: 422 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789049496.480535:0:10560:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb8f7747800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10560:1875954110623232:192.168.206.26@tcp:104: 00000100:00100000:0.0:1789049496.480630:0:10560:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cb8ce48fc00 going to sleep for 11 seconds 00000100:00100000:0.0:1789049496.491334:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.26@tcp (source: 12345-192.168.206.26@tcp) 00000100:00100000:3.0:1789049496.491433:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954089618432 00000100:00100000:3.0:1789049496.491442:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954089618432 00010000:00010000:3.0:1789049496.491486:0:5837:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000f535ea4e/0xf4f48ce5e1bbf0b0 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a33a6 expref: 9 pid: 6703 timeout: 422 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789049496.491528:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.26@tcp, seq: 35 00000100:00100000:3.0:1789049496.491538:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8f7744a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e823b53a-3591-475c-8624-c682227e5c13+9:2358:x1875954089618432:12345-192.168.206.26@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789049496.491552:0:5837:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789049496.491576:0:5837:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000f535ea4e/0xf4f48ce5e1bbf0b0 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a33a6 expref: 9 pid: 6703 timeout: 422 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049496.491602:0:5837:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000f535ea4e/0xf4f48ce5e1bbf0b0 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a33a6 expref: 9 pid: 6703 timeout: 422 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049496.491628:0:5837:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789049496.491645:0:5837:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789049496.491653:0:5837:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000216359a7/0xf4f48ce5e1bbf0b7 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a33ad expref: 9 pid: 10560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049496.491663:0:5837:0:(ldlm_resource.c:1751:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000216359a7/0xf4f48ce5e1bbf0b7 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a33ad expref: 9 pid: 10560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049496.491701:0:5837:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000216359a7/0xf4f48ce5e1bbf0b7 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a33ad expref: 9 pid: 10560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789049496.491716:0:5837:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb900a1d180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5837:1875954110623360:192.168.206.26@tcp:105: 00000100:00100000:3.0:1789049496.491809:0:5837:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cb7c4e736c0 going to sleep for 11 seconds 00010000:00010000:2.0:1789049496.492328:0:10560:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f535ea4e/0xf4f48ce5e1bbf0b0 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a33a6 expref: 9 pid: 6703 timeout: 422 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789049496.492346:0:10560:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb8f7747800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10560:1875954110623232:192.168.206.26@tcp:104: 00010000:00010000:2.0:1789049496.492368:0:10560:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000216359a7/0xf4f48ce5e1bbf0b7 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a33ad expref: 8 pid: 10560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049496.492379:0:10560:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cb7c4c38000, rc 0) 00000100:00100000:2.0:1789049496.492430:0:10560:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8ff3ef800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e823b53a-3591-475c-8624-c682227e5c13+8:10278:x1875954089618304:12345-192.168.206.26@tcp:101:bash.0 Request processed in 12077us (12482us total) trans 0 rc 0/0 00000100:00100000:2.0:1789049496.492437:0:10560:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.26@tcp, seq: 22 00000100:00100000:0.0:1789049496.500350:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.26@tcp (source: 12345-192.168.206.26@tcp) 00000100:00100000:2.0:1789049496.500501:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954089618688 00000100:00100000:2.0:1789049496.500523:0:5853:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954089618688 00000100:00100000:2.0:1789049496.500591:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.26@tcp, seq: 6 00000100:00100000:2.0:1789049496.500601:0:5853:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8f7744700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e823b53a-3591-475c-8624-c682227e5c13+13:10278:x1875954089618688:12345-192.168.206.26@tcp:35:bash.0 00000001:00080000:2.0:1789049496.500885:0:5853:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967312 00000100:00100000:2.0:1789049496.500997:0:5853:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8f7744700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e823b53a-3591-475c-8624-c682227e5c13+15:10278:x1875954089618688:12345-192.168.206.26@tcp:35:bash.0 Request processed in 396us (655us total) trans 4294967313 rc 0/0 00000100:00100000:2.0:1789049496.501005:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.26@tcp, seq: 6 00000020:00080000:2.0:1789049496.501009:0:5853:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1789049496.501533:0:5837:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb900a1d180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5837:1875954110623360:192.168.206.26@tcp:105: 00010000:00010000:3.0:1789049496.501552:0:5837:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789049496.501599:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8f7744a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e823b53a-3591-475c-8624-c682227e5c13+7:2358:x1875954089618432:12345-192.168.206.26@tcp:103:ldlm_bl.0 Request processed in 10062us (10276us total) trans 0 rc 0/0 00000100:00100000:3.0:1789049496.501608:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.26@tcp, seq: 35 00000100:00100000:0.0:1789049496.591277:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.26@tcp (source: 12345-192.168.206.26@tcp) 00000100:00100000:1.0:1789049496.591368:0:6841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954089618944 00000100:00100000:1.0:1789049496.591379:0:6841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954089618944 00000100:00100000:1.0:1789049496.591447:0:6841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.26@tcp, seq: 41 00000100:00100000:1.0:1789049496.591457:0:6841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8f7745180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e823b53a-3591-475c-8624-c682227e5c13+15:10288:x1875954089618944:12345-192.168.206.26@tcp:101:lfs.0 00010000:00010000:1.0:1789049496.591479:0:6841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789049496.591498:0:6841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d776e200/0xf4f48ce5e1bbf0be lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7fc5e358805a33b4 expref: -99 pid: 6841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789049496.591578:0:6841:0:(mdt_handler.c:922:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00010000:00010000:1.0:1789049496.591684:0:6841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d776e200/0xf4f48ce5e1bbf0be lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a33b4 expref: 17 pid: 6841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049496.591698:0:6841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8cb8cab67d00) 00010000:00010000:1.0:1789049496.591701:0:6841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1789049496.591706:0:6841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d776e200/0xf4f48ce5e1bbf0be lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a33b4 expref: 17 pid: 6841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049496.591722:0:6841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cb8d776e200, rc 0) 00000100:00100000:1.0:1789049496.591785:0:6841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8f7745180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e823b53a-3591-475c-8624-c682227e5c13+16:10288:x1875954089618944:12345-192.168.206.26@tcp:101:lfs.0 Request processed in 329us (528us total) trans 4294967314 rc 301/301 00000100:00100000:1.0:1789049496.591792:0:6841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.26@tcp, seq: 41 00000100:00100000:2.0:1789049496.595183:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.26@tcp (source: 12345-192.168.206.26@tcp) 00000100:00100000:3.0:1789049496.595281:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954089619200 00000100:00100000:3.0:1789049496.595291:0:5853:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954089619200 00000100:00100000:3.0:1789049496.595345:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.26@tcp, seq: 7 00000100:00100000:3.0:1789049496.595355:0:5853:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8ff3eed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e823b53a-3591-475c-8624-c682227e5c13+16:10288:x1875954089619200:12345-192.168.206.26@tcp:35:lfs.0 00000100:00100000:3.0:1789049496.595743:0:5853:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8ff3eed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e823b53a-3591-475c-8624-c682227e5c13+17:10288:x1875954089619200:12345-192.168.206.26@tcp:35:lfs.0 Request processed in 388us (569us total) trans 4294967315 rc 0/0 00000100:00100000:3.0:1789049496.595752:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.26@tcp, seq: 7 00000100:00100000:2.0:1789049496.739298:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.26@tcp (source: 12345-192.168.206.26@tcp) 00000100:00100000:0.0:1789049496.739387:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954089619328 00000100:00100000:0.0:1789049496.739397:0:5850:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954089619328 00000100:00100000:0.0:1789049496.739457:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.26@tcp, seq: 42 00000100:00100000:0.0:1789049496.739482:0:5850:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8ff3ef480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e823b53a-3591-475c-8624-c682227e5c13+17:10294:x1875954089619328:12345-192.168.206.26@tcp:101:lfs.0 00010000:00010000:0.0:1789049496.739506:0:5850:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789049496.739526:0:5850:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb7c4c38800/0xf4f48ce5e1bbf0cc lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7fc5e358805a33bb expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049496.739588:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb7c4c39e00/0xf4f48ce5e1bbf0d3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049496.739602:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cb7c4c39e00/0xf4f48ce5e1bbf0d3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049496.739613:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb7c4c39e00/0xf4f48ce5e1bbf0d3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789049496.739645:0:5850:0:(mdt_handler.c:922:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00000004:00200000:0.0:1789049496.739649:0:5850:0:(mdt_handler.c:1587:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1789049496.739668:0:5850:0:(mdt_handler.c:2522:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8cb7c4c39e00/0xf4f48ce5e1bbf0d3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049496.739693:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb7c4c38800/0xf4f48ce5e1bbf0cc lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a33bb expref: 19 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049496.739710:0:5850:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb7c4c39e00/0xf4f48ce5e1bbf0d3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a33bb expref: 18 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049496.739718:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8cb8c396df00) 00010000:00010000:0.0:1789049496.739721:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1789049496.739724:0:5850:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cb7c4c39e00, rc 0) 00000100:00100000:0.0:1789049496.739787:0:5850:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8ff3ef480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e823b53a-3591-475c-8624-c682227e5c13+18:10294:x1875954089619328:12345-192.168.206.26@tcp:101:lfs.0 Request processed in 308us (497us total) trans 0 rc 0/0 00000100:00100000:0.0:1789049496.739803:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.26@tcp, seq: 42 00000100:00100000:1.0:1789049496.753597:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.26@tcp (source: 12345-192.168.206.26@tcp) 00000100:00100000:3.0:1789049496.753729:0:6841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954089619584 00000100:00100000:3.0:1789049496.753739:0:6841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954089619584 00000100:00100000:3.0:1789049496.753812:0:6841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.26@tcp, seq: 43 00000100:00100000:3.0:1789049496.753822:0:6841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8ff3caa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e823b53a-3591-475c-8624-c682227e5c13+18:10294:x1875954089619584:12345-192.168.206.26@tcp:101:lfs.0 00010000:00010000:3.0:1789049496.753872:0:6841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789049496.753894:0:6841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c6b35800/0xf4f48ce5e1bbf0da lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7fc5e358805a33c2 expref: -99 pid: 6841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049496.753997:0:6841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c6b34000/0xf4f48ce5e1bbf0e1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049496.754030:0:6841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c6b34000/0xf4f48ce5e1bbf0e1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049496.754043:0:6841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c6b34000/0xf4f48ce5e1bbf0e1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6841 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789049496.754054:0:6841:0:(mdt_handler.c:922:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:3.0:1789049496.754178:0:6841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c6b35800/0xf4f48ce5e1bbf0da lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a33c2 expref: 21 pid: 6841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049496.754198:0:6841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c6b34000/0xf4f48ce5e1bbf0e1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a33c2 expref: 20 pid: 6841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049496.754207:0:6841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8cb8e0130000) 00010000:00010000:3.0:1789049496.754209:0:6841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789049496.754214:0:6841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cb8c6b34000, rc 0) 00000100:00100000:3.0:1789049496.754283:0:6841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8ff3caa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e823b53a-3591-475c-8624-c682227e5c13+20:10294:x1875954089619584:12345-192.168.206.26@tcp:101:lfs.0 Request processed in 462us (708us total) trans 4294967316 rc 0/0 00000100:00100000:3.0:1789049496.754291:0:6841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.26@tcp, seq: 43 00000100:00100000:3.0:1789049496.758229:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.26@tcp (source: 12345-192.168.206.26@tcp) 00000100:00100000:0.0:1789049496.758340:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954089619840 00000100:00100000:0.0:1789049496.758349:0:5850:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954089619840 00000100:00100000:0.0:1789049496.758407:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.26@tcp, seq: 44 00000100:00100000:0.0:1789049496.758416:0:5850:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb900a1d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e823b53a-3591-475c-8624-c682227e5c13+20:10294:x1875954089619840:12345-192.168.206.26@tcp:101:lfs.0 00010000:00010000:0.0:1789049496.758439:0:5850:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789049496.758458:0:5850:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb7c4c38800/0xf4f48ce5e1bbf0ef lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7fc5e358805a33c9 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049496.758545:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb7c4c38c00/0xf4f48ce5e1bbf0f6 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049496.758559:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cb7c4c38c00/0xf4f48ce5e1bbf0f6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049496.758572:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb7c4c38c00/0xf4f48ce5e1bbf0f6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789049496.758600:0:5850:0:(mdt_handler.c:922:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:0.0:1789049496.758712:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb7c4c38800/0xf4f48ce5e1bbf0ef lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a33c9 expref: 23 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049496.758729:0:5850:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb7c4c38c00/0xf4f48ce5e1bbf0f6 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a33c9 expref: 22 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049496.758737:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8cb8e0130000) 00010000:00010000:0.0:1789049496.758739:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1789049496.758743:0:5850:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cb7c4c38c00, rc 0) 00000100:00100000:0.0:1789049496.758809:0:5850:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb900a1d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e823b53a-3591-475c-8624-c682227e5c13+22:10294:x1875954089619840:12345-192.168.206.26@tcp:101:lfs.0 Request processed in 394us (588us total) trans 4294967317 rc 0/0 00000100:00100000:0.0:1789049496.758816:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.26@tcp, seq: 44 00000100:00100000:2.0:1789049496.761059:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.26@tcp (source: 12345-192.168.206.26@tcp) 00000100:00100000:1.0:1789049496.761149:0:6720:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954089619968 00000100:00100000:1.0:1789049496.761171:0:6720:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954089619968 00000100:00100000:1.0:1789049496.761227:0:6720:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.26@tcp, seq: 2 00000100:00100000:1.0:1789049496.761237:0:6720:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8ff3ed180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e823b53a-3591-475c-8624-c682227e5c13+22:2355:x1875954089619968:12345-192.168.206.26@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789049496.761252:0:6720:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789049496.761286:0:6720:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c6b34000/0xf4f48ce5e1bbf0e1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a33c2 expref: 22 pid: 6841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049496.761304:0:6720:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8cb8e0130000) 00010000:00010000:1.0:1789049496.761308:0:6720:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789049496.761363:0:6720:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8ff3ed180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e823b53a-3591-475c-8624-c682227e5c13+21:2355:x1875954089619968:12345-192.168.206.26@tcp:103:ldlm_bl.0 Request processed in 127us (314us total) trans 0 rc 0/0 00000100:00100000:1.0:1789049496.761371:0:6720:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.26@tcp, seq: 2 00000100:00100000:1.0:1789049496.768219:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.26@tcp (source: 12345-192.168.206.26@tcp) 00000100:00100000:0.0:1789049496.768450:0:6703:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954089620096 00000100:00100000:0.0:1789049496.768460:0:6703:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954089620096 00000100:00100000:0.0:1789049496.768515:0:6703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.26@tcp, seq: 23 00000100:00100000:0.0:1789049496.768524:0:6703:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8ff3cb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e823b53a-3591-475c-8624-c682227e5c13+7:2358:x1875954089620096:12345-192.168.206.26@tcp:1:lfs.0 00010000:00010000:0.0:1789049496.768566:0:6703:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ea604f9c/0xf4f48ce5e1bbf104 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049496.768598:0:6703:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000216359a7/0xf4f48ce5e1bbf0b7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a33ad expref: 7 pid: 10560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049496.768606:0:6703:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789049496.768611:0:6703:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1789049496.768615:0:6703:0:(ldlm_resource.c:1751:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ea604f9c/0xf4f48ce5e1bbf104 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049496.768648:0:6703:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000216359a7/0xf4f48ce5e1bbf0b7 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a33ad expref: 7 pid: 10560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049496.768662:0:6703:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000216359a7/0xf4f48ce5e1bbf0b7 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a33ad expref: 7 pid: 10560 timeout: 422 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789049496.768676:0:6703:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb8f7747800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6703:1875954110623488:192.168.206.26@tcp:104: 00000100:00100000:0.0:1789049496.768766:0:6703:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cb8ce48fc00 going to sleep for 11 seconds 00000100:00100000:3.0:1789049496.771755:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.26@tcp (source: 12345-192.168.206.26@tcp) 00000100:00100000:0.0:1789049496.771913:0:6703:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb8f7747800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6703:1875954110623488:192.168.206.26@tcp:104: 00010000:00010000:0.0:1789049496.771951:0:6703:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000ea604f9c/0xf4f48ce5e1bbf104 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789049496.775957:0:6708:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954089620224 00000100:00100000:1.0:1789049496.775973:0:6708:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954089620224 00002000:00100000:1.0:1789049496.776025:0:6708:0:(ofd_dev.c:2725:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x2:0x0] (0->12) req@ffff8cb900a1fb80 x1875954089620224/t0(0) o4->e823b53a-3591-475c-8624-c682227e5c13@192.168.206.26@tcp:752/0 lens 504/0 e 0 to 0 dl 1789049507 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789049496.776037:0:6708:0:(ofd_dev.c:2581:ofd_prolong_extent_locks()) Prolong locks for req ffff8cb900a1fb80 with x1875954089620224 ext(0->12) 00010000:00010000:1.0:1789049496.776046:0:6708:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000216359a7/0xf4f48ce5e1bbf0b7 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a33ad expref: 8 pid: 10560 timeout: 422 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049496.776063:0:6708:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000216359a7/0xf4f48ce5e1bbf0b7 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a33ad expref: 8 pid: 10560 timeout: 422 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1789049496.776071:0:6708:0:(ofd_dev.c:2730:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8cb900a1fb80 00000100:00100000:1.0:1789049496.776169:0:6708:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.26@tcp, seq: 0 00000100:00100000:1.0:1789049496.776179:0:6708:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb900a1fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:e823b53a-3591-475c-8624-c682227e5c13+8:2358:x1875954089620224:12345-192.168.206.26@tcp:4:lfs.0 00000001:00100000:0.0:1789049496.826340:0:7663:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of e823b53a-3591-475c-8624-c682227e5c13 00000100:00100000:3.0:1789049496.827150:0:6708:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb900a1fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:e823b53a-3591-475c-8624-c682227e5c13+9:2358:x1875954089620224:12345-192.168.206.26@tcp:4:lfs.0 Request processed in 50965us (55398us total) trans 4294967299 rc 0/0 00000100:00100000:3.0:1789049496.827167:0:6708:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.26@tcp, seq: 0 00002000:00100000:3.0:1789049496.827179:0:6708:0:(ofd_dev.c:2725:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x2:0x0] (0->12) req@ffff8cb900a1fb80 x1875954089620224/t4294967299(0) o4->e823b53a-3591-475c-8624-c682227e5c13@192.168.206.26@tcp:752/0 lens 504/448 e 0 to 0 dl 1789049507 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789049496.827189:0:6708:0:(ofd_dev.c:2581:ofd_prolong_extent_locks()) Prolong locks for req ffff8cb900a1fb80 with x1875954089620224 ext(0->12) 00010000:00010000:3.0:1789049496.827199:0:6708:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000216359a7/0xf4f48ce5e1bbf0b7 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a33ad expref: 9 pid: 10560 timeout: 422 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049496.827217:0:6708:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000216359a7/0xf4f48ce5e1bbf0b7 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a33ad expref: 9 pid: 10560 timeout: 422 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789049496.827225:0:6708:0:(ofd_dev.c:2730:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8cb900a1fb80 00000100:00100000:2.0:1789049496.832398:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.26@tcp (source: 12345-192.168.206.26@tcp) 00000100:00100000:0.0:1789049496.832516:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954089620352 00000100:00100000:0.0:1789049496.832526:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954089620352 00010000:00010000:0.0:1789049496.832562:0:5836:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000216359a7/0xf4f48ce5e1bbf0b7 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a33ad expref: 9 pid: 10560 timeout: 422 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789049496.832601:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.26@tcp, seq: 36 00000100:00100000:0.0:1789049496.832610:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8ff3ec000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e823b53a-3591-475c-8624-c682227e5c13+9:2355:x1875954089620352:12345-192.168.206.26@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789049496.832625:0:5836:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:0.0:1789049496.832641:0:5836:0:(ofd_lvb.c:321:ofd_lvbo_update()) res: [0x280000400:0x2:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:0.0:1789049496.832644:0:5836:0:(ofd_lvb.c:328:ofd_lvbo_update()) res: [0x280000400:0x2:0x0] updating lvb mtime from disk: 0 -> 1789049495815492086 00002000:00010000:0.0:1789049496.832647:0:5836:0:(ofd_lvb.c:334:ofd_lvbo_update()) res: [0x280000400:0x2:0x0] updating lvb atime from disk: 0 -> 1789049496083369579 00002000:00010000:0.0:1789049496.832649:0:5836:0:(ofd_lvb.c:340:ofd_lvbo_update()) res: [0x280000400:0x2:0x0] updating lvb ctime from disk: 0 -> 1789049495815492086 00010000:00010000:0.0:1789049496.832656:0:5836:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000216359a7/0xf4f48ce5e1bbf0b7 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a33ad expref: 9 pid: 10560 timeout: 422 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049496.832669:0:5836:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000216359a7/0xf4f48ce5e1bbf0b7 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a33ad expref: 9 pid: 10560 timeout: 422 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049496.832691:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000216359a7/0xf4f48ce5e1bbf0b7 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a33ad expref: 9 pid: 10560 timeout: 422 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049496.832724:0:5836:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1789049496.832728:0:5836:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1789049496.832735:0:5836:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000ea604f9c/0xf4f48ce5e1bbf104 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049496.832744:0:5836:0:(ldlm_resource.c:1751:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ea604f9c/0xf4f48ce5e1bbf104 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049496.832777:0:5836:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789049496.832826:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8ff3ec000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e823b53a-3591-475c-8624-c682227e5c13+8:2355:x1875954089620352:12345-192.168.206.26@tcp:103:ldlm_bl.0 Request processed in 216us (446us total) trans 0 rc 0/0 00000100:00100000:0.0:1789049496.832833:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.26@tcp, seq: 36 00010000:00010000:2.0:1789049496.833420:0:6703:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000ea604f9c/0xf4f48ce5e1bbf104 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049496.833434:0:6703:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ea604f9c/0xf4f48ce5e1bbf104 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049496.833460:0:6703:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ea604f9c/0xf4f48ce5e1bbf104 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049496.833469:0:6703:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ea604f9c/0xf4f48ce5e1bbf104 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049496.833478:0:6703:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ea604f9c/0xf4f48ce5e1bbf104 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049496.833499:0:6703:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cb7c4c38800 already unused, calling callback (ffffffffc166a8f0) 00010000:00010000:2.0:1789049496.833503:0:6703:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ea604f9c/0xf4f48ce5e1bbf104 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049496.833513:0:6703:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ea604f9c/0xf4f48ce5e1bbf104 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049496.833531:0:6703:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ea604f9c/0xf4f48ce5e1bbf104 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049496.833539:0:6703:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ea604f9c/0xf4f48ce5e1bbf104 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789049496.833603:0:6703:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8ff3cb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e823b53a-3591-475c-8624-c682227e5c13+7:2358:x1875954089620096:12345-192.168.206.26@tcp:1:lfs.0 Request processed in 65079us (65392us total) trans 0 rc 0/0 00000100:00100000:2.0:1789049496.833611:0:6703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.26@tcp, seq: 23 00000100:00100000:2.0:1789049496.837316:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.26@tcp (source: 12345-192.168.206.26@tcp) 00000100:00100000:3.0:1789049496.837404:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954089620608 00000100:00100000:3.0:1789049496.837414:0:5853:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954089620608 00000100:00100000:3.0:1789049496.837465:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.26@tcp, seq: 8 00000100:00100000:3.0:1789049496.837475:0:5853:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8ff3eca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e823b53a-3591-475c-8624-c682227e5c13+21:10294:x1875954089620608:12345-192.168.206.26@tcp:35:lfs.0 00000004:00010000:3.0:1789049496.837532:0:5853:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0x4:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8cb7c4c38c00/0xf4f48ce5e1bbf0f6 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a33c9 expref: 21 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789049496.837797:0:5853:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967318 00000001:00080000:3.0:1789049496.837837:0:5853:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967319 00000001:00080000:3.0:1789049496.838642:0:5853:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967320 00010000:00010000:3.0:1789049496.838698:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c6b35800/0xf4f48ce5e1bbf10b lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049496.838716:0:5853:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6714e00/0xf4f48ce5e1bbf09b lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a339f expref: 25 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049496.838731:0:5853:0:(ldlm_resource.c:1751:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c6b35800/0xf4f48ce5e1bbf10b lrc: 4/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049496.838767:0:5853:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6714e00/0xf4f48ce5e1bbf09b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a339f expref: 25 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049496.838783:0:5853:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6714e00/0xf4f48ce5e1bbf09b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a339f expref: 25 pid: 5852 timeout: 422 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789049496.838798:0:5853:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb900a1f800 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5853:1875954110623616:192.168.206.26@tcp:104: 00000100:00100000:3.0:1789049496.839531:0:5853:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cb7c4e730c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789049496.843982:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.26@tcp (source: 12345-192.168.206.26@tcp) 00000100:00100000:1.0:1789049496.844049:0:6720:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954089620736 00000100:00100000:1.0:1789049496.844058:0:6720:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954089620736 00010000:00010000:1.0:1789049496.844104:0:6720:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6714e00/0xf4f48ce5e1bbf09b lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a339f expref: 26 pid: 5852 timeout: 422 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789049496.844141:0:6720:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.26@tcp, seq: 37 00000100:00100000:1.0:1789049496.844151:0:6720:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8f7747800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e823b53a-3591-475c-8624-c682227e5c13+26:2357:x1875954089620736:12345-192.168.206.26@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789049496.844165:0:6720:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789049496.844172:0:6720:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6714e00/0xf4f48ce5e1bbf09b lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a339f expref: 26 pid: 5852 timeout: 422 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049496.844185:0:6720:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6714e00/0xf4f48ce5e1bbf09b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a339f expref: 26 pid: 5852 timeout: 422 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049496.844209:0:6720:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8cb8e0130000) 00010000:00010000:1.0:1789049496.844215:0:6720:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c6b35800/0xf4f48ce5e1bbf10b lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049496.844225:0:6720:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c6b35800/0xf4f48ce5e1bbf10b lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049496.844232:0:6720:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c6b35800/0xf4f48ce5e1bbf10b lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049496.844250:0:6720:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789049496.844500:0:6720:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8f7747800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e823b53a-3591-475c-8624-c682227e5c13+26:2357:x1875954089620736:12345-192.168.206.26@tcp:103:ldlm_bl.0 Request processed in 348us (525us total) trans 0 rc 0/0 00000100:00100000:1.0:1789049496.844508:0:6720:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.26@tcp, seq: 37 00010000:00010000:3.0:1789049496.844670:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6714e00/0xf4f48ce5e1bbf09b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a339f expref: 25 pid: 5852 timeout: 422 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789049496.844687:0:5853:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb900a1f800 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5853:1875954110623616:192.168.206.26@tcp:104: 00010000:00010000:3.0:1789049496.844708:0:5853:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c6b35800/0xf4f48ce5e1bbf10b lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049496.844717:0:5853:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c6b35800/0xf4f48ce5e1bbf10b lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049496.844723:0:5853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c6b35800/0xf4f48ce5e1bbf10b lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789049496.844832:0:5853:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967321 00000001:00080000:3.0:1789049496.845048:0:5853:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967322 00000100:00100000:3.0:1789049496.845181:0:5853:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb900a1f800 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5853:1875954110623744:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1789049496.845297:0:5853:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789049496.845324:0:5853:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cb7c4e736c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789049496.846119:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954110623744 00000100:00100000:0.0:1789049496.846128:0:5855:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954110623744 00000100:00100000:0.0:1789049496.846193:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1789049496.846202:0:5855:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8c6320000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5853:x1875954110623744:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1789049496.846297:0:5855:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8c6320000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5853:x1875954110623744:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 96us (1000us total) trans 0 rc 0/0 00000100:00100000:0.0:1789049496.846304:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1789049496.846362:0:5853:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb900a1f800 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5853:1875954110623744:0@lo:1000:mdt_rdpg00_000.0 00000100:00080000:1.0:1789049496.846611:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000001:00080000:1.0:1789049496.849837:0:5853:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967323 00000100:00100000:1.0:1789049496.850134:0:5853:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb8ff3c9c00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5853:1875954110623872:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1789049496.850201:0:5853:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789049496.850279:0:5853:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cb8d1a2b180 going to sleep for 11 seconds 00000100:00100000:0.0:1789049496.850383:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954110623872 00000100:00100000:0.0:1789049496.850457:0:5855:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954110623872 00000100:00100000:0.0:1789049496.850538:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1789049496.850548:0:5855:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8ff3c8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5853:x1875954110623872:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1789049496.850740:0:5855:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8ff3c8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5853:x1875954110623872:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 194us (538us total) trans 4294967300 rc 0/0 00000100:00100000:0.0:1789049496.850748:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1789049496.850824:0:5853:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb8ff3c9c00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5853:1875954110623872:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:1.0:1789049496.850908:0:5853:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967324 00010000:00010000:1.0:1789049496.850957:0:5853:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c6b35800/0xf4f48ce5e1bbf10b lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049496.850968:0:5853:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c6b35800/0xf4f48ce5e1bbf10b lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049496.850975:0:5853:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c6b35800/0xf4f48ce5e1bbf10b lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049496.850981:0:5853:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cb8c6b35800 already unused, calling callback (ffffffffc20ca4f0) 00010000:00010000:1.0:1789049496.850986:0:5853:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c6b35800/0xf4f48ce5e1bbf10b lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049496.850994:0:5853:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c6b35800/0xf4f48ce5e1bbf10b lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049496.851009:0:5853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8cb8e0130000) 00010000:00010000:1.0:1789049496.851012:0:5853:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:1.0:1789049496.851017:0:5853:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c6b35800/0xf4f48ce5e1bbf10b lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049496.851024:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c6b35800/0xf4f48ce5e1bbf10b lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1789049496.851202:0:5853:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0x5:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:1.0:1789049496.851571:0:5853:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].2, 64 off8320 00000004:00080000:1.0:1789049496.851584:0:5853:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 322903739779ns, next at 323903737702ns, rc = 0 00000001:00080000:1.0:1789049496.851591:0:5853:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967325 00010000:00010000:1.0:1789049496.851626:0:5853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8cb8e0130000) 00010000:00010000:1.0:1789049496.851629:0:5853:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1789049496.851636:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb7c4c38c00/0xf4f48ce5e1bbf0f6 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a33c9 expref: 29 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789049496.851743:0:5853:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8ff3eca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e823b53a-3591-475c-8624-c682227e5c13+28:10294:x1875954089620608:12345-192.168.206.26@tcp:35:lfs.0 Request processed in 14269us (14437us total) trans 4294967326 rc 0/0 00000100:00100000:1.0:1789049496.851756:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.26@tcp, seq: 8 00000020:00080000:1.0:1789049496.851760:0:5853:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:0.0:1789049496.860279:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.26@tcp (source: 12345-192.168.206.26@tcp) 00000100:00100000:3.0:1789049496.860385:0:6841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954089620864 00000100:00100000:3.0:1789049496.860395:0:6841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954089620864 00000100:00100000:3.0:1789049496.860492:0:6841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.26@tcp, seq: 45 00000100:00100000:3.0:1789049496.860503:0:6841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb900a1f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e823b53a-3591-475c-8624-c682227e5c13+28:10294:x1875954089620864:12345-192.168.206.26@tcp:101:lfs.0 00010000:00010000:3.0:1789049496.860528:0:6841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789049496.860548:0:6841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c6b34000/0xf4f48ce5e1bbf112 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7fc5e358805a33d0 expref: -99 pid: 6841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049496.860605:0:6841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c6b34000/0xf4f48ce5e1bbf112 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a33d0 expref: 29 pid: 6841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049496.860620:0:6841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c6b34000/0xf4f48ce5e1bbf112 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a33d0 expref: 29 pid: 6841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049496.860638:0:6841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8cb8cab67900) 00010000:00010000:3.0:1789049496.860641:0:6841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1789049496.860644:0:6841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cb8c6b34000, rc 0) 00000100:00100000:3.0:1789049496.860703:0:6841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb900a1f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e823b53a-3591-475c-8624-c682227e5c13+29:10294:x1875954089620864:12345-192.168.206.26@tcp:101:lfs.0 Request processed in 201us (433us total) trans 0 rc 0/0 00000100:00100000:3.0:1789049496.860710:0:6841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.26@tcp, seq: 45 00000100:00100000:3.0:1789049496.872417:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.26@tcp (source: 12345-192.168.206.26@tcp) 00000100:00100000:0.0:1789049496.873805:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954089621120 00000100:00100000:0.0:1789049496.873817:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954089621120 00000100:00100000:0.0:1789049496.873889:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.26@tcp, seq: 9 00000100:00100000:0.0:1789049496.873899:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8d1d2c050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e823b53a-3591-475c-8624-c682227e5c13+29:10294:x1875954089621120:12345-192.168.206.26@tcp:35:lfs.0 00000100:00100000:2.0:1789049496.874330:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8d1d2c050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e823b53a-3591-475c-8624-c682227e5c13+30:10294:x1875954089621120:12345-192.168.206.26@tcp:35:lfs.0 Request processed in 431us (1919us total) trans 4294967327 rc 0/0 00000100:00100000:2.0:1789049496.874338:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.26@tcp, seq: 9 00000100:00100000:2.0:1789049496.970060:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.26@tcp (source: 12345-192.168.206.26@tcp) 00000100:00100000:0.0:1789049496.970247:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954089621376 00000100:00100000:0.0:1789049496.970257:0:5850:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954089621376 00000100:00100000:0.0:1789049496.970362:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.26@tcp, seq: 46 00000100:00100000:0.0:1789049496.970374:0:5850:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8ff3eed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e823b53a-3591-475c-8624-c682227e5c13+30:10304:x1875954089621376:12345-192.168.206.26@tcp:101:lfs.0 00010000:00010000:0.0:1789049496.970396:0:5850:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789049496.970417:0:5850:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb7c4c38000/0xf4f48ce5e1bbf119 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7fc5e358805a33d7 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789049496.970504:0:5850:0:(mdt_handler.c:922:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00010000:00010000:0.0:1789049496.970615:0:5850:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb7c4c38000/0xf4f48ce5e1bbf119 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a33d7 expref: 32 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049496.970628:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8cb8cab67d00) 00010000:00010000:0.0:1789049496.970631:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1789049496.970635:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb7c4c38000/0xf4f48ce5e1bbf119 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a33d7 expref: 32 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049496.970649:0:5850:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cb7c4c38000, rc 0) 00000100:00100000:0.0:1789049496.970711:0:5850:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8ff3eed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e823b53a-3591-475c-8624-c682227e5c13+31:10304:x1875954089621376:12345-192.168.206.26@tcp:101:lfs.0 Request processed in 341us (659us total) trans 4294967328 rc 301/301 00000100:00100000:0.0:1789049496.970731:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.26@tcp, seq: 46 00000100:00100000:0.0:1789049496.976261:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.26@tcp (source: 12345-192.168.206.26@tcp) 00000100:00100000:1.0:1789049496.976456:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954089621504 00000100:00100000:1.0:1789049496.976467:0:5851:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954089621504 00000100:00100000:1.0:1789049496.976524:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.26@tcp, seq: 47 00000100:00100000:1.0:1789049496.976534:0:5851:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8df29b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e823b53a-3591-475c-8624-c682227e5c13+31:10304:x1875954089621504:12345-192.168.206.26@tcp:34:lfs.0 00010000:00010000:1.0:1789049496.976605:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d776e200/0xf4f48ce5e1bbf127 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049496.976620:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d776e200/0xf4f48ce5e1bbf127 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049496.976633:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d776e200/0xf4f48ce5e1bbf127 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049496.976647:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c146d800/0xf4f48ce5e1bbf12e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049496.976665:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c146d800/0xf4f48ce5e1bbf12e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049496.976671:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c146d800/0xf4f48ce5e1bbf12e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049496.976758:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c146c200/0xf4f48ce5e1bbf135 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049496.976765:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c146c200/0xf4f48ce5e1bbf135 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049496.976772:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c146c200/0xf4f48ce5e1bbf135 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789049496.976813:0:5851:0:(mdt_handler.c:2522:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c146c200/0xf4f48ce5e1bbf135 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049496.976826:0:5851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d776e200/0xf4f48ce5e1bbf127 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049496.976832:0:5851:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d776e200/0xf4f48ce5e1bbf127 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049496.976838:0:5851:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d776e200/0xf4f48ce5e1bbf127 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049496.976888:0:5851:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cb8d776e200 already unused, calling callback (ffffffffc20ca4f0) 00010000:00010000:1.0:1789049496.976893:0:5851:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d776e200/0xf4f48ce5e1bbf127 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049496.976901:0:5851:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d776e200/0xf4f48ce5e1bbf127 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049496.976927:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8cb8c396df00) 00010000:00010000:1.0:1789049496.976930:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789049496.976935:0:5851:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d776e200/0xf4f48ce5e1bbf127 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049496.976942:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d776e200/0xf4f48ce5e1bbf127 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049496.976956:0:5851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c146d800/0xf4f48ce5e1bbf12e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049496.976962:0:5851:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c146d800/0xf4f48ce5e1bbf12e lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049496.976968:0:5851:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c146d800/0xf4f48ce5e1bbf12e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049496.976973:0:5851:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cb8c146d800 already unused, calling callback (ffffffffc20ca4f0) 00010000:00010000:1.0:1789049496.976976:0:5851:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c146d800/0xf4f48ce5e1bbf12e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049496.976982:0:5851:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c146d800/0xf4f48ce5e1bbf12e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049496.976988:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8cb8c396da00) 00010000:00010000:1.0:1789049496.976990:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789049496.976993:0:5851:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c146d800/0xf4f48ce5e1bbf12e lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049496.976998:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c146d800/0xf4f48ce5e1bbf12e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049496.977021:0:5851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c146c200/0xf4f48ce5e1bbf135 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049496.977028:0:5851:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c146c200/0xf4f48ce5e1bbf135 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049496.977034:0:5851:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c146c200/0xf4f48ce5e1bbf135 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049496.977039:0:5851:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cb8c146c200 already unused, calling callback (ffffffffc20ca4f0) 00010000:00010000:1.0:1789049496.977041:0:5851:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c146c200/0xf4f48ce5e1bbf135 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049496.977047:0:5851:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c146c200/0xf4f48ce5e1bbf135 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049496.977053:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8cb8cab67900) 00010000:00010000:1.0:1789049496.977055:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789049496.977058:0:5851:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c146c200/0xf4f48ce5e1bbf135 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049496.977064:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c146c200/0xf4f48ce5e1bbf135 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789049496.977121:0:5851:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8df29b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e823b53a-3591-475c-8624-c682227e5c13+31:10304:x1875954089621504:12345-192.168.206.26@tcp:34:lfs.0 Request processed in 588us (869us total) trans 0 rc 0/0 00000100:00100000:1.0:1789049496.977128:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.26@tcp, seq: 47 00000100:00100000:3.0:1789049496.980710:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.26@tcp (source: 12345-192.168.206.26@tcp) 00000100:00100000:1.0:1789049496.980827:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954089621760 00000100:00100000:1.0:1789049496.980836:0:5853:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954089621760 00000100:00100000:1.0:1789049496.980963:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.26@tcp, seq: 10 00000100:00100000:1.0:1789049496.980986:0:5853:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8c6323100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e823b53a-3591-475c-8624-c682227e5c13+31:10304:x1875954089621760:12345-192.168.206.26@tcp:35:lfs.0 00000100:00100000:1.0:1789049496.981334:0:5853:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8c6323100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e823b53a-3591-475c-8624-c682227e5c13+32:10304:x1875954089621760:12345-192.168.206.26@tcp:35:lfs.0 Request processed in 348us (631us total) trans 4294967329 rc 0/0 00000100:00100000:1.0:1789049496.981350:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.26@tcp, seq: 10 00000100:00100000:3.0:1789049496.987146:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789049496.987167:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb8ff3c8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3309:1875954110624000:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789049496.987227:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789049496.987382:0:6706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954110624000 00000100:00100000:0.0:1789049496.987399:0:6706:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954110624000 00000100:00100000:0.0:1789049496.987447:0:6706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1789049496.987455:0:6706:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8c6322d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3309:x1875954110624000:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1789049496.987476:0:6706:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 1703936 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789049496.987537:0:6706:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8c6322d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3309:x1875954110624000:12345-0@lo:13:osp-pre-1-0.0 Request processed in 82us (308us total) trans 0 rc 0/0 00000100:00100000:0.0:1789049496.987544:0:6706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1789049496.987672:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb8ff3c8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3309:1875954110624000:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789049496.988445:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb8ff3c8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:7ef694ec-1ea0-4f02-800c-d1279b4fdf12:3309:1875954110624128:0@lo:400:kworker.0 00000100:00100000:3.0:1789049496.988496:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789049496.988595:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb8ff3cb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1875954110624512:0@lo:400:kworker.0 00000100:00100000:2.0:1789049496.988626:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789049496.988657:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb8ff3c9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3310:1875954110624256:0@lo:400:kworker.0 00000100:00100000:2.0:1789049496.988693:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789049496.988711:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789049496.988716:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb8ff3c9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3310:1875954110624384:0@lo:400:kworker.0 00000100:00100000:2.0:1789049496.988734:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789049496.988756:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954110624256 00000100:00100000:2.0:1789049496.988760:0:5852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954110624256 00000100:00100000:2.0:1789049496.988803:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954110624384 00000100:00100000:2.0:1789049496.988806:0:5852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954110624384 00000100:00100000:2.0:1789049496.988830:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00100000:2.0:1789049496.988836:0:5852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8f7744700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1875954110624256:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789049496.988894:0:5852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8f7744700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1875954110624256:12345-0@lo:400:kworker.0 Request processed in 57us (200us total) trans 0 rc 0/0 00000100:00100000:2.0:1789049496.988900:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00000100:00100000:2.0:1789049496.988913:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 129 00000100:00100000:2.0:1789049496.988931:0:5852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8df480700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1875954110624384:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789049496.988956:0:5852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8df480700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1875954110624384:12345-0@lo:400:kworker.0 Request processed in 38us (221us total) trans 0 rc 0/0 00000100:00100000:2.0:1789049496.988960:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 129 00000100:00100000:2.0:1789049496.988989:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb8ff3c9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3310:1875954110624384:0@lo:400:kworker.0 00000100:00100000:2.0:1789049496.988997:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb8ff3c9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3310:1875954110624256:0@lo:400:kworker.0 00000100:00080000:2.0:1789049496.989013:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789049496.989308:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954110624128 00000100:00100000:0.0:1789049496.989313:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954110624128 00000100:00100000:0.0:1789049496.989358:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 284 00000100:00100000:0.0:1789049496.989366:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8c6295050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7ef694ec-1ea0-4f02-800c-d1279b4fdf12+19:3309:x1875954110624128:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789049496.991247:0:6705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954110624512 00000100:00100000:1.0:1789049496.991256:0:6705:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954110624512 00000100:00100000:2.0:1789049496.991561:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789049496.991578:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb8ff3c8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3308:1875954110624640:0@lo:400:kworker.0 00000100:00100000:2.0:1789049496.991637:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789049496.991680:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954110624640 00000100:00100000:2.0:1789049496.991683:0:5852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954110624640 00000100:00100000:2.0:1789049496.991746:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:2.0:1789049496.991754:0:5852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8df482300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1875954110624640:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789049496.991822:0:5852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8df482300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1875954110624640:12345-0@lo:400:kworker.0 Request processed in 68us (184us total) trans 0 rc 0/0 00000100:00100000:2.0:1789049496.991829:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00100000:2.0:1789049496.991891:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb8ff3c8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3308:1875954110624640:0@lo:400:kworker.0 00000100:00080000:2.0:1789049496.991914:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789049496.992257:0:6705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1789049496.992274:0:6705:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8ff3eca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3308:x1875954110624512:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789049496.992331:0:6705:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8ff3eca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3308:x1875954110624512:12345-0@lo:400:kworker.0 Request processed in 67us (3703us total) trans 0 rc 0/0 00000100:00100000:1.0:1789049496.992616:0:6705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1789049496.992658:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb8ff3cb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1875954110624512:0@lo:400:kworker.0 00000100:00100000:0.0:1789049496.992758:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8c6295050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7ef694ec-1ea0-4f02-800c-d1279b4fdf12+19:3309:x1875954110624128:12345-0@lo:400:kworker.0 Request processed in 3391us (4259us total) trans 0 rc 0/0 00000100:00100000:0.0:1789049496.992768:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 284 00000100:00100000:3.0:1789049496.993513:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb8ff3c8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:7ef694ec-1ea0-4f02-800c-d1279b4fdf12:3309:1875954110624128:0@lo:400:kworker.0 00000100:00100000:3.0:1789049497.067561:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.26@tcp (source: 12345-192.168.206.26@tcp) 00000100:00100000:2.0:1789049497.067700:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954089622016 00000100:00100000:2.0:1789049497.067711:0:5851:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954089622016 00000100:00100000:2.0:1789049497.067769:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.26@tcp, seq: 48 00000100:00100000:2.0:1789049497.067778:0:5851:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8c633f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e823b53a-3591-475c-8624-c682227e5c13+32:10307:x1875954089622016:12345-192.168.206.26@tcp:101:lfs.0 00010000:00010000:2.0:1789049497.067799:0:5851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789049497.067819:0:5851:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6715c00/0xf4f48ce5e1bbf13c lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7fc5e358805a33de expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049497.067933:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6715200/0xf4f48ce5e1bbf143 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049497.067948:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6715200/0xf4f48ce5e1bbf143 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049497.067960:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6715200/0xf4f48ce5e1bbf143 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049497.067973:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6714a00/0xf4f48ce5e1bbf14a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049497.067980:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6714a00/0xf4f48ce5e1bbf14a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049497.068004:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6714a00/0xf4f48ce5e1bbf14a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049497.068121:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6715a00/0xf4f48ce5e1bbf151 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049497.068130:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6715a00/0xf4f48ce5e1bbf151 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049497.068138:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6715a00/0xf4f48ce5e1bbf151 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789049497.068148:0:5851:0:(mdt_handler.c:922:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:2.0:1789049497.068238:0:5851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6715200/0xf4f48ce5e1bbf143 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049497.068245:0:5851:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6715200/0xf4f48ce5e1bbf143 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049497.068252:0:5851:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6715200/0xf4f48ce5e1bbf143 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049497.068257:0:5851:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cb8d6715200 already unused, calling callback (ffffffffc20ca4f0) 00010000:00010000:2.0:1789049497.068261:0:5851:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6715200/0xf4f48ce5e1bbf143 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049497.068269:0:5851:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6715200/0xf4f48ce5e1bbf143 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049497.068281:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8cb8c396df00) 00010000:00010000:2.0:1789049497.068284:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789049497.068296:0:5851:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6715200/0xf4f48ce5e1bbf143 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049497.068303:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6715200/0xf4f48ce5e1bbf143 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049497.068316:0:5851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6714a00/0xf4f48ce5e1bbf14a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049497.068323:0:5851:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6714a00/0xf4f48ce5e1bbf14a lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049497.068329:0:5851:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6714a00/0xf4f48ce5e1bbf14a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049497.068334:0:5851:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cb8d6714a00 already unused, calling callback (ffffffffc20ca4f0) 00010000:00010000:2.0:1789049497.068350:0:5851:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6714a00/0xf4f48ce5e1bbf14a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049497.068356:0:5851:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6714a00/0xf4f48ce5e1bbf14a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049497.068364:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8cb8e0130f00) 00010000:00010000:2.0:1789049497.068367:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789049497.068370:0:5851:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6714a00/0xf4f48ce5e1bbf14a lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049497.068376:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6714a00/0xf4f48ce5e1bbf14a lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049497.068418:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6715c00/0xf4f48ce5e1bbf13c lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a33de expref: 35 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049497.068446:0:5851:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6715a00/0xf4f48ce5e1bbf151 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a33de expref: 34 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049497.068454:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8cb8cab67900) 00010000:00010000:2.0:1789049497.068457:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789049497.068459:0:5851:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cb8d6715a00, rc 0) 00000100:00100000:2.0:1789049497.068527:0:5851:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8c633f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e823b53a-3591-475c-8624-c682227e5c13+34:10307:x1875954089622016:12345-192.168.206.26@tcp:101:lfs.0 Request processed in 750us (975us total) trans 4294967330 rc 0/0 00000100:00100000:2.0:1789049497.068534:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.26@tcp, seq: 48 00000100:00100000:0.0:1789049497.073107:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.26@tcp (source: 12345-192.168.206.26@tcp) 00000100:00100000:2.0:1789049497.073331:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954089622144 00000100:00100000:2.0:1789049497.073341:0:5852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954089622144 00000100:00100000:2.0:1789049497.073406:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.26@tcp, seq: 49 00000100:00100000:2.0:1789049497.073416:0:5852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8df298000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e823b53a-3591-475c-8624-c682227e5c13+34:10307:x1875954089622144:12345-192.168.206.26@tcp:54:lfs.0 00010000:00010000:2.0:1789049497.073477:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6714c00/0xf4f48ce5e1bbf15f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049497.073506:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6714c00/0xf4f48ce5e1bbf15f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049497.073519:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6714c00/0xf4f48ce5e1bbf15f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049497.073544:0:5852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6714c00/0xf4f48ce5e1bbf15f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049497.073551:0:5852:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6714c00/0xf4f48ce5e1bbf15f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049497.073576:0:5852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6714c00/0xf4f48ce5e1bbf15f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049497.073594:0:5852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cb8d6714c00 already unused, calling callback (ffffffffc20ca4f0) 00010000:00010000:2.0:1789049497.073598:0:5852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6714c00/0xf4f48ce5e1bbf15f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049497.073606:0:5852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6714c00/0xf4f48ce5e1bbf15f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049497.073618:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8cb8cab67900) 00010000:00010000:2.0:1789049497.073622:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1789049497.073626:0:5852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6714c00/0xf4f48ce5e1bbf15f lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049497.073633:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6714c00/0xf4f48ce5e1bbf15f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789049497.073709:0:5852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8df298000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e823b53a-3591-475c-8624-c682227e5c13+34:10307:x1875954089622144:12345-192.168.206.26@tcp:54:lfs.0 Request processed in 293us (611us total) trans 0 rc 0/0 00000100:00100000:2.0:1789049497.073716:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.26@tcp, seq: 49 00000100:00100000:3.0:1789049497.077835:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.26@tcp (source: 12345-192.168.206.26@tcp) 00000100:00100000:2.0:1789049497.078000:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954089622400 00000100:00100000:2.0:1789049497.078009:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954089622400 00000100:00100000:2.0:1789049497.078066:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.26@tcp, seq: 11 00000100:00100000:2.0:1789049497.078075:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8c633c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e823b53a-3591-475c-8624-c682227e5c13+34:10307:x1875954089622400:12345-192.168.206.26@tcp:35:lfs.0 00000100:00100000:2.0:1789049497.078320:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8c633c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e823b53a-3591-475c-8624-c682227e5c13+35:10307:x1875954089622400:12345-192.168.206.26@tcp:35:lfs.0 Request processed in 245us (493us total) trans 4294967331 rc 0/0 00000100:00100000:2.0:1789049497.078328:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.26@tcp, seq: 11 00010000:00010000:2.0:1789049497.307811:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789049497.430594:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.26@tcp (source: 12345-192.168.206.26@tcp) 00000100:00100000:0.0:1789049497.430685:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954089622656 00000100:00100000:0.0:1789049497.430695:0:5850:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954089622656 00000100:00100000:0.0:1789049497.430757:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.26@tcp, seq: 50 00000100:00100000:0.0:1789049497.430767:0:5850:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8ff3cb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e823b53a-3591-475c-8624-c682227e5c13+35:10338:x1875954089622656:12345-192.168.206.26@tcp:101:cat.0 00010000:00010000:0.0:1789049497.430790:0:5850:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789049497.430811:0:5850:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb7c4c38800/0xf4f48ce5e1bbf166 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7fc5e358805a33e5 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049497.430967:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb7c4c39400/0xf4f48ce5e1bbf16d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049497.430982:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cb7c4c39400/0xf4f48ce5e1bbf16d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049497.430993:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb7c4c39400/0xf4f48ce5e1bbf16d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789049497.431005:0:5850:0:(mdt_handler.c:922:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:0.0:1789049497.431152:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb7c4c38800/0xf4f48ce5e1bbf166 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a33e5 expref: 38 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049497.431170:0:5850:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb7c4c39400/0xf4f48ce5e1bbf16d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a33e5 expref: 37 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049497.431178:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8cb8cab67900) 00010000:00010000:0.0:1789049497.431191:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789049497.431195:0:5850:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cb7c4c39400, rc 0) 00000100:00100000:0.0:1789049497.431255:0:5850:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8ff3cb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e823b53a-3591-475c-8624-c682227e5c13+37:10338:x1875954089622656:12345-192.168.206.26@tcp:101:cat.0 Request processed in 489us (669us total) trans 4294967332 rc 0/0 00000100:00100000:0.0:1789049497.431679:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.26@tcp, seq: 50 00000100:00100000:0.0:1789049497.437435:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.26@tcp (source: 12345-192.168.206.26@tcp) 00000100:00100000:0.0:1789049497.437482:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.26@tcp (source: 12345-192.168.206.26@tcp) 00000100:00100000:3.0:1789049497.437590:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954089623040 00000100:00100000:3.0:1789049497.437600:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954089623040 00000100:00100000:3.0:1789049497.437660:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.26@tcp, seq: 3 00000100:00100000:3.0:1789049497.437670:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8c7def050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e823b53a-3591-475c-8624-c682227e5c13+37:2355:x1875954089623040:12345-192.168.206.26@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789049497.437685:0:5837:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789049497.437707:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb7c4c39400/0xf4f48ce5e1bbf16d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a33e5 expref: 37 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049497.437724:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8cb8cab67900) 00010000:00010000:3.0:1789049497.437729:0:5837:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789049497.437787:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8c7def050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e823b53a-3591-475c-8624-c682227e5c13+36:2355:x1875954089623040:12345-192.168.206.26@tcp:103:ldlm_bl.0 Request processed in 118us (304us total) trans 0 rc 0/0 00000100:00100000:3.0:1789049497.437795:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.26@tcp, seq: 3 00000100:00100000:2.0:1789049497.437938:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954089622912 00000100:00100000:2.0:1789049497.437943:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954089622912 00000100:00100000:2.0:1789049497.437980:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.26@tcp, seq: 12 00000100:00100000:2.0:1789049497.437987:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8df29ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e823b53a-3591-475c-8624-c682227e5c13+36:10338:x1875954089622912:12345-192.168.206.26@tcp:35:cat.0 00000100:00100000:2.0:1789049497.438784:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8df29ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e823b53a-3591-475c-8624-c682227e5c13+37:10338:x1875954089622912:12345-192.168.206.26@tcp:35:cat.0 Request processed in 792us (1353us total) trans 4294967333 rc 0/0 00000100:00100000:2.0:1789049497.438793:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.26@tcp, seq: 12 00000100:00100000:0.0:1789049497.522212:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.26@tcp (source: 12345-192.168.206.26@tcp) 00000100:00100000:2.0:1789049497.522518:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954089623296 00000100:00100000:2.0:1789049497.522528:0:5852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954089623296 00000100:00100000:2.0:1789049497.522585:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.26@tcp, seq: 51 00000100:00100000:2.0:1789049497.522596:0:5852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8df299f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e823b53a-3591-475c-8624-c682227e5c13+37:10344:x1875954089623296:12345-192.168.206.26@tcp:101:dd.0 00010000:00010000:2.0:1789049497.522618:0:5852:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789049497.522621:0:5852:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1789049497.522645:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb7c4c39e00/0xf4f48ce5e1bbf0d3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a33bb expref: 37 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049497.522663:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8cb8c396df00) 00010000:00010000:2.0:1789049497.522668:0:5852:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789049497.522683:0:5852:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6714c00/0xf4f48ce5e1bbf17b lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7fc5e358805a33ec expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049497.522769:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6715c00/0xf4f48ce5e1bbf182 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049497.522782:0:5852:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6715a00/0xf4f48ce5e1bbf151 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a33de expref: 37 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049497.522808:0:5852:0:(ldlm_resource.c:1751:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6715c00/0xf4f48ce5e1bbf182 lrc: 4/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049497.523603:0:5852:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6715a00/0xf4f48ce5e1bbf151 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a33de expref: 37 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049497.523626:0:5852:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6715a00/0xf4f48ce5e1bbf151 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a33de expref: 37 pid: 5851 timeout: 423 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789049497.523640:0:5852:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb8fcf04a80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5852:1875954110624768:192.168.206.26@tcp:104: 00000100:00100000:2.0:1789049497.523729:0:5852:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cb8c9326600 going to sleep for 11 seconds 00000100:00100000:2.0:1789049497.525983:0:5852:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb8fcf04a80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5852:1875954110624768:192.168.206.26@tcp:104: 00010000:00010000:2.0:1789049497.526010:0:5852:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6715c00/0xf4f48ce5e1bbf182 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789049497.526696:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.26@tcp (source: 12345-192.168.206.26@tcp) 00000100:00100000:2.0:1789049497.527245:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954089623424 00000100:00100000:2.0:1789049497.527253:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954089623424 00010000:00010000:2.0:1789049497.527474:0:5835:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6715a00/0xf4f48ce5e1bbf151 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a33de expref: 38 pid: 5851 timeout: 423 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789049497.527570:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.26@tcp, seq: 38 00000100:00100000:2.0:1789049497.527580:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8df299880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e823b53a-3591-475c-8624-c682227e5c13+38:2357:x1875954089623424:12345-192.168.206.26@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789049497.527594:0:5835:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789049497.527600:0:5835:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6715a00/0xf4f48ce5e1bbf151 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a33de expref: 38 pid: 5851 timeout: 423 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049497.527630:0:5835:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6715a00/0xf4f48ce5e1bbf151 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a33de expref: 38 pid: 5851 timeout: 423 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049497.527650:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6715a00/0xf4f48ce5e1bbf151 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a33de expref: 38 pid: 5851 timeout: 423 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049497.527665:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8cb8cab67900) 00010000:00010000:2.0:1789049497.527670:0:5835:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6715c00/0xf4f48ce5e1bbf182 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049497.527678:0:5835:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6715c00/0xf4f48ce5e1bbf182 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049497.527686:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6715c00/0xf4f48ce5e1bbf182 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049497.527719:0:5835:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789049497.527775:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8df299880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e823b53a-3591-475c-8624-c682227e5c13+37:2357:x1875954089623424:12345-192.168.206.26@tcp:103:ldlm_bl.0 Request processed in 196us (1081us total) trans 0 rc 0/0 00000100:00100000:2.0:1789049497.527782:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.26@tcp, seq: 38 00010000:00010000:3.0:1789049497.527836:0:5852:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6715c00/0xf4f48ce5e1bbf182 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049497.527859:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6715c00/0xf4f48ce5e1bbf182 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789049497.527879:0:5852:0:(mdt_handler.c:922:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:3.0:1789049497.528055:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6714c00/0xf4f48ce5e1bbf17b lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a33ec expref: 38 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049497.528078:0:5852:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6715c00/0xf4f48ce5e1bbf182 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a33ec expref: 37 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049497.528085:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8cb8cab67900) 00010000:00010000:3.0:1789049497.528088:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1789049497.528090:0:5852:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cb8d6715c00, rc 0) 00000100:00100000:3.0:1789049497.528128:0:5852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8df299f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e823b53a-3591-475c-8624-c682227e5c13+37:10344:x1875954089623296:12345-192.168.206.26@tcp:101:dd.0 Request processed in 5534us (5924us total) trans 4294967334 rc 0/0 00000100:00100000:3.0:1789049497.528135:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.26@tcp, seq: 51 00000100:00100000:0.0:1789049497.530773:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.26@tcp (source: 12345-192.168.206.26@tcp) 00000100:00100000:2.0:1789049497.531022:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954089623680 00000100:00100000:2.0:1789049497.531032:0:5851:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954089623680 00000100:00100000:2.0:1789049497.531122:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.26@tcp, seq: 52 00000100:00100000:2.0:1789049497.531133:0:5851:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8df29b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e823b53a-3591-475c-8624-c682227e5c13+37:10344:x1875954089623680:12345-192.168.206.26@tcp:36:dd.0 00010000:00010000:2.0:1789049497.531506:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6714a00/0xf4f48ce5e1bbf190 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049497.531522:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6714a00/0xf4f48ce5e1bbf190 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049497.531541:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6714a00/0xf4f48ce5e1bbf190 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789049497.531594:0:5851:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967335 00000004:00010000:2.0:1789049497.531620:0:5851:0:(mdt_handler.c:4507:mdt_save_lock()) ### save lock request 00000000cc9842f2 reply state 00000000540b1e8f transno 4294967336 ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6714a00/0xf4f48ce5e1bbf190 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789049497.531629:0:5851:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1789049497.531722:0:5851:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8df29b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e823b53a-3591-475c-8624-c682227e5c13+40:10344:x1875954089623680:12345-192.168.206.26@tcp:36:dd.0 Request processed in 590us (956us total) trans 4294967336 rc 0/0 00000100:00100000:2.0:1789049497.531729:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.26@tcp, seq: 52 00000020:00080000:2.0:1789049497.531733:0:5851:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1789049497.540508:0:3294:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6714a00/0xf4f48ce5e1bbf190 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049497.540525:0:3294:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6714a00/0xf4f48ce5e1bbf190 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049497.540533:0:3294:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6714a00/0xf4f48ce5e1bbf190 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049497.540539:0:3294:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cb8d6714a00 already unused, calling callback (ffffffffc20ca4f0) 00010000:00010000:2.0:1789049497.540544:0:3294:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6714a00/0xf4f48ce5e1bbf190 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049497.540551:0:3294:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6714a00/0xf4f48ce5e1bbf190 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049497.540568:0:3294:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8cb8cab67900) 00010000:00010000:2.0:1789049497.540571:0:3294:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789049497.540593:0:3294:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6714a00/0xf4f48ce5e1bbf190 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049497.540600:0:3294:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6714a00/0xf4f48ce5e1bbf190 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789049497.929419:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.26@tcp (source: 12345-192.168.206.26@tcp) 00000100:00100000:0.0:1789049497.929464:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.26@tcp (source: 12345-192.168.206.26@tcp) 00000100:00100000:0.0:1789049497.929498:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.26@tcp (source: 12345-192.168.206.26@tcp) 00000100:00100000:0.0:1789049497.929538:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.26@tcp (source: 12345-192.168.206.26@tcp) 00000100:00100000:1.0:1789049497.929560:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954089624064 00000100:00100000:1.0:1789049497.929569:0:6704:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954089624064 00000100:00100000:1.0:1789049497.929632:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.26@tcp, seq: 58 00000100:00100000:1.0:1789049497.929642:0:6704:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8df29a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e823b53a-3591-475c-8624-c682227e5c13+7:2358:x1875954089624064:12345-192.168.206.26@tcp:400:kworker.0 00000100:00100000:1.0:1789049497.929711:0:6704:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8df29a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e823b53a-3591-475c-8624-c682227e5c13+7:2358:x1875954089624064:12345-192.168.206.26@tcp:400:kworker.0 Request processed in 71us (246us total) trans 0 rc 0/0 00000100:00100000:1.0:1789049497.929718:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.26@tcp, seq: 58 00000100:00100000:2.0:1789049497.930000:0:6841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954089623936 00000100:00100000:2.0:1789049497.930006:0:6841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954089623936 00000100:00100000:2.0:1789049497.930048:0:6841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954089624192 00000100:00100000:2.0:1789049497.930052:0:6841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954089624192 00000100:00100000:2.0:1789049497.930082:0:6841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.26@tcp, seq: 131 00000100:00100000:2.0:1789049497.930089:0:6841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8df29bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e823b53a-3591-475c-8624-c682227e5c13+39:2358:x1875954089623936:12345-192.168.206.26@tcp:400:kworker.0 00000100:00100000:2.0:1789049497.930135:0:6841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8df29bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e823b53a-3591-475c-8624-c682227e5c13+39:2358:x1875954089623936:12345-192.168.206.26@tcp:400:kworker.0 Request processed in 46us (635us total) trans 0 rc 0/0 00000100:00100000:2.0:1789049497.930141:0:6841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.26@tcp, seq: 131 00000100:00100000:2.0:1789049497.930153:0:6841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.26@tcp, seq: 132 00000100:00100000:2.0:1789049497.930159:0:6841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8df298380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:59d63492-f1ee-4aa5-bf8c-853a603b0252+5:2358:x1875954089624192:12345-192.168.206.26@tcp:400:kworker.0 00000100:00100000:2.0:1789049497.930187:0:6841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8df298380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:59d63492-f1ee-4aa5-bf8c-853a603b0252+5:2358:x1875954089624192:12345-192.168.206.26@tcp:400:kworker.0 Request processed in 27us (648us total) trans 0 rc 0/0 00000100:00080000:0.0:1789049497.930187:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789049497.930192:0:6841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.26@tcp, seq: 132 00000100:00100000:3.0:1789049497.930767:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954089623808 00000100:00100000:3.0:1789049497.930772:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954089623808 00000100:00100000:3.0:1789049497.930818:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.26@tcp, seq: 285 00000100:00100000:3.0:1789049497.930826:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8c6297850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:de93d576-ed8d-4d27-ab00-9189a62cea33+13:2358:x1875954089623808:12345-192.168.206.26@tcp:400:kworker.0 00000100:00100000:3.0:1789049497.930897:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8c6297850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:de93d576-ed8d-4d27-ab00-9189a62cea33+13:2358:x1875954089623808:12345-192.168.206.26@tcp:400:kworker.0 Request processed in 71us (1487us total) trans 0 rc 0/0 00000100:00100000:3.0:1789049497.930923:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.26@tcp, seq: 285 00000100:00100000:0.0:1789049497.931877:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.26@tcp (source: 12345-192.168.206.26@tcp) 00000100:00100000:3.0:1789049497.932010:0:6841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954089624320 00000100:00100000:3.0:1789049497.932017:0:6841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954089624320 00000100:00100000:3.0:1789049497.932069:0:6841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.26@tcp, seq: 53 00000100:00100000:3.0:1789049497.932079:0:6841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8df29a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e823b53a-3591-475c-8624-c682227e5c13+39:10358:x1875954089624320:12345-192.168.206.26@tcp:101:stat.0 00010000:00010000:3.0:1789049497.932095:0:6841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789049497.932114:0:6841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c6b34e00/0xf4f48ce5e1bbf197 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7fc5e358805a33f3 expref: -99 pid: 6841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049497.932177:0:6841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c6b34200/0xf4f48ce5e1bbf19e lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049497.932204:0:6841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c6b34200/0xf4f48ce5e1bbf19e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049497.932216:0:6841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c6b34200/0xf4f48ce5e1bbf19e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049497.932233:0:6841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c6b35c00/0xf4f48ce5e1bbf1a5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049497.932241:0:6841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c6b35c00/0xf4f48ce5e1bbf1a5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049497.932248:0:6841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c6b35c00/0xf4f48ce5e1bbf1a5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049497.932343:0:6841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c6b35a00/0xf4f48ce5e1bbf1ac lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049497.932355:0:6841:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6715c00/0xf4f48ce5e1bbf182 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a33ec expref: 40 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049497.932363:0:6841:0:(ldlm_resource.c:1751:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c6b35a00/0xf4f48ce5e1bbf1ac lrc: 4/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049497.932407:0:6841:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6715c00/0xf4f48ce5e1bbf182 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a33ec expref: 40 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049497.932421:0:6841:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6715c00/0xf4f48ce5e1bbf182 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a33ec expref: 40 pid: 5852 timeout: 423 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789049497.932444:0:6841:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb8c633e300 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6841:1875954110624896:192.168.206.26@tcp:104: 00000100:00100000:3.0:1789049497.933051:0:6841:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cb7c4e73000 going to sleep for 11 seconds 00000100:00100000:3.0:1789049497.940190:0:6841:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb8c633e300 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6841:1875954110624896:192.168.206.26@tcp:104: 00010000:00010000:3.0:1789049497.940222:0:6841:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c6b35a00/0xf4f48ce5e1bbf1ac lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6841 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789049497.940588:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.26@tcp (source: 12345-192.168.206.26@tcp) 00000100:00100000:2.0:1789049497.941021:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954089624576 00000100:00100000:2.0:1789049497.941028:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954089624576 00000100:00100000:2.0:1789049497.941082:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.26@tcp, seq: 13 00000100:00100000:2.0:1789049497.941092:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8ff3c8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e823b53a-3591-475c-8624-c682227e5c13+41:5595:x1875954089624576:12345-192.168.206.26@tcp:35:ldlm_bl.0 00000100:00100000:2.0:1789049497.941752:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8ff3c8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e823b53a-3591-475c-8624-c682227e5c13+42:5595:x1875954089624576:12345-192.168.206.26@tcp:35:ldlm_bl.0 Request processed in 661us (1165us total) trans 4294967337 rc 0/0 00000100:00100000:2.0:1789049497.941760:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.26@tcp, seq: 13 00000100:00100000:0.0:1789049497.946164:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.26@tcp (source: 12345-192.168.206.26@tcp) 00000100:00100000:3.0:1789049497.946267:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954089624704 00000100:00100000:3.0:1789049497.946277:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954089624704 00010000:00010000:3.0:1789049497.946317:0:5837:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6715c00/0xf4f48ce5e1bbf182 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a33ec expref: 42 pid: 5852 timeout: 423 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789049497.946393:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.26@tcp, seq: 39 00000100:00100000:3.0:1789049497.946402:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8df29aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e823b53a-3591-475c-8624-c682227e5c13+42:2357:x1875954089624704:12345-192.168.206.26@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789049497.946415:0:5837:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789049497.946422:0:5837:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6715c00/0xf4f48ce5e1bbf182 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a33ec expref: 42 pid: 5852 timeout: 423 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049497.946434:0:5837:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6715c00/0xf4f48ce5e1bbf182 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a33ec expref: 42 pid: 5852 timeout: 423 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049497.946468:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6715c00/0xf4f48ce5e1bbf182 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a33ec expref: 42 pid: 5852 timeout: 423 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049497.946484:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8cb8cab67900) 00010000:00010000:3.0:1789049497.946489:0:5837:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c6b35a00/0xf4f48ce5e1bbf1ac lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049497.946510:0:5837:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c6b35a00/0xf4f48ce5e1bbf1ac lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049497.946518:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c6b35a00/0xf4f48ce5e1bbf1ac lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049497.946550:0:5837:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789049497.946679:0:6841:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c6b35a00/0xf4f48ce5e1bbf1ac lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049497.946687:0:6841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c6b35a00/0xf4f48ce5e1bbf1ac lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6841 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789049497.946729:0:6841:0:(mdt_handler.c:922:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:2.0:1789049497.946733:0:6841:0:(mdt_handler.c:1587:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1789049497.946776:0:6841:0:(mdt_handler.c:2522:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c6b35a00/0xf4f48ce5e1bbf1ac lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049497.946788:0:6841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c6b35a00/0xf4f48ce5e1bbf1ac lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049497.946796:0:6841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c6b34200/0xf4f48ce5e1bbf19e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049497.946803:0:6841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c6b34200/0xf4f48ce5e1bbf19e lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049497.946809:0:6841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c6b34200/0xf4f48ce5e1bbf19e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049497.946815:0:6841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cb8c6b34200 already unused, calling callback (ffffffffc20ca4f0) 00010000:00010000:2.0:1789049497.946819:0:6841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c6b34200/0xf4f48ce5e1bbf19e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049497.946825:0:6841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c6b34200/0xf4f48ce5e1bbf19e lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049497.946833:0:6841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8cb8c396df00) 00010000:00010000:2.0:1789049497.946835:0:6841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789049497.946840:0:6841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c6b34200/0xf4f48ce5e1bbf19e lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049497.946876:0:6841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c6b34200/0xf4f48ce5e1bbf19e lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049497.946887:0:6841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c6b35c00/0xf4f48ce5e1bbf1a5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049497.946892:0:6841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c6b35c00/0xf4f48ce5e1bbf1a5 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049497.946898:0:6841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c6b35c00/0xf4f48ce5e1bbf1a5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049497.946903:0:6841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cb8c6b35c00 already unused, calling callback (ffffffffc20ca4f0) 00010000:00010000:2.0:1789049497.946906:0:6841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c6b35c00/0xf4f48ce5e1bbf1a5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049497.946921:0:6841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c6b35c00/0xf4f48ce5e1bbf1a5 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049497.946930:0:6841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8cb8cab67100) 00010000:00010000:2.0:1789049497.946932:0:6841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789049497.946935:0:6841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c6b35c00/0xf4f48ce5e1bbf1a5 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049497.946941:0:6841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c6b35c00/0xf4f48ce5e1bbf1a5 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049497.946973:0:6841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c6b34e00/0xf4f48ce5e1bbf197 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a33f3 expref: 42 pid: 6841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049497.946987:0:6841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c6b35a00/0xf4f48ce5e1bbf1ac lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a33f3 expref: 41 pid: 6841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049497.947001:0:6841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8cb8cab67900) 00010000:00010000:2.0:1789049497.947003:0:6841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789049497.947005:0:6841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cb8c6b35a00, rc 0) 00000100:00100000:3.0:1789049497.947087:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8df29aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e823b53a-3591-475c-8624-c682227e5c13+41:2357:x1875954089624704:12345-192.168.206.26@tcp:103:ldlm_bl.0 Request processed in 685us (930us total) trans 0 rc 0/0 00000100:00100000:3.0:1789049497.947095:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.26@tcp, seq: 39 00000100:00100000:2.0:1789049497.947644:0:6841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8df29a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e823b53a-3591-475c-8624-c682227e5c13+40:10358:x1875954089624320:12345-192.168.206.26@tcp:101:stat.0 Request processed in 15565us (15798us total) trans 0 rc 0/0 00000100:00100000:2.0:1789049497.947652:0:6841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.26@tcp, seq: 53 00000100:00100000:0.0:1789049498.064355:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.26@tcp (source: 12345-192.168.206.26@tcp) 00000100:00100000:3.0:1789049498.064420:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954089624960 00000100:00100000:3.0:1789049498.064431:0:5850:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954089624960 00000100:00080000:0.0:1789049498.064486:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789049498.064503:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.26@tcp, seq: 54 00000100:00100000:3.0:1789049498.064516:0:5850:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8df29b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e823b53a-3591-475c-8624-c682227e5c13+40:10364:x1875954089624960:12345-192.168.206.26@tcp:36:truncate.0 00010000:00010000:3.0:1789049498.064570:0:5850:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789049498.064598:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c6b35a00/0xf4f48ce5e1bbf1ac lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a33f3 expref: 40 pid: 6841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049498.064616:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8cb8cab67900) 00010000:00010000:3.0:1789049498.064622:0:5850:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789049498.064993:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c6b35400/0xf4f48ce5e1bbf1b3 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049498.065007:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c6b35400/0xf4f48ce5e1bbf1b3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049498.065016:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c6b35400/0xf4f48ce5e1bbf1b3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789049498.065088:0:5850:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967338 00000004:00010000:3.0:1789049498.065113:0:5850:0:(mdt_handler.c:4507:mdt_save_lock()) ### save lock request 000000007dd15b55 reply state 00000000ba6b19a6 transno 4294967339 ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c6b35400/0xf4f48ce5e1bbf1b3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789049498.065121:0:5850:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1789049498.065245:0:5850:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8df29b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e823b53a-3591-475c-8624-c682227e5c13+42:10364:x1875954089624960:12345-192.168.206.26@tcp:36:truncate.0 Request processed in 732us (897us total) trans 4294967339 rc 0/0 00000100:00100000:3.0:1789049498.065253:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.26@tcp, seq: 54 00000020:00080000:3.0:1789049498.065258:0:5850:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1789049498.069743:0:3295:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c6b35400/0xf4f48ce5e1bbf1b3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049498.069760:0:3295:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c6b35400/0xf4f48ce5e1bbf1b3 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049498.069769:0:3295:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c6b35400/0xf4f48ce5e1bbf1b3 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049498.069775:0:3295:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cb8c6b35400 already unused, calling callback (ffffffffc20ca4f0) 00010000:00010000:0.0:1789049498.069779:0:3295:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c6b35400/0xf4f48ce5e1bbf1b3 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049498.069786:0:3295:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c6b35400/0xf4f48ce5e1bbf1b3 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049498.069802:0:3295:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8cb8cab67900) 00010000:00010000:0.0:1789049498.069805:0:3295:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789049498.069809:0:3295:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c6b35400/0xf4f48ce5e1bbf1b3 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049498.069816:0:3295:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c6b35400/0xf4f48ce5e1bbf1b3 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789049498.074357:0:5872:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967332 is committed 00000004:00080000:2.0:1789049498.074397:0:5872:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2 committed 00000020:00080000:2.0:1789049498.074423:0:5872:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8cb8c6b2aa80 refcount 2 committed 0 result 0 batchid 1 00000020:00080000:2.0:1789049498.074428:0:5872:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8cb8c7bbd200 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8cb8c6b2a540 00000020:00080000:2.0:1789049498.074432:0:5872:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8cb8c7bbd100 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8cb8ff350400 00000001:00080000:2.0:1789049498.074462:0:5872:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967337 is committed 00000100:00100000:0.0:1789049498.074609:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1789049498.074631:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb8ff3c8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3311:1875954110625024:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1789049498.074714:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789049498.074871:0:6705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954110625024 00000100:00100000:1.0:1789049498.074880:0:6705:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954110625024 00000100:00100000:1.0:1789049498.074941:0:6705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1789049498.074952:0:6705:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8df299c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3311:x1875954110625024:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:1.0:1789049498.074992:0:6705:0:(ofd_dev.c:1868:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:2 count 1 00002000:00010000:1.0:1789049498.075027:0:6705:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x2:0x0] initial LVB size: 13, mtime: 0x18d3fb09a3ac91f6, atime: 0x18d3fb09b3a40e6b, ctime: 0x18d3fb09a3ac91f6, blocks: 0x1 00010000:00010000:1.0:1789049498.075035:0:6705:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f0b5c0b0/0xf4f48ce5e1bbf1ba lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049498.075050:0:6705:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=324s v=(0 0) 00010000:00010000:1.0:1789049498.075054:0:6705:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789049498.075060:0:6705:0:(ldlm_resource.c:1751:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f0b5c0b0/0xf4f48ce5e1bbf1ba lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049498.075077:0:6705:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f0b5c0b0/0xf4f48ce5e1bbf1ba lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049498.075087:0:6705:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f0b5c0b0/0xf4f48ce5e1bbf1ba lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049498.075094:0:6705:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f0b5c0b0/0xf4f48ce5e1bbf1ba lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049498.075109:0:6705:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00080000:0.0:1789049498.075322:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:0.0:1789049498.075334:0:6719:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789049498.075340:0:6719:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f0b5c0b0/0xf4f48ce5e1bbf1ba lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049498.075348:0:6719:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cb8c146d800 already unused, calling callback (ffffffffc166a8f0) 00010000:00010000:0.0:1789049498.075353:0:6719:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f0b5c0b0/0xf4f48ce5e1bbf1ba lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049498.075363:0:6719:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f0b5c0b0/0xf4f48ce5e1bbf1ba lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049498.075380:0:6719:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f0b5c0b0/0xf4f48ce5e1bbf1ba lrc: 1/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049498.075389:0:6719:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f0b5c0b0/0xf4f48ce5e1bbf1ba lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049498.075411:0:6719:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789049498.075413:0:6719:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789049498.075415:0:6719:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:3.0:1789049498.075817:0:5883:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 1 committed batchid 0 00000020:00080000:3.0:1789049498.075927:0:5883:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 0 00000100:00100000:1.0:1789049498.076482:0:6705:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8df299c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3311:x1875954110625024:12345-0@lo:6:osp-syn-1-0.0 Request processed in 1529us (1776us total) trans 4294967301 rc 0/0 00000100:00100000:1.0:1789049498.076491:0:6705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000004:00080000:0.0:1789049498.082886:0:3311:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8cb8ff3c8000/2, rc 0, transno 4294967301 00000100:00100000:0.0:1789049498.082902:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb8ff3c8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3311:1875954110625024:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1789049498.311543:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.26@tcp (source: 12345-192.168.206.26@tcp) 00000100:00100000:1.0:1789049498.311822:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954089625088 00000100:00100000:1.0:1789049498.311832:0:5851:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954089625088 00000100:00100000:1.0:1789049498.313125:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.26@tcp, seq: 55 00000100:00100000:1.0:1789049498.313144:0:5851:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8df298a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e823b53a-3591-475c-8624-c682227e5c13+12:10378:x1875954089625088:12345-192.168.206.26@tcp:101:stat.0 00010000:00010000:1.0:1789049498.313186:0:5851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789049498.313207:0:5851:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c146c200/0xf4f48ce5e1bbf1c1 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7fc5e358805a33fa expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049498.313283:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c146d800/0xf4f48ce5e1bbf1c8 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049498.313297:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c146d800/0xf4f48ce5e1bbf1c8 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049498.313308:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c146d800/0xf4f48ce5e1bbf1c8 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049498.313322:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c146d200/0xf4f48ce5e1bbf1cf lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049498.313341:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c146d200/0xf4f48ce5e1bbf1cf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049498.313347:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c146d200/0xf4f48ce5e1bbf1cf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049498.313661:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d776e200/0xf4f48ce5e1bbf1d6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049498.313670:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d776e200/0xf4f48ce5e1bbf1d6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049498.313677:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d776e200/0xf4f48ce5e1bbf1d6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789049498.313725:0:5851:0:(mdt_handler.c:922:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 1234567 00000004:00200000:1.0:1789049498.313736:0:5851:0:(mdt_handler.c:1587:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1789049498.313763:0:5851:0:(mdt_handler.c:2522:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d776e200/0xf4f48ce5e1bbf1d6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049498.313776:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d776e200/0xf4f48ce5e1bbf1d6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049498.313784:0:5851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c146d800/0xf4f48ce5e1bbf1c8 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049498.313791:0:5851:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c146d800/0xf4f48ce5e1bbf1c8 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049498.313798:0:5851:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c146d800/0xf4f48ce5e1bbf1c8 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049498.313803:0:5851:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cb8c146d800 already unused, calling callback (ffffffffc20ca4f0) 00010000:00010000:1.0:1789049498.313807:0:5851:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c146d800/0xf4f48ce5e1bbf1c8 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049498.313815:0:5851:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c146d800/0xf4f48ce5e1bbf1c8 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049498.313825:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8cb8c396df00) 00010000:00010000:1.0:1789049498.313829:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789049498.313833:0:5851:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c146d800/0xf4f48ce5e1bbf1c8 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049498.313839:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c146d800/0xf4f48ce5e1bbf1c8 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049498.313875:0:5851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c146d200/0xf4f48ce5e1bbf1cf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049498.313888:0:5851:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c146d200/0xf4f48ce5e1bbf1cf lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049498.313894:0:5851:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c146d200/0xf4f48ce5e1bbf1cf lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049498.313899:0:5851:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cb8c146d200 already unused, calling callback (ffffffffc20ca4f0) 00010000:00010000:1.0:1789049498.313902:0:5851:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c146d200/0xf4f48ce5e1bbf1cf lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049498.313908:0:5851:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c146d200/0xf4f48ce5e1bbf1cf lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049498.313927:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8cb8c396d900) 00010000:00010000:1.0:1789049498.313929:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789049498.313932:0:5851:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c146d200/0xf4f48ce5e1bbf1cf lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049498.313938:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c146d200/0xf4f48ce5e1bbf1cf lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049498.313971:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c146c200/0xf4f48ce5e1bbf1c1 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a33fa expref: 14 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049498.313986:0:5851:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d776e200/0xf4f48ce5e1bbf1d6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a33fa expref: 13 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049498.313992:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8cb8cab67900) 00010000:00010000:1.0:1789049498.313994:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789049498.314004:0:5851:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cb8d776e200, rc 0) 00000100:00100000:1.0:1789049498.314075:0:5851:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8df298a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e823b53a-3591-475c-8624-c682227e5c13+13:10378:x1875954089625088:12345-192.168.206.26@tcp:101:stat.0 Request processed in 938us (2544us total) trans 0 rc 0/0 00000100:00100000:1.0:1789049498.314084:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.26@tcp, seq: 55 00010000:00010000:0.0:1789049498.331112:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789049498.427698:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.26@tcp (source: 12345-192.168.206.26@tcp) 00000100:00100000:3.0:1789049498.427875:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954089625344 00000100:00100000:3.0:1789049498.427884:0:5850:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954089625344 00000100:00100000:3.0:1789049498.427955:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.26@tcp, seq: 56 00000100:00100000:3.0:1789049498.427965:0:5850:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8ff3c9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e823b53a-3591-475c-8624-c682227e5c13+13:10388:x1875954089625344:12345-192.168.206.26@tcp:101:lfs.0 00010000:00010000:3.0:1789049498.427985:0:5850:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789049498.428003:0:5850:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c6b35a00/0xf4f48ce5e1bbf1dd lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7fc5e358805a3401 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789049498.428084:0:5850:0:(mdt_handler.c:922:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00010000:00010000:3.0:1789049498.428188:0:5850:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c6b35a00/0xf4f48ce5e1bbf1dd lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a3401 expref: 15 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049498.428200:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8cb8cab67d00) 00010000:00010000:3.0:1789049498.428203:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1789049498.428208:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c6b35a00/0xf4f48ce5e1bbf1dd lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a3401 expref: 15 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049498.428248:0:5850:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cb8c6b35a00, rc 0) 00000100:00100000:3.0:1789049498.428491:0:5850:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8ff3c9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e823b53a-3591-475c-8624-c682227e5c13+14:10388:x1875954089625344:12345-192.168.206.26@tcp:101:lfs.0 Request processed in 525us (799us total) trans 4294967340 rc 301/301 00000100:00100000:3.0:1789049498.428499:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.26@tcp, seq: 56 00000100:00100000:0.0:1789049498.432679:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.26@tcp (source: 12345-192.168.206.26@tcp) 00000100:00100000:3.0:1789049498.432899:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954089625600 00000100:00100000:3.0:1789049498.432919:0:5853:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954089625600 00000100:00100000:3.0:1789049498.432978:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.26@tcp, seq: 14 00000100:00100000:3.0:1789049498.432988:0:5853:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8df298e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e823b53a-3591-475c-8624-c682227e5c13+14:10388:x1875954089625600:12345-192.168.206.26@tcp:35:lfs.0 00000100:00100000:3.0:1789049498.433198:0:5853:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8df298e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e823b53a-3591-475c-8624-c682227e5c13+15:10388:x1875954089625600:12345-192.168.206.26@tcp:35:lfs.0 Request processed in 211us (529us total) trans 4294967341 rc 0/0 00000100:00100000:3.0:1789049498.433205:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.26@tcp, seq: 14 00000100:00100000:1.0:1789049498.544591:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.26@tcp (source: 12345-192.168.206.26@tcp) 00000100:00100000:2.0:1789049498.544968:0:6841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954089625856 00000100:00100000:2.0:1789049498.544978:0:6841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954089625856 00000100:00100000:2.0:1789049498.545032:0:6841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.26@tcp, seq: 57 00000100:00100000:2.0:1789049498.545040:0:6841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8ff3c9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e823b53a-3591-475c-8624-c682227e5c13+15:10394:x1875954089625856:12345-192.168.206.26@tcp:101:bash.0 00010000:00010000:2.0:1789049498.545061:0:6841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789049498.545079:0:6841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6714a00/0xf4f48ce5e1bbf1eb lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7fc5e358805a3408 expref: -99 pid: 6841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049498.545161:0:6841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6715a00/0xf4f48ce5e1bbf1f2 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049498.545175:0:6841:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d776e200/0xf4f48ce5e1bbf1d6 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a33fa expref: 16 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049498.545201:0:6841:0:(ldlm_resource.c:1751:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6715a00/0xf4f48ce5e1bbf1f2 lrc: 4/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049498.545229:0:6841:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d776e200/0xf4f48ce5e1bbf1d6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a33fa expref: 16 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049498.545241:0:6841:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d776e200/0xf4f48ce5e1bbf1d6 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a33fa expref: 16 pid: 5851 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789049498.545253:0:6841:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb8fcf04a80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6841:1875954110625152:192.168.206.26@tcp:104: 00000100:00100000:2.0:1789049498.545346:0:6841:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cb8c783ecc0 going to sleep for 11 seconds 00000100:00100000:1.0:1789049498.548998:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.26@tcp (source: 12345-192.168.206.26@tcp) 00000100:00100000:0.0:1789049498.549079:0:6720:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954089625984 00000100:00100000:0.0:1789049498.549088:0:6720:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954089625984 00010000:00010000:0.0:1789049498.549129:0:6720:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d776e200/0xf4f48ce5e1bbf1d6 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a33fa expref: 17 pid: 5851 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789049498.549171:0:6720:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.26@tcp, seq: 40 00000100:00100000:0.0:1789049498.549180:0:6720:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8ff3c8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e823b53a-3591-475c-8624-c682227e5c13+17:2358:x1875954089625984:12345-192.168.206.26@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789049498.549195:0:6720:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789049498.549202:0:6720:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d776e200/0xf4f48ce5e1bbf1d6 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a33fa expref: 17 pid: 5851 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049498.549215:0:6720:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d776e200/0xf4f48ce5e1bbf1d6 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a33fa expref: 17 pid: 5851 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049498.549235:0:6720:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8cb8cab67900) 00010000:00010000:0.0:1789049498.549241:0:6720:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6715a00/0xf4f48ce5e1bbf1f2 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049498.549250:0:6720:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6715a00/0xf4f48ce5e1bbf1f2 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049498.549258:0:6720:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6715a00/0xf4f48ce5e1bbf1f2 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049498.549283:0:6720:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789049498.549348:0:6720:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8ff3c8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e823b53a-3591-475c-8624-c682227e5c13+17:2358:x1875954089625984:12345-192.168.206.26@tcp:103:ldlm_bl.0 Request processed in 168us (357us total) trans 0 rc 0/0 00000100:00100000:0.0:1789049498.549369:0:6720:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.26@tcp, seq: 40 00010000:00010000:2.0:1789049498.550069:0:6841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d776e200/0xf4f48ce5e1bbf1d6 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a33fa expref: 16 pid: 5851 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789049498.550087:0:6841:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb8fcf04a80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6841:1875954110625152:192.168.206.26@tcp:104: 00010000:00010000:2.0:1789049498.550106:0:6841:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6715a00/0xf4f48ce5e1bbf1f2 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049498.550114:0:6841:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6715a00/0xf4f48ce5e1bbf1f2 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049498.550120:0:6841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6715a00/0xf4f48ce5e1bbf1f2 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6841 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789049498.550138:0:6841:0:(mdt_handler.c:922:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 1234567 00010000:00010000:2.0:1789049498.550284:0:6841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6714a00/0xf4f48ce5e1bbf1eb lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a3408 expref: 17 pid: 6841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049498.550314:0:6841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6715a00/0xf4f48ce5e1bbf1f2 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a3408 expref: 16 pid: 6841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049498.550322:0:6841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8cb8cab67900) 00010000:00010000:2.0:1789049498.550324:0:6841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1789049498.550327:0:6841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cb8d6715a00, rc 0) 00000100:00100000:2.0:1789049498.550600:0:6841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8ff3c9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e823b53a-3591-475c-8624-c682227e5c13+16:10394:x1875954089625856:12345-192.168.206.26@tcp:101:bash.0 Request processed in 5559us (6021us total) trans 4294967342 rc 0/0 00000100:00100000:2.0:1789049498.550609:0:6841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.26@tcp, seq: 57 00000100:00100000:1.0:1789049498.573053:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.26@tcp (source: 12345-192.168.206.26@tcp) 00000100:00100000:3.0:1789049498.573174:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954089626240 00000100:00100000:3.0:1789049498.573184:0:5850:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954089626240 00000100:00100000:3.0:1789049498.573237:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.26@tcp, seq: 58 00000100:00100000:3.0:1789049498.573247:0:5850:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8ff3cad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e823b53a-3591-475c-8624-c682227e5c13+16:10394:x1875954089626240:12345-192.168.206.26@tcp:36:bash.0 00010000:00010000:3.0:1789049498.573491:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c6b35a00/0xf4f48ce5e1bbf200 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049498.573510:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c6b35a00/0xf4f48ce5e1bbf200 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049498.573522:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c6b35a00/0xf4f48ce5e1bbf200 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789049498.573574:0:5850:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967343 00000004:00010000:3.0:1789049498.573599:0:5850:0:(mdt_handler.c:4507:mdt_save_lock()) ### save lock request 0000000046b41d84 reply state 0000000063a39712 transno 4294967344 ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c6b35a00/0xf4f48ce5e1bbf200 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789049498.573621:0:5850:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1789049498.573898:0:5850:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8ff3cad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e823b53a-3591-475c-8624-c682227e5c13+19:10394:x1875954089626240:12345-192.168.206.26@tcp:36:bash.0 Request processed in 652us (854us total) trans 4294967344 rc 0/0 00000100:00100000:3.0:1789049498.573907:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.26@tcp, seq: 58 00000020:00080000:3.0:1789049498.573922:0:5850:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1789049498.580395:0:3294:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c6b35a00/0xf4f48ce5e1bbf200 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049498.580411:0:3294:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c6b35a00/0xf4f48ce5e1bbf200 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049498.580420:0:3294:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c6b35a00/0xf4f48ce5e1bbf200 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049498.580426:0:3294:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cb8c6b35a00 already unused, calling callback (ffffffffc20ca4f0) 00010000:00010000:2.0:1789049498.580430:0:3294:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c6b35a00/0xf4f48ce5e1bbf200 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049498.580437:0:3294:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c6b35a00/0xf4f48ce5e1bbf200 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049498.580452:0:3294:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8cb8cab67900) 00010000:00010000:2.0:1789049498.580638:0:3294:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789049498.580646:0:3294:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c6b35a00/0xf4f48ce5e1bbf200 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049498.580668:0:3294:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c6b35a00/0xf4f48ce5e1bbf200 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789049498.586761:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.26@tcp (source: 12345-192.168.206.26@tcp) 00000100:00100000:2.0:1789049498.586932:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954089626368 00000100:00100000:2.0:1789049498.586942:0:5851:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954089626368 00000100:00100000:2.0:1789049498.586995:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.26@tcp, seq: 59 00000100:00100000:2.0:1789049498.587005:0:5851:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8df209c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e823b53a-3591-475c-8624-c682227e5c13+18:10394:x1875954089626368:12345-192.168.206.26@tcp:101:bash.0 00010000:00010000:2.0:1789049498.587028:0:5851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789049498.587047:0:5851:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6714a00/0xf4f48ce5e1bbf207 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7fc5e358805a340f expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049498.587131:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6715200/0xf4f48ce5e1bbf20e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049498.587146:0:5851:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6715a00/0xf4f48ce5e1bbf1f2 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a3408 expref: 19 pid: 6841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049498.587155:0:5851:0:(ldlm_resource.c:1751:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6715200/0xf4f48ce5e1bbf20e lrc: 4/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049498.587188:0:5851:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6715a00/0xf4f48ce5e1bbf1f2 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a3408 expref: 19 pid: 6841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049498.587201:0:5851:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6715a00/0xf4f48ce5e1bbf1f2 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a3408 expref: 19 pid: 6841 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789049498.587214:0:5851:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb8fcf04a80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5851:1875954110625280:192.168.206.26@tcp:104: 00000100:00100000:2.0:1789049498.587293:0:5851:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cb8c783e0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789049498.595932:0:5851:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb8fcf04a80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5851:1875954110625280:192.168.206.26@tcp:104: 00010000:00010000:2.0:1789049498.595960:0:5851:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6715200/0xf4f48ce5e1bbf20e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789049498.597150:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.26@tcp (source: 12345-192.168.206.26@tcp) 00000100:00100000:0.0:1789049498.607138:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954089626496 00000100:00100000:0.0:1789049498.607154:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954089626496 00010000:00010000:0.0:1789049498.607199:0:5836:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6715a00/0xf4f48ce5e1bbf1f2 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a3408 expref: 20 pid: 6841 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789049498.607250:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.26@tcp, seq: 41 00000100:00100000:0.0:1789049498.607270:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8df208a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e823b53a-3591-475c-8624-c682227e5c13+20:2357:x1875954089626496:12345-192.168.206.26@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789049498.607284:0:5836:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789049498.607291:0:5836:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6715a00/0xf4f48ce5e1bbf1f2 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a3408 expref: 20 pid: 6841 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049498.607304:0:5836:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6715a00/0xf4f48ce5e1bbf1f2 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a3408 expref: 20 pid: 6841 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049498.607326:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6715a00/0xf4f48ce5e1bbf1f2 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a3408 expref: 20 pid: 6841 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049498.607341:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8cb8cab67900) 00010000:00010000:0.0:1789049498.607347:0:5836:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6715200/0xf4f48ce5e1bbf20e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049498.607356:0:5836:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6715200/0xf4f48ce5e1bbf20e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049498.607363:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6715200/0xf4f48ce5e1bbf20e lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049498.607413:0:5836:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789049498.607471:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8df208a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e823b53a-3591-475c-8624-c682227e5c13+19:2357:x1875954089626496:12345-192.168.206.26@tcp:103:ldlm_bl.0 Request processed in 203us (10328us total) trans 0 rc 0/0 00000100:00100000:0.0:1789049498.607479:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.26@tcp, seq: 41 00010000:00010000:1.0:1789049498.608985:0:5851:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6715200/0xf4f48ce5e1bbf20e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049498.609001:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6715200/0xf4f48ce5e1bbf20e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789049498.609056:0:5851:0:(mdt_handler.c:922:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:1.0:1789049498.609060:0:5851:0:(mdt_handler.c:1587:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1789049498.609081:0:5851:0:(mdt_handler.c:2522:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6715200/0xf4f48ce5e1bbf20e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049498.609119:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6714a00/0xf4f48ce5e1bbf207 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a340f expref: 19 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049498.609138:0:5851:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6715200/0xf4f48ce5e1bbf20e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a340f expref: 18 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049498.609146:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8cb8cab67900) 00010000:00010000:1.0:1789049498.609149:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789049498.609168:0:5851:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cb8d6715200, rc 0) 00000100:00100000:1.0:1789049498.609230:0:5851:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8df209c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e823b53a-3591-475c-8624-c682227e5c13+18:10394:x1875954089626368:12345-192.168.206.26@tcp:101:bash.0 Request processed in 22226us (22477us total) trans 0 rc 0/0 00000100:00100000:1.0:1789049498.609238:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.26@tcp, seq: 59 00000100:00100000:1.0:1789049498.618609:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.26@tcp (source: 12345-192.168.206.26@tcp) 00000100:00100000:3.0:1789049498.620355:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954089626752 00000100:00100000:3.0:1789049498.620370:0:5853:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954089626752 00000100:00100000:2.0:1789049498.622448:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.26@tcp, seq: 15 00000100:00100000:2.0:1789049498.622469:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8d1d2cc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e823b53a-3591-475c-8624-c682227e5c13+18:10394:x1875954089626752:12345-192.168.206.26@tcp:35:bash.0 00000100:00100000:2.0:1789049498.622765:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8d1d2cc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e823b53a-3591-475c-8624-c682227e5c13+19:10394:x1875954089626752:12345-192.168.206.26@tcp:35:bash.0 Request processed in 305us (4164us total) trans 4294967345 rc 0/0 00000100:00100000:2.0:1789049498.622774:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.26@tcp, seq: 15 00000100:00100000:0.0:1789049498.728627:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.26@tcp (source: 12345-192.168.206.26@tcp) 00000100:00100000:3.0:1789049498.728879:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954089627008 00000100:00100000:3.0:1789049498.728889:0:5850:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954089627008 00000100:00100000:3.0:1789049498.728962:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.26@tcp, seq: 60 00000100:00100000:3.0:1789049498.728973:0:5850:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8df298700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e823b53a-3591-475c-8624-c682227e5c13+19:10404:x1875954089627008:12345-192.168.206.26@tcp:101:lfs.0 00010000:00010000:3.0:1789049498.728997:0:5850:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789049498.729018:0:5850:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c6b35a00/0xf4f48ce5e1bbf215 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7fc5e358805a3416 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789049498.729120:0:5850:0:(mdt_handler.c:922:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00010000:00010000:3.0:1789049498.729233:0:5850:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c6b35a00/0xf4f48ce5e1bbf215 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a3416 expref: 21 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049498.729247:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8cb8cab67d00) 00010000:00010000:3.0:1789049498.729250:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1789049498.729364:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c6b35a00/0xf4f48ce5e1bbf215 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a3416 expref: 21 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049498.729444:0:5850:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cb8c6b35a00, rc 0) 00000100:00100000:3.0:1789049498.729567:0:5850:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8df298700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e823b53a-3591-475c-8624-c682227e5c13+20:10404:x1875954089627008:12345-192.168.206.26@tcp:101:lfs.0 Request processed in 596us (950us total) trans 4294967346 rc 301/301 00000100:00100000:3.0:1789049498.729591:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.26@tcp, seq: 60 00000100:00100000:1.0:1789049498.735093:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.26@tcp (source: 12345-192.168.206.26@tcp) 00000100:00100000:3.0:1789049498.735239:0:6841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954089627136 00000100:00100000:3.0:1789049498.735248:0:6841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954089627136 00000100:00100000:3.0:1789049498.735464:0:6841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.26@tcp, seq: 61 00000100:00100000:3.0:1789049498.735475:0:6841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8df208e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e823b53a-3591-475c-8624-c682227e5c13+20:10404:x1875954089627136:12345-192.168.206.26@tcp:34:lfs.0 00010000:00010000:3.0:1789049498.735544:0:6841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c6b35400/0xf4f48ce5e1bbf223 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049498.735561:0:6841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c6b35400/0xf4f48ce5e1bbf223 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049498.735572:0:6841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c6b35400/0xf4f48ce5e1bbf223 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049498.735586:0:6841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c6b34e00/0xf4f48ce5e1bbf22a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049498.735593:0:6841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c6b34e00/0xf4f48ce5e1bbf22a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049498.735599:0:6841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c6b34e00/0xf4f48ce5e1bbf22a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049498.736040:0:6841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c6b35a00/0xf4f48ce5e1bbf231 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049498.736052:0:6841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c6b35a00/0xf4f48ce5e1bbf231 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049498.736059:0:6841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c6b35a00/0xf4f48ce5e1bbf231 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6841 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789049498.736118:0:6841:0:(mdt_handler.c:2522:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c6b35a00/0xf4f48ce5e1bbf231 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049498.736130:0:6841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c6b35400/0xf4f48ce5e1bbf223 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049498.736137:0:6841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c6b35400/0xf4f48ce5e1bbf223 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049498.736144:0:6841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c6b35400/0xf4f48ce5e1bbf223 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049498.736150:0:6841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cb8c6b35400 already unused, calling callback (ffffffffc20ca4f0) 00010000:00010000:3.0:1789049498.736155:0:6841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c6b35400/0xf4f48ce5e1bbf223 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049498.736163:0:6841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c6b35400/0xf4f48ce5e1bbf223 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049498.736174:0:6841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8cb8c396df00) 00010000:00010000:3.0:1789049498.736177:0:6841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789049498.736181:0:6841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c6b35400/0xf4f48ce5e1bbf223 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049498.736188:0:6841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c6b35400/0xf4f48ce5e1bbf223 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049498.736199:0:6841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c6b34e00/0xf4f48ce5e1bbf22a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049498.736205:0:6841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c6b34e00/0xf4f48ce5e1bbf22a lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049498.736218:0:6841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c6b34e00/0xf4f48ce5e1bbf22a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049498.736223:0:6841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cb8c6b34e00 already unused, calling callback (ffffffffc20ca4f0) 00010000:00010000:3.0:1789049498.736226:0:6841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c6b34e00/0xf4f48ce5e1bbf22a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049498.736232:0:6841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c6b34e00/0xf4f48ce5e1bbf22a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049498.736240:0:6841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8cb8c687db00) 00010000:00010000:3.0:1789049498.736242:0:6841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789049498.736245:0:6841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c6b34e00/0xf4f48ce5e1bbf22a lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049498.736251:0:6841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c6b34e00/0xf4f48ce5e1bbf22a lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049498.736334:0:6841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c6b35a00/0xf4f48ce5e1bbf231 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049498.736341:0:6841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c6b35a00/0xf4f48ce5e1bbf231 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049498.736347:0:6841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c6b35a00/0xf4f48ce5e1bbf231 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049498.736351:0:6841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cb8c6b35a00 already unused, calling callback (ffffffffc20ca4f0) 00010000:00010000:3.0:1789049498.736354:0:6841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c6b35a00/0xf4f48ce5e1bbf231 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049498.736369:0:6841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c6b35a00/0xf4f48ce5e1bbf231 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049498.736377:0:6841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8cb8cab67900) 00010000:00010000:3.0:1789049498.736449:0:6841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789049498.736453:0:6841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c6b35a00/0xf4f48ce5e1bbf231 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049498.736459:0:6841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c6b35a00/0xf4f48ce5e1bbf231 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6841 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789049498.736577:0:6841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8df208e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e823b53a-3591-475c-8624-c682227e5c13+20:10404:x1875954089627136:12345-192.168.206.26@tcp:34:lfs.0 Request processed in 1103us (1490us total) trans 0 rc 0/0 00000100:00100000:3.0:1789049498.736585:0:6841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.26@tcp, seq: 61 00000100:00100000:0.0:1789049498.739740:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.26@tcp (source: 12345-192.168.206.26@tcp) 00000100:00100000:3.0:1789049498.739807:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954089627392 00000100:00100000:3.0:1789049498.739816:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954089627392 00000100:00100000:3.0:1789049498.739892:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.26@tcp, seq: 16 00000100:00100000:3.0:1789049498.739916:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8df299500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e823b53a-3591-475c-8624-c682227e5c13+20:10404:x1875954089627392:12345-192.168.206.26@tcp:35:lfs.0 00000100:00100000:3.0:1789049498.740148:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8df299500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e823b53a-3591-475c-8624-c682227e5c13+21:10404:x1875954089627392:12345-192.168.206.26@tcp:35:lfs.0 Request processed in 245us (414us total) trans 4294967347 rc 0/0 00000100:00100000:3.0:1789049498.740155:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.26@tcp, seq: 16 00000100:00100000:0.0:1789049498.779684:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.26@tcp (source: 12345-192.168.206.26@tcp) 00000100:00100000:3.0:1789049498.779772:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954089627648 00000100:00100000:3.0:1789049498.779782:0:5850:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954089627648 00000100:00100000:3.0:1789049498.779839:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.26@tcp, seq: 62 00000100:00100000:3.0:1789049498.779879:0:5850:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8df299180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e823b53a-3591-475c-8624-c682227e5c13+21:10407:x1875954089627648:12345-192.168.206.26@tcp:101:lfs.0 00010000:00010000:3.0:1789049498.779903:0:5850:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789049498.779942:0:5850:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c6b35a00/0xf4f48ce5e1bbf238 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7fc5e358805a341d expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049498.780026:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c6b34e00/0xf4f48ce5e1bbf23f lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049498.780040:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c6b34e00/0xf4f48ce5e1bbf23f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049498.780052:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c6b34e00/0xf4f48ce5e1bbf23f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049498.780065:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c6b35400/0xf4f48ce5e1bbf246 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049498.780072:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c6b35400/0xf4f48ce5e1bbf246 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049498.780078:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c6b35400/0xf4f48ce5e1bbf246 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049498.780753:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6715800/0xf4f48ce5e1bbf24d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049498.780764:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6715800/0xf4f48ce5e1bbf24d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049498.780772:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6715800/0xf4f48ce5e1bbf24d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789049498.780783:0:5850:0:(mdt_handler.c:922:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:2.0:1789049498.780886:0:5850:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c6b34e00/0xf4f48ce5e1bbf23f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049498.780894:0:5850:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c6b34e00/0xf4f48ce5e1bbf23f lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049498.780901:0:5850:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c6b34e00/0xf4f48ce5e1bbf23f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049498.780920:0:5850:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cb8c6b34e00 already unused, calling callback (ffffffffc20ca4f0) 00010000:00010000:2.0:1789049498.780925:0:5850:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c6b34e00/0xf4f48ce5e1bbf23f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049498.780939:0:5850:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c6b34e00/0xf4f48ce5e1bbf23f lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049498.780949:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8cb8c396df00) 00010000:00010000:2.0:1789049498.780952:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789049498.780956:0:5850:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c6b34e00/0xf4f48ce5e1bbf23f lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049498.780962:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c6b34e00/0xf4f48ce5e1bbf23f lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049498.780974:0:5850:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c6b35400/0xf4f48ce5e1bbf246 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049498.780979:0:5850:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c6b35400/0xf4f48ce5e1bbf246 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049498.780985:0:5850:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c6b35400/0xf4f48ce5e1bbf246 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049498.780989:0:5850:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cb8c6b35400 already unused, calling callback (ffffffffc20ca4f0) 00010000:00010000:2.0:1789049498.780992:0:5850:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c6b35400/0xf4f48ce5e1bbf246 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049498.780996:0:5850:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c6b35400/0xf4f48ce5e1bbf246 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049498.781002:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8cb8c687db00) 00010000:00010000:2.0:1789049498.781004:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789049498.781007:0:5850:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c6b35400/0xf4f48ce5e1bbf246 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049498.781023:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c6b35400/0xf4f48ce5e1bbf246 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049498.781066:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c6b35a00/0xf4f48ce5e1bbf238 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a341d expref: 24 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049498.781079:0:5850:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6715800/0xf4f48ce5e1bbf24d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a341d expref: 23 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049498.781085:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8cb8cab67900) 00010000:00010000:2.0:1789049498.781088:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789049498.781090:0:5850:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cb8d6715800, rc 0) 00000100:00100000:2.0:1789049498.781166:0:5850:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8df299180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e823b53a-3591-475c-8624-c682227e5c13+23:10407:x1875954089627648:12345-192.168.206.26@tcp:101:lfs.0 Request processed in 1290us (1490us total) trans 4294967348 rc 0/0 00000100:00100000:2.0:1789049498.781173:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.26@tcp, seq: 62 00000100:00100000:0.0:1789049498.788485:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.26@tcp (source: 12345-192.168.206.26@tcp) 00000100:00100000:1.0:1789049498.788636:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954089627776 00000100:00100000:1.0:1789049498.788647:0:5851:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954089627776 00000100:00100000:1.0:1789049498.788707:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.26@tcp, seq: 63 00000100:00100000:1.0:1789049498.788717:0:5851:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8df29ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e823b53a-3591-475c-8624-c682227e5c13+23:10407:x1875954089627776:12345-192.168.206.26@tcp:54:lfs.0 00010000:00010000:1.0:1789049498.788780:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c146c200/0xf4f48ce5e1bbf25b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049498.788797:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c146c200/0xf4f48ce5e1bbf25b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049498.788809:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c146c200/0xf4f48ce5e1bbf25b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049498.788835:0:5851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c146c200/0xf4f48ce5e1bbf25b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049498.788878:0:5851:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c146c200/0xf4f48ce5e1bbf25b lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049498.788886:0:5851:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c146c200/0xf4f48ce5e1bbf25b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049498.788891:0:5851:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cb8c146c200 already unused, calling callback (ffffffffc20ca4f0) 00010000:00010000:1.0:1789049498.788895:0:5851:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c146c200/0xf4f48ce5e1bbf25b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049498.788931:0:5851:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c146c200/0xf4f48ce5e1bbf25b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049498.788943:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8cb8cab67900) 00010000:00010000:1.0:1789049498.788946:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1789049498.788951:0:5851:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c146c200/0xf4f48ce5e1bbf25b lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049498.788957:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c146c200/0xf4f48ce5e1bbf25b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789049498.789032:0:5851:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8df29ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e823b53a-3591-475c-8624-c682227e5c13+23:10407:x1875954089627776:12345-192.168.206.26@tcp:54:lfs.0 Request processed in 316us (558us total) trans 0 rc 0/0 00000100:00100000:1.0:1789049498.789040:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.26@tcp, seq: 63 00000100:00100000:0.0:1789049498.791137:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.26@tcp (source: 12345-192.168.206.26@tcp) 00000100:00100000:1.0:1789049498.791257:0:6720:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954089627904 00000100:00100000:1.0:1789049498.791276:0:6720:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954089627904 00000100:00100000:1.0:1789049498.791337:0:6720:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.26@tcp, seq: 4 00000100:00100000:1.0:1789049498.791347:0:6720:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8df298e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e823b53a-3591-475c-8624-c682227e5c13+23:2357:x1875954089627904:12345-192.168.206.26@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789049498.791361:0:6720:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789049498.791394:0:6720:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6715800/0xf4f48ce5e1bbf24d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a341d expref: 23 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049498.791410:0:6720:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8cb8cab67900) 00010000:00010000:1.0:1789049498.791415:0:6720:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789049498.791464:0:6720:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8df298e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e823b53a-3591-475c-8624-c682227e5c13+22:2357:x1875954089627904:12345-192.168.206.26@tcp:103:ldlm_bl.0 Request processed in 118us (334us total) trans 0 rc 0/0 00000100:00100000:1.0:1789049498.791471:0:6720:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.26@tcp, seq: 4 00000100:00100000:0.0:1789049498.795715:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.26@tcp (source: 12345-192.168.206.26@tcp) 00000100:00100000:3.0:1789049498.795803:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954089628160 00000100:00100000:3.0:1789049498.795812:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954089628160 00000100:00100000:3.0:1789049498.795900:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.26@tcp, seq: 17 00000100:00100000:3.0:1789049498.795922:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb900a56d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e823b53a-3591-475c-8624-c682227e5c13+22:10407:x1875954089628160:12345-192.168.206.26@tcp:35:lfs.0 00000100:00100000:3.0:1789049498.796160:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb900a56d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e823b53a-3591-475c-8624-c682227e5c13+23:10407:x1875954089628160:12345-192.168.206.26@tcp:35:lfs.0 Request processed in 249us (452us total) trans 4294967349 rc 0/0 00000100:00100000:3.0:1789049498.796168:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.26@tcp, seq: 17 00000100:00100000:0.0:1789049499.001215:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.26@tcp (source: 12345-192.168.206.26@tcp) 00000100:00100000:3.0:1789049499.001397:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954089628416 00000100:00100000:3.0:1789049499.001407:0:5852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954089628416 00000100:00100000:3.0:1789049499.001520:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.26@tcp, seq: 64 00000100:00100000:3.0:1789049499.001531:0:5852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb900a55f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e823b53a-3591-475c-8624-c682227e5c13+23:10426:x1875954089628416:12345-192.168.206.26@tcp:101:cat.0 00010000:00010000:3.0:1789049499.001577:0:5852:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789049499.001600:0:5852:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c6b35c00/0xf4f48ce5e1bbf262 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7fc5e358805a3424 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049499.001710:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c6b34200/0xf4f48ce5e1bbf269 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049499.001725:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c6b34200/0xf4f48ce5e1bbf269 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049499.001739:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c6b34200/0xf4f48ce5e1bbf269 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789049499.001751:0:5852:0:(mdt_handler.c:922:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:3.0:1789049499.001920:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c6b35c00/0xf4f48ce5e1bbf262 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a3424 expref: 26 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049499.001939:0:5852:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c6b34200/0xf4f48ce5e1bbf269 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a3424 expref: 25 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049499.001947:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8cb8cab67900) 00010000:00010000:3.0:1789049499.001950:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:3.0:1789049499.001953:0:5852:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cb8c6b34200, rc 0) 00000100:00100000:3.0:1789049499.002009:0:5852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb900a55f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e823b53a-3591-475c-8624-c682227e5c13+25:10426:x1875954089628416:12345-192.168.206.26@tcp:101:cat.0 Request processed in 479us (800us total) trans 4294967350 rc 0/0 00000100:00100000:3.0:1789049499.002017:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.26@tcp, seq: 64 00000100:00100000:0.0:1789049499.044969:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.26@tcp (source: 12345-192.168.206.26@tcp) 00000100:00100000:1.0:1789049499.045246:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954089628544 00000100:00100000:1.0:1789049499.045265:0:5851:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954089628544 00000100:00100000:1.0:1789049499.045322:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.26@tcp, seq: 65 00000100:00100000:1.0:1789049499.045332:0:5851:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb900a55880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e823b53a-3591-475c-8624-c682227e5c13+25:10427:x1875954089628544:12345-192.168.206.26@tcp:101:lfs.0 00010000:00010000:1.0:1789049499.045357:0:5851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789049499.045390:0:5851:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c146c200/0xf4f48ce5e1bbf277 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7fc5e358805a342b expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049499.045459:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c146d200/0xf4f48ce5e1bbf27e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049499.045474:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c146d200/0xf4f48ce5e1bbf27e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049499.045484:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c146d200/0xf4f48ce5e1bbf27e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789049499.045517:0:5851:0:(mdt_handler.c:922:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00000004:00200000:1.0:1789049499.045521:0:5851:0:(mdt_handler.c:1587:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1789049499.045538:0:5851:0:(mdt_handler.c:2522:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c146d200/0xf4f48ce5e1bbf27e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049499.045566:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c146c200/0xf4f48ce5e1bbf277 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a342b expref: 27 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049499.045585:0:5851:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c146d200/0xf4f48ce5e1bbf27e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a342b expref: 26 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049499.045594:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8cb8c396df00) 00010000:00010000:1.0:1789049499.045596:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1789049499.045613:0:5851:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cb8c146d200, rc 0) 00000100:00100000:1.0:1789049499.045672:0:5851:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb900a55880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e823b53a-3591-475c-8624-c682227e5c13+26:10427:x1875954089628544:12345-192.168.206.26@tcp:101:lfs.0 Request processed in 342us (713us total) trans 0 rc 0/0 00000100:00100000:1.0:1789049499.045679:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.26@tcp, seq: 65 00000100:00100000:0.0:1789049499.052759:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.26@tcp (source: 12345-192.168.206.26@tcp) 00000100:00100000:3.0:1789049499.053100:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954089628928 00000100:00100000:3.0:1789049499.053112:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954089628928 00000100:00100000:3.0:1789049499.053171:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.26@tcp, seq: 18 00000100:00100000:3.0:1789049499.053194:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb900a57100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e823b53a-3591-475c-8624-c682227e5c13+26:10427:x1875954089628928:12345-192.168.206.26@tcp:35:lfs.0 00000001:00080000:3.0:1789049499.053466:0:5854:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967351 00000100:00100000:3.0:1789049499.053573:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb900a57100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e823b53a-3591-475c-8624-c682227e5c13+28:10427:x1875954089628928:12345-192.168.206.26@tcp:35:lfs.0 Request processed in 381us (823us total) trans 4294967352 rc 0/0 00000100:00100000:3.0:1789049499.053581:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.26@tcp, seq: 18 00000020:00080000:3.0:1789049499.053585:0:5854:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1789049499.057147:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.26@tcp (source: 12345-192.168.206.26@tcp) 00000100:00100000:2.0:1789049499.057245:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954089629056 00000100:00100000:2.0:1789049499.057254:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954089629056 00000100:00100000:2.0:1789049499.057370:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.26@tcp, seq: 5 00000100:00100000:2.0:1789049499.057390:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb900a56680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e823b53a-3591-475c-8624-c682227e5c13+28:10427:x1875954089629056:12345-192.168.206.26@tcp:103:lfs.0 00010000:00010000:2.0:1789049499.057407:0:5836:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:2.0:1789049499.057432:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6715200/0xf4f48ce5e1bbf20e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a340f expref: 28 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049499.057455:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c6b34200/0xf4f48ce5e1bbf269 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a3424 expref: 27 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049499.057493:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c6b34000/0xf4f48ce5e1bbf112 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a33d0 expref: 26 pid: 6841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049499.057502:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8cb8cab67900) 00010000:00010000:2.0:1789049499.057513:0:5836:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789049499.057572:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb900a56680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e823b53a-3591-475c-8624-c682227e5c13+25:10427:x1875954089629056:12345-192.168.206.26@tcp:103:lfs.0 Request processed in 193us (434us total) trans 0 rc 0/0 00000100:00100000:2.0:1789049499.057579:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.26@tcp, seq: 5 00000100:00100000:0.0:1789049499.060531:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.26@tcp (source: 12345-192.168.206.26@tcp) 00000100:00100000:2.0:1789049499.060704:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954089629184 00000100:00100000:2.0:1789049499.060714:0:5850:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954089629184 00000100:00100000:2.0:1789049499.060771:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.26@tcp, seq: 66 00000100:00100000:2.0:1789049499.060781:0:5850:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb900a57b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e823b53a-3591-475c-8624-c682227e5c13+25:10427:x1875954089629184:12345-192.168.206.26@tcp:58:lfs.0 00010000:00010000:2.0:1789049499.061071:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6715a00/0xf4f48ce5e1bbf285 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049499.061088:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6715a00/0xf4f48ce5e1bbf285 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049499.061098:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6715a00/0xf4f48ce5e1bbf285 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1789049499.061741:0:5850:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1789049499.062542:0:5850:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 64 off8256 00000040:00080000:2.0:1789049499.062618:0:5850:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1, 136 off8328 00000100:00100000:2.0:1789049499.062794:0:5850:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb900a57b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e823b53a-3591-475c-8624-c682227e5c13+25:10427:x1875954089629184:12345-192.168.206.26@tcp:58:lfs.0 Request processed in 2010us (2268us total) trans 0 rc 0/0 00000100:00100000:2.0:1789049499.062805:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.26@tcp, seq: 66 00000040:00080000:0.0:1789049499.099076:0:11704:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1789049499.099084:0:11704:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1789049499.099147:0:11704:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:0.0:1789049499.099154:0:11704:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1789049499.099286:0:11704:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb900a54380 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11704:1875954110625408:192.168.206.26@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1789049499.099602:0:11704:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cb8c6b2a6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789049499.114432:0:11704:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb900a54380 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11704:1875954110625408:192.168.206.26@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1789049499.119456:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.26@tcp (source: 12345-192.168.206.26@tcp) 00000100:00100000:2.0:1789049499.119732:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954089629312 00000100:00100000:2.0:1789049499.119742:0:5862:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954089629312 00000100:00100000:2.0:1789049499.119796:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.26@tcp, seq: 1 00000100:00100000:2.0:1789049499.119807:0:5862:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb900a56300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:e823b53a-3591-475c-8624-c682227e5c13+25:10431:x1875954089629312:12345-192.168.206.26@tcp:900:lhsmtool_posix.0 00000100:00100000:2.0:1789049499.119938:0:5862:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb900a56300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:e823b53a-3591-475c-8624-c682227e5c13+25:10431:x1875954089629312:12345-192.168.206.26@tcp:900:lhsmtool_posix.0 Request processed in 134us (491us total) trans 0 rc 0/0 00000100:00100000:2.0:1789049499.119946:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.26@tcp, seq: 1 00000100:00100000:0.0:1789049499.131491:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.26@tcp (source: 12345-192.168.206.26@tcp) 00000100:00100000:1.0:1789049499.131593:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954089629440 00000100:00100000:1.0:1789049499.131603:0:5851:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954089629440 00000100:00100000:1.0:1789049499.131661:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.26@tcp, seq: 67 00000100:00100000:1.0:1789049499.131671:0:5851:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb900a56a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e823b53a-3591-475c-8624-c682227e5c13+25:10429:x1875954089629440:12345-192.168.206.26@tcp:101:lfs.0 00010000:00010000:1.0:1789049499.131692:0:5851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789049499.131712:0:5851:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c146c200/0xf4f48ce5e1bbf28c lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7fc5e358805a3432 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049499.131775:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c146d800/0xf4f48ce5e1bbf293 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049499.131789:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c146d800/0xf4f48ce5e1bbf293 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049499.131800:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c146d800/0xf4f48ce5e1bbf293 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049499.131834:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c3600/0xf4f48ce5e1bbf29a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049499.131877:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c3600/0xf4f48ce5e1bbf29a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049499.131886:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c3600/0xf4f48ce5e1bbf29a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049499.132114:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c3400/0xf4f48ce5e1bbf2a1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049499.132131:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c3400/0xf4f48ce5e1bbf2a1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049499.132139:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c3400/0xf4f48ce5e1bbf2a1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789049499.132177:0:5851:0:(mdt_handler.c:922:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:1.0:1789049499.132181:0:5851:0:(mdt_handler.c:1587:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1789049499.132200:0:5851:0:(mdt_handler.c:2522:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c3400/0xf4f48ce5e1bbf2a1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049499.132211:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c3400/0xf4f48ce5e1bbf2a1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049499.132219:0:5851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c146d800/0xf4f48ce5e1bbf293 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049499.132225:0:5851:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c146d800/0xf4f48ce5e1bbf293 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049499.132232:0:5851:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c146d800/0xf4f48ce5e1bbf293 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049499.132238:0:5851:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cb8c146d800 already unused, calling callback (ffffffffc20ca4f0) 00010000:00010000:1.0:1789049499.132242:0:5851:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c146d800/0xf4f48ce5e1bbf293 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049499.132249:0:5851:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c146d800/0xf4f48ce5e1bbf293 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049499.132273:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8cb8c396df00) 00010000:00010000:1.0:1789049499.132276:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789049499.132289:0:5851:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c146d800/0xf4f48ce5e1bbf293 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049499.132306:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c146d800/0xf4f48ce5e1bbf293 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049499.132322:0:5851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c3600/0xf4f48ce5e1bbf29a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049499.132328:0:5851:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c3600/0xf4f48ce5e1bbf29a lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049499.132334:0:5851:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c3600/0xf4f48ce5e1bbf29a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049499.132339:0:5851:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cb8c28c3600 already unused, calling callback (ffffffffc20ca4f0) 00010000:00010000:1.0:1789049499.132341:0:5851:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c3600/0xf4f48ce5e1bbf29a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049499.132347:0:5851:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c3600/0xf4f48ce5e1bbf29a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049499.132355:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8cb8c396d900) 00010000:00010000:1.0:1789049499.132357:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789049499.132360:0:5851:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c3600/0xf4f48ce5e1bbf29a lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049499.132366:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c3600/0xf4f48ce5e1bbf29a lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049499.132397:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c146c200/0xf4f48ce5e1bbf28c lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a3432 expref: 27 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049499.132423:0:5851:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c3400/0xf4f48ce5e1bbf2a1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a3432 expref: 26 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049499.132430:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8cb8e0130f00) 00010000:00010000:1.0:1789049499.132432:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1789049499.132434:0:5851:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cb8c28c3400, rc 0) 00000100:00100000:1.0:1789049499.132490:0:5851:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb900a56a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e823b53a-3591-475c-8624-c682227e5c13+26:10429:x1875954089629440:12345-192.168.206.26@tcp:101:lfs.0 Request processed in 820us (1010us total) trans 0 rc 0/0 00000100:00100000:1.0:1789049499.132497:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.26@tcp, seq: 67 00000100:00100000:3.0:1789049499.137646:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.26@tcp (source: 12345-192.168.206.26@tcp) 00000100:00100000:0.0:1789049499.138069:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954089629568 00000100:00100000:0.0:1789049499.138080:0:5852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954089629568 00000100:00100000:0.0:1789049499.138150:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.26@tcp, seq: 68 00000100:00100000:0.0:1789049499.138161:0:5852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8c633e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e823b53a-3591-475c-8624-c682227e5c13+26:10431:x1875954089629568:12345-192.168.206.26@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1789049499.138207:0:5852:0:(mdt_handler.c:7990:mdt_fid2path()) path get [0x200000401:0x4:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1789049499.138327:0:5852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8c633e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e823b53a-3591-475c-8624-c682227e5c13+26:10431:x1875954089629568:12345-192.168.206.26@tcp:53:lhsmtool_posix.0 Request processed in 168us (690us total) trans 0 rc 0/0 00000100:00100000:0.0:1789049499.138335:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.26@tcp, seq: 68 00000100:00100000:0.0:1789049499.143070:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.26@tcp (source: 12345-192.168.206.26@tcp) 00000100:00100000:1.0:1789049499.143692:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954089629696 00000100:00100000:1.0:1789049499.143703:0:5851:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954089629696 00000100:00100000:1.0:1789049499.143763:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.26@tcp, seq: 69 00000100:00100000:1.0:1789049499.143773:0:5851:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb900a57480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e823b53a-3591-475c-8624-c682227e5c13+26:10431:x1875954089629696:12345-192.168.206.26@tcp:34:lhsmtool_posix.0 00010000:00010000:1.0:1789049499.143889:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c3a00/0xf4f48ce5e1bbf2a8 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049499.143923:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c3a00/0xf4f48ce5e1bbf2a8 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049499.143936:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c3a00/0xf4f48ce5e1bbf2a8 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049499.144007:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c3000/0xf4f48ce5e1bbf2af lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049499.144015:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c3000/0xf4f48ce5e1bbf2af lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049499.144038:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c3000/0xf4f48ce5e1bbf2af lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049499.144064:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c2400/0xf4f48ce5e1bbf2b6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049499.144073:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c2400/0xf4f48ce5e1bbf2b6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049499.144080:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c2400/0xf4f48ce5e1bbf2b6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789049499.144665:0:5851:0:(mdt_handler.c:922:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:1.0:1789049499.144672:0:5851:0:(mdt_handler.c:1587:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1789049499.144686:0:5851:0:(mdt_handler.c:2522:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c2400/0xf4f48ce5e1bbf2b6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049499.144700:0:5851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c3a00/0xf4f48ce5e1bbf2a8 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049499.144707:0:5851:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c3a00/0xf4f48ce5e1bbf2a8 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049499.144714:0:5851:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c3a00/0xf4f48ce5e1bbf2a8 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049499.144719:0:5851:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cb8c28c3a00 already unused, calling callback (ffffffffc20ca4f0) 00010000:00010000:1.0:1789049499.144723:0:5851:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c3a00/0xf4f48ce5e1bbf2a8 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049499.144731:0:5851:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c3a00/0xf4f48ce5e1bbf2a8 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049499.144754:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8cb8e0130a00) 00010000:00010000:1.0:1789049499.144757:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789049499.144762:0:5851:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c3a00/0xf4f48ce5e1bbf2a8 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049499.144768:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c3a00/0xf4f48ce5e1bbf2a8 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049499.144782:0:5851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c3000/0xf4f48ce5e1bbf2af lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049499.144789:0:5851:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c3000/0xf4f48ce5e1bbf2af lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049499.144794:0:5851:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c3000/0xf4f48ce5e1bbf2af lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049499.144799:0:5851:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cb8c28c3000 already unused, calling callback (ffffffffc20ca4f0) 00010000:00010000:1.0:1789049499.144802:0:5851:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c3000/0xf4f48ce5e1bbf2af lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049499.144808:0:5851:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c3000/0xf4f48ce5e1bbf2af lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049499.144815:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x3c15db59 (ffff8cb8c396d900) 00010000:00010000:1.0:1789049499.144817:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789049499.144820:0:5851:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c3000/0xf4f48ce5e1bbf2af lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049499.144825:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c3000/0xf4f48ce5e1bbf2af lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049499.144893:0:5851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c2400/0xf4f48ce5e1bbf2b6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049499.144919:0:5851:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c2400/0xf4f48ce5e1bbf2b6 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049499.144924:0:5851:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c2400/0xf4f48ce5e1bbf2b6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049499.144929:0:5851:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cb8c28c2400 already unused, calling callback (ffffffffc20ca4f0) 00010000:00010000:1.0:1789049499.144932:0:5851:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c2400/0xf4f48ce5e1bbf2b6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049499.144939:0:5851:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c2400/0xf4f48ce5e1bbf2b6 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049499.144947:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8cb8e0130f00) 00010000:00010000:1.0:1789049499.144950:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789049499.144953:0:5851:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c2400/0xf4f48ce5e1bbf2b6 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049499.144959:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c2400/0xf4f48ce5e1bbf2b6 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789049499.145133:0:5851:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb900a57480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e823b53a-3591-475c-8624-c682227e5c13+26:10431:x1875954089629696:12345-192.168.206.26@tcp:34:lhsmtool_posix.0 Request processed in 1359us (2070us total) trans 0 rc 0/0 00000100:00100000:1.0:1789049499.145143:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.26@tcp, seq: 69 00000100:00100000:1.0:1789049499.153971:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.26@tcp (source: 12345-192.168.206.26@tcp) 00000100:00100000:0.0:1789049499.154067:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954089629952 00000100:00100000:0.0:1789049499.154078:0:5852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954089629952 00000100:00100000:0.0:1789049499.154147:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.26@tcp, seq: 70 00000100:00100000:0.0:1789049499.154158:0:5852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8df208700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e823b53a-3591-475c-8624-c682227e5c13+26:10431:x1875954089629952:12345-192.168.206.26@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789049499.154179:0:5852:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789049499.154198:0:5852:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb7c4c39200/0xf4f48ce5e1bbf2bd lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7fc5e358805a3439 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049499.154298:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb7c4c39000/0xf4f48ce5e1bbf2c4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049499.154313:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cb7c4c39000/0xf4f48ce5e1bbf2c4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049499.154325:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb7c4c39000/0xf4f48ce5e1bbf2c4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789049499.154337:0:5852:0:(mdt_handler.c:922:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:0.0:1789049499.154435:0:5852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb7c4c39000/0xf4f48ce5e1bbf2c4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049499.154443:0:5852:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cb7c4c39000/0xf4f48ce5e1bbf2c4 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049499.154450:0:5852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cb7c4c39000/0xf4f48ce5e1bbf2c4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049499.154468:0:5852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cb7c4c39000 already unused, calling callback (ffffffffc20ca4f0) 00010000:00010000:0.0:1789049499.154472:0:5852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb7c4c39000/0xf4f48ce5e1bbf2c4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049499.154479:0:5852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb7c4c39000/0xf4f48ce5e1bbf2c4 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049499.154491:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8cb8e0130f00) 00010000:00010000:0.0:1789049499.154494:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1789049499.154499:0:5852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cb7c4c39000/0xf4f48ce5e1bbf2c4 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049499.154506:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb7c4c39000/0xf4f48ce5e1bbf2c4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049499.154548:0:5852:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb7c4c39200/0xf4f48ce5e1bbf2bd lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a3439 expref: 28 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049499.154558:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8cb8e0130a00) 00010000:00010000:0.0:1789049499.154560:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1789049499.154563:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb7c4c39200/0xf4f48ce5e1bbf2bd lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a3439 expref: 28 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049499.154572:0:5852:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cb7c4c39200, rc 0) 00000100:00100000:0.0:1789049499.154637:0:5852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8df208700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e823b53a-3591-475c-8624-c682227e5c13+27:10431:x1875954089629952:12345-192.168.206.26@tcp:101:lhsmtool_posix.0 Request processed in 480us (674us total) trans 4294967353 rc 301/301 00000100:00100000:0.0:1789049499.154644:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.26@tcp, seq: 70 00000100:00100000:2.0:1789049499.160823:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.26@tcp (source: 12345-192.168.206.26@tcp) 00000100:00100000:3.0:1789049499.161353:0:6841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954089630080 00000100:00100000:3.0:1789049499.161362:0:6841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954089630080 00000100:00100000:3.0:1789049499.161423:0:6841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.26@tcp, seq: 71 00000100:00100000:3.0:1789049499.161431:0:6841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8fcf04a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e823b53a-3591-475c-8624-c682227e5c13+27:10431:x1875954089630080:12345-192.168.206.26@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1789049499.161474:0:6841:0:(mdt_handler.c:7990:mdt_fid2path()) path get [0x200000401:0x4:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1789049499.161576:0:6841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8fcf04a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e823b53a-3591-475c-8624-c682227e5c13+27:10431:x1875954089630080:12345-192.168.206.26@tcp:53:lhsmtool_posix.0 Request processed in 145us (762us total) trans 0 rc 0/0 00000100:00100000:3.0:1789049499.161583:0:6841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.26@tcp, seq: 71 00000100:00100000:1.0:1789049499.170360:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.26@tcp (source: 12345-192.168.206.26@tcp) 00000100:00100000:0.0:1789049499.170901:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954089630336 00000100:00100000:0.0:1789049499.170934:0:5852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954089630336 00000100:00100000:0.0:1789049499.170993:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.26@tcp, seq: 72 00000100:00100000:0.0:1789049499.171003:0:5852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8df209500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e823b53a-3591-475c-8624-c682227e5c13+27:10431:x1875954089630336:12345-192.168.206.26@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789049499.171024:0:5852:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789049499.171027:0:5852:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1789049499.171051:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c146d200/0xf4f48ce5e1bbf27e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a342b expref: 27 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049499.171070:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8cb8c396df00) 00010000:00010000:0.0:1789049499.171074:0:5852:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789049499.171085:0:5852:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb7c4c39000/0xf4f48ce5e1bbf2d2 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7fc5e358805a3440 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1789049499.172040:0:5852:0:(osp_object.c:1667:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x3:0x0], index 0: 0 00010000:00010000:0.0:1789049499.172755:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb7c4c39200/0xf4f48ce5e1bbf2d9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049499.172775:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cb7c4c39200/0xf4f48ce5e1bbf2d9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049499.172789:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb7c4c39200/0xf4f48ce5e1bbf2d9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049499.172893:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb7c4c39000/0xf4f48ce5e1bbf2d2 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a3440 expref: 29 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049499.172921:0:5852:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb7c4c39200/0xf4f48ce5e1bbf2d9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a3440 expref: 28 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049499.172942:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff8cb8ce751600) 00010000:00010000:0.0:1789049499.172946:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789049499.172949:0:5852:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cb7c4c39200, rc 0) 00000100:00100000:0.0:1789049499.173022:0:5852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8df209500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e823b53a-3591-475c-8624-c682227e5c13+28:10431:x1875954089630336:12345-192.168.206.26@tcp:101:lhsmtool_posix.0 Request processed in 2019us (2678us total) trans 4294967354 rc 0/0 00000100:00100000:0.0:1789049499.173030:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.26@tcp, seq: 72 00000100:00100000:0.0:1789049499.179677:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.26@tcp (source: 12345-192.168.206.26@tcp) 00000100:00100000:3.0:1789049499.179751:0:6841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954089630592 00000100:00100000:3.0:1789049499.179760:0:6841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954089630592 00000100:00100000:3.0:1789049499.179820:0:6841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.26@tcp, seq: 73 00000100:00100000:3.0:1789049499.179830:0:6841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb900a55c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e823b53a-3591-475c-8624-c682227e5c13+28:10431:x1875954089630592:12345-192.168.206.26@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1789049499.179923:0:6841:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789049499.179947:0:6841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb7c4c39200/0xf4f48ce5e1bbf2d9 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a3440 expref: 28 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049499.179966:0:6841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff8cb8ce751600) 00010000:00010000:3.0:1789049499.179988:0:6841:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789049499.180009:0:6841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c6b35c00/0xf4f48ce5e1bbf2e7 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049499.180023:0:6841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c6b35c00/0xf4f48ce5e1bbf2e7 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049499.180033:0:6841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c6b35c00/0xf4f48ce5e1bbf2e7 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049499.180046:0:6841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c6b35800/0xf4f48ce5e1bbf2ee lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x8ed2b83c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049499.180053:0:6841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c6b35800/0xf4f48ce5e1bbf2ee lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x8ed2b83c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049499.180060:0:6841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c6b35800/0xf4f48ce5e1bbf2ee lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x8ed2b83c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049499.180242:0:6841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c6b35c00/0xf4f48ce5e1bbf2e7 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049499.180249:0:6841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c6b35c00/0xf4f48ce5e1bbf2e7 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049499.180525:0:6841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c6b35c00/0xf4f48ce5e1bbf2e7 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049499.180531:0:6841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cb8c6b35c00 already unused, calling callback (ffffffffc20ca4f0) 00010000:00010000:3.0:1789049499.180535:0:6841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c6b35c00/0xf4f48ce5e1bbf2e7 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049499.180543:0:6841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c6b35c00/0xf4f48ce5e1bbf2e7 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049499.180558:0:6841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8cb8c396df00) 00010000:00010000:3.0:1789049499.180561:0:6841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789049499.180565:0:6841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c6b35c00/0xf4f48ce5e1bbf2e7 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049499.180572:0:6841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c6b35c00/0xf4f48ce5e1bbf2e7 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049499.180582:0:6841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c6b35800/0xf4f48ce5e1bbf2ee lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x8ed2b83c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049499.180588:0:6841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c6b35800/0xf4f48ce5e1bbf2ee lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x8ed2b83c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049499.180594:0:6841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c6b35800/0xf4f48ce5e1bbf2ee lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x8ed2b83c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049499.180599:0:6841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cb8c6b35800 already unused, calling callback (ffffffffc20ca4f0) 00010000:00010000:3.0:1789049499.180602:0:6841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c6b35800/0xf4f48ce5e1bbf2ee lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x8ed2b83c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049499.180609:0:6841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c6b35800/0xf4f48ce5e1bbf2ee lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x8ed2b83c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049499.180616:0:6841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x8ed2b83c (ffff8cb8c687d900) 00010000:00010000:3.0:1789049499.180618:0:6841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789049499.180621:0:6841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c6b35800/0xf4f48ce5e1bbf2ee lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x8ed2b83c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049499.180626:0:6841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c6b35800/0xf4f48ce5e1bbf2ee lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x8ed2b83c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6841 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789049499.180760:0:6841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb900a55c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e823b53a-3591-475c-8624-c682227e5c13+27:10431:x1875954089630592:12345-192.168.206.26@tcp:36:lhsmtool_posix.0 Request processed in 931us (1091us total) trans 0 rc -2/-2 00000100:00100000:3.0:1789049499.180768:0:6841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.26@tcp, seq: 73 00000100:00100000:2.0:1789049499.185641:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.26@tcp (source: 12345-192.168.206.26@tcp) 00000100:00100000:1.0:1789049499.185775:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954089630720 00000100:00100000:1.0:1789049499.185798:0:5850:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954089630720 00000100:00100000:1.0:1789049499.185974:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.26@tcp, seq: 74 00000100:00100000:1.0:1789049499.185984:0:5850:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8fcf07800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e823b53a-3591-475c-8624-c682227e5c13+27:10431:x1875954089630720:12345-192.168.206.26@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1789049499.186003:0:5850:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789049499.186024:0:5850:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c3000/0xf4f48ce5e1bbf2f5 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7fc5e358805a3447 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049499.186056:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c2c00/0xf4f48ce5e1bbf2fc lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049499.186068:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c2c00/0xf4f48ce5e1bbf2fc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049499.186079:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c2c00/0xf4f48ce5e1bbf2fc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049499.186182:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c3000/0xf4f48ce5e1bbf2f5 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a3447 expref: 29 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049499.186200:0:5850:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c2c00/0xf4f48ce5e1bbf2fc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a3447 expref: 28 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049499.186208:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff8cb8c396d900) 00010000:00010000:1.0:1789049499.186211:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1789049499.186214:0:5850:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cb8c28c2c00, rc 0) 00000100:00100000:1.0:1789049499.186277:0:5850:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8fcf07800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e823b53a-3591-475c-8624-c682227e5c13+28:10431:x1875954089630720:12345-192.168.206.26@tcp:101:lhsmtool_posix.0 Request processed in 294us (646us total) trans 0 rc 0/0 00000100:00100000:1.0:1789049499.186285:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.26@tcp, seq: 74 00000100:00100000:2.0:1789049499.189056:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.26@tcp (source: 12345-192.168.206.26@tcp) 00000100:00100000:0.0:1789049499.190251:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954089630976 00000100:00100000:0.0:1789049499.190272:0:5852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954089630976 00000100:00100000:0.0:1789049499.190345:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.26@tcp, seq: 75 00000100:00100000:0.0:1789049499.190355:0:5852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8c6323100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e823b53a-3591-475c-8624-c682227e5c13+28:10431:x1875954089630976:12345-192.168.206.26@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1789049499.190441:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb7c4c39000/0xf4f48ce5e1bbf303 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049499.190732:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cb7c4c39000/0xf4f48ce5e1bbf303 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049499.190746:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb7c4c39000/0xf4f48ce5e1bbf303 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1789049499.191061:0:5852:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].3, 88 off8408 00000004:00080000:0.0:1789049499.191072:0:5852:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 325243227945ns, next at 326243225330ns, rc = 0 00000004:00010000:0.0:1789049499.191281:0:5852:0:(mdt_handler.c:4507:mdt_save_lock()) ### save lock request 00000000ac34ea74 reply state 00000000e0783eff transno 4294967355 ns: mdt-lustre-MDT0000_UUID lock: ffff8cb7c4c39000/0xf4f48ce5e1bbf303 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789049499.191292:0:5852:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1789049499.191606:0:5852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8c6323100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e823b53a-3591-475c-8624-c682227e5c13+30:10431:x1875954089630976:12345-192.168.206.26@tcp:36:lhsmtool_posix.0 Request processed in 1250us (2555us total) trans 4294967355 rc 0/0 00000100:00100000:0.0:1789049499.191625:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.26@tcp, seq: 75 00000100:00100000:2.0:1789049499.205566:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.26@tcp (source: 12345-192.168.206.26@tcp) 00000100:00100000:3.0:1789049499.206304:0:6841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954089631104 00000100:00100000:3.0:1789049499.206316:0:6841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954089631104 00000100:00100000:3.0:1789049499.206388:0:6841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.26@tcp, seq: 76 00000100:00100000:3.0:1789049499.206398:0:6841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8ff3c8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e823b53a-3591-475c-8624-c682227e5c13+30:10431:x1875954089631104:12345-192.168.206.26@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789049499.206421:0:6841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789049499.206440:0:6841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c6b35800/0xf4f48ce5e1bbf30a lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7fc5e358805a344e expref: -99 pid: 6841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049499.206740:0:6841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c6b35800/0xf4f48ce5e1bbf30a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a344e expref: 31 pid: 6841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049499.206755:0:6841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c6b35800/0xf4f48ce5e1bbf30a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a344e expref: 31 pid: 6841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049499.206772:0:6841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff8cb8c396d900) 00010000:00010000:3.0:1789049499.206775:0:6841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1789049499.206779:0:6841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cb8c6b35800, rc 0) 00000100:00100000:3.0:1789049499.206877:0:6841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8ff3c8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e823b53a-3591-475c-8624-c682227e5c13+31:10431:x1875954089631104:12345-192.168.206.26@tcp:101:lhsmtool_posix.0 Request processed in 480us (1318us total) trans 0 rc 0/0 00000100:00100000:3.0:1789049499.206884:0:6841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.26@tcp, seq: 76 00010000:00010000:0.0:1789049499.211663:0:3295:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb7c4c39000/0xf4f48ce5e1bbf303 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049499.211682:0:3295:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cb7c4c39000/0xf4f48ce5e1bbf303 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049499.211690:0:3295:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cb7c4c39000/0xf4f48ce5e1bbf303 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049499.211696:0:3295:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cb7c4c39000 already unused, calling callback (ffffffffc20ca4f0) 00010000:00010000:0.0:1789049499.211701:0:3295:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb7c4c39000/0xf4f48ce5e1bbf303 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049499.211708:0:3295:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb7c4c39000/0xf4f48ce5e1bbf303 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049499.211725:0:3295:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff8cb8c396d900) 00010000:00010000:0.0:1789049499.211729:0:3295:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1789049499.211733:0:3295:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cb7c4c39000/0xf4f48ce5e1bbf303 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049499.211740:0:3295:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb7c4c39000/0xf4f48ce5e1bbf303 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789049499.212215:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.26@tcp (source: 12345-192.168.206.26@tcp) 00000100:00100000:1.0:1789049499.212317:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954089631232 00000100:00100000:1.0:1789049499.212351:0:6704:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954089631232 00000100:00100000:1.0:1789049499.212400:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.26@tcp, seq: 25 00000100:00100000:1.0:1789049499.212408:0:6704:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8c59cb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2354:x1875954089631232:12345-192.168.206.26@tcp:8:lhsmtool_posix.0 00010000:00080000:1.0:1789049499.212440:0:6704:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0000: connection from e823b53a-3591-475c-8624-c682227e5c13@192.168.206.26@tcp t0 exp 0000000000000000 cur 325 last 0 00000020:00000080:1.0:1789049499.212481:0:6704:0:(genops.c:1384:class_connect()) connect: client e823b53a-3591-475c-8624-c682227e5c13, cookie 0xf4f48ce5e1bbf311 00002000:00100000:1.0:1789049499.212492:0:6704:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli e823b53a-3591-475c-8624-c682227e5c13/ffff8cb8df3d5000 ocd_connect_flags: 0xa046faf2e3640038 ocd_version: 2113a28 ocd_grant: 3407872 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1789049499.212515:0:6704:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:1.0:1789049499.212729:0:6704:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:1.0:1789049499.212759:0:6704:0:(import.c:65:import_set_state_nolock()) ffff8cb8df3d7800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1789049499.212833:0:6704:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8c59cb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e823b53a-3591-475c-8624-c682227e5c13+6:2354:x1875954089631232:12345-192.168.206.26@tcp:8:lhsmtool_posix.0 Request processed in 423us (621us total) trans 0 rc 0/0 00000100:00100000:1.0:1789049499.212864:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.26@tcp, seq: 25 00000100:00100000:1.0:1789049499.219882:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.26@tcp (source: 12345-192.168.206.26@tcp) 00000100:00100000:2.0:1789049499.220013:0:10560:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954089631360 00000100:00100000:2.0:1789049499.220022:0:10560:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954089631360 00000100:00100000:2.0:1789049499.220093:0:10560:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.26@tcp, seq: 26 00000100:00100000:2.0:1789049499.220103:0:10560:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8df209180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e823b53a-3591-475c-8624-c682227e5c13+6:0:x1875954089631360:12345-192.168.206.26@tcp:2:lhsmtool_posix.0 00000100:00080000:0.0:1789049499.220425:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:00100000:3.0:1789049499.286581:0:6731:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of e823b53a-3591-475c-8624-c682227e5c13 00000001:00080000:3.0:1789049499.286601:0:6731:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967301 is committed 00000100:00100000:2.0:1789049499.286888:0:10560:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8df209180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e823b53a-3591-475c-8624-c682227e5c13+5:0:x1875954089631360:12345-192.168.206.26@tcp:2:lhsmtool_posix.0 Request processed in 66780us (67042us total) trans 4294967301 rc 0/0 00000100:00100000:2.0:1789049499.286899:0:10560:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.26@tcp, seq: 26 00000100:00100000:0.0:1789049499.292073:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.26@tcp (source: 12345-192.168.206.26@tcp) 00000100:00100000:3.0:1789049499.295267:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954089631616 00000100:00100000:3.0:1789049499.295282:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954089631616 00000100:00100000:3.0:1789049499.295356:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.26@tcp, seq: 19 00000100:00100000:2.0:1789049499.296367:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb900a54a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e823b53a-3591-475c-8624-c682227e5c13+30:10431:x1875954089631616:12345-192.168.206.26@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1789049499.296792:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb900a54a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e823b53a-3591-475c-8624-c682227e5c13+31:10431:x1875954089631616:12345-192.168.206.26@tcp:35:lhsmtool_posix.0 Request processed in 762us (4727us total) trans 4294967356 rc 0/0 00000100:00100000:2.0:1789049499.296802:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.26@tcp, seq: 19 00000100:00100000:3.0:1789049499.306211:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.26@tcp (source: 12345-192.168.206.26@tcp) 00000100:00100000:2.0:1789049499.306372:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954089631872 00000100:00100000:2.0:1789049499.306381:0:5850:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954089631872 00000100:00100000:2.0:1789049499.306450:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.26@tcp, seq: 77 00000100:00100000:2.0:1789049499.306459:0:5850:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8c633c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e823b53a-3591-475c-8624-c682227e5c13+31:10431:x1875954089631872:12345-192.168.206.26@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1789049499.306609:0:5850:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8c633c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e823b53a-3591-475c-8624-c682227e5c13+31:10431:x1875954089631872:12345-192.168.206.26@tcp:57:lhsmtool_posix.0 Request processed in 150us (406us total) trans 0 rc 0/0 00000100:00100000:2.0:1789049499.306617:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.26@tcp, seq: 77 00000100:00100000:3.0:1789049499.312767:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.26@tcp (source: 12345-192.168.206.26@tcp) 00000100:00100000:1.0:1789049499.312955:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954089632000 00000100:00100000:1.0:1789049499.312964:0:5852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954089632000 00000100:00100000:1.0:1789049499.313018:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.26@tcp, seq: 78 00000100:00100000:1.0:1789049499.313027:0:5852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8c633f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e823b53a-3591-475c-8624-c682227e5c13+31:10431:x1875954089632000:12345-192.168.206.26@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1789049499.313093:0:5852:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789049499.313117:0:5852:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c2e00/0xf4f48ce5e1bbf318 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7fc5e358805a3455 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049499.313206:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c3800/0xf4f48ce5e1bbf31f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049499.313221:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c3800/0xf4f48ce5e1bbf31f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049499.313242:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c3800/0xf4f48ce5e1bbf31f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789049499.313279:0:5852:0:(mdt_handler.c:1587:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1789049499.313298:0:5852:0:(mdt_handler.c:2522:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c3800/0xf4f48ce5e1bbf31f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049499.316272:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c2e00/0xf4f48ce5e1bbf318 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a3455 expref: 33 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049499.316310:0:5852:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c3800/0xf4f48ce5e1bbf31f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a3455 expref: 32 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049499.316466:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff8cb8c396d900) 00010000:00010000:1.0:1789049499.316469:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1789049499.316472:0:5852:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cb8c28c3800, rc 0) 00000100:00100000:0.0:1789049499.316605:0:5852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8c633f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e823b53a-3591-475c-8624-c682227e5c13+32:10431:x1875954089632000:12345-192.168.206.26@tcp:101:lhsmtool_posix.0 Request processed in 3576us (3844us total) trans 0 rc 0/0 00000100:00100000:0.0:1789049499.316614:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.26@tcp, seq: 78 00000100:00100000:0.0:1789049499.328619:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.26@tcp (source: 12345-192.168.206.26@tcp) 00000100:00100000:1.0:1789049499.328971:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954089632128 00000100:00100000:1.0:1789049499.328981:0:6704:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954089632128 00000100:00100000:0.0:1789049499.329109:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.26@tcp, seq: 27 00000100:00100000:0.0:1789049499.329119:0:6704:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb900a54e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e823b53a-3591-475c-8624-c682227e5c13+5:2356:x1875954089632128:12345-192.168.206.26@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789049499.329136:0:6704:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789049499.329159:0:6704:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f535ea4e/0xf4f48ce5e1bbf326 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x7fc5e358805a345c expref: -99 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789049499.329185:0:6704:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x18d3fb0a43ebf200, blocks: 0x1 00010000:00010000:0.0:1789049499.329203:0:6704:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=325s v=(0 0) 00010000:00010000:0.0:1789049499.329207:0:6704:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789049499.329216:0:6704:0:(ldlm_resource.c:1751:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f535ea4e/0xf4f48ce5e1bbf326 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a345c expref: 6 pid: 6704 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049499.329236:0:6704:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000f535ea4e/0xf4f48ce5e1bbf326 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a345c expref: 6 pid: 6704 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049499.329249:0:6704:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cb7c4c39a00, rc 0) 00000100:00100000:0.0:1789049499.329366:0:6704:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb900a54e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e823b53a-3591-475c-8624-c682227e5c13+6:2356:x1875954089632128:12345-192.168.206.26@tcp:101:lhsmtool_posix.0 Request processed in 248us (755us total) trans 0 rc 0/0 00000100:00100000:0.0:1789049499.329374:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.26@tcp, seq: 27 00000100:00100000:1.0:1789049499.337080:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.26@tcp (source: 12345-192.168.206.26@tcp) 00000100:00100000:2.0:1789049499.337160:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954089632384 00000100:00100000:2.0:1789049499.337169:0:5850:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954089632384 00000100:00100000:2.0:1789049499.337226:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.26@tcp, seq: 79 00000100:00100000:2.0:1789049499.337235:0:5850:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8df20b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e823b53a-3591-475c-8624-c682227e5c13+32:10431:x1875954089632384:12345-192.168.206.26@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1789049499.337362:0:5850:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8df20b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e823b53a-3591-475c-8624-c682227e5c13+32:10431:x1875954089632384:12345-192.168.206.26@tcp:57:lhsmtool_posix.0 Request processed in 128us (291us total) trans 0 rc 0/0 00000100:00100000:2.0:1789049499.337370:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.26@tcp, seq: 79 00000100:00100000:3.0:1789049499.343688:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.26@tcp (source: 12345-192.168.206.26@tcp) 00000100:00100000:0.0:1789049499.343820:0:6705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954089632512 00000100:00100000:0.0:1789049499.343829:0:6705:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954089632512 00000100:00100000:0.0:1789049499.343917:0:6705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.26@tcp, seq: 28 00000100:00100000:0.0:1789049499.343927:0:6705:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8c633fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e823b53a-3591-475c-8624-c682227e5c13+6:10431:x1875954089632512:12345-192.168.206.26@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789049499.343944:0:6705:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789049499.343961:0:6705:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e3341081/0xf4f48ce5e1bbf32d lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x7fc5e358805a3463 expref: -99 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049499.344000:0:6705:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000f535ea4e/0xf4f48ce5e1bbf326 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a345c expref: 7 pid: 6704 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049499.344009:0:6705:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789049499.344013:0:6705:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789049499.344019:0:6705:0:(ldlm_resource.c:1751:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e3341081/0xf4f48ce5e1bbf32d lrc: 4/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a3463 expref: 7 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049499.344051:0:6705:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000f535ea4e/0xf4f48ce5e1bbf326 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a345c expref: 7 pid: 6704 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049499.344064:0:6705:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000f535ea4e/0xf4f48ce5e1bbf326 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a345c expref: 7 pid: 6704 timeout: 425 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789049499.344079:0:6705:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb900a54700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6705:1875954110625536:192.168.206.26@tcp:104: 00000100:00100000:0.0:1789049499.344170:0:6705:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cb8c6b2a300 going to sleep for 11 seconds 00000100:00100000:2.0:1789049499.355368:0:6705:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb900a54700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6705:1875954110625536:192.168.206.26@tcp:104: 00010000:00010000:2.0:1789049499.355409:0:6705:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000e3341081/0xf4f48ce5e1bbf32d lrc: 3/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a3463 expref: 7 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049499.355433:0:6705:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cb7c4c38a00, rc 0) 00000100:00100000:2.0:1789049499.355626:0:6705:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8c633fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e823b53a-3591-475c-8624-c682227e5c13+7:10431:x1875954089632512:12345-192.168.206.26@tcp:101:lhsmtool_posix.0 Request processed in 11699us (11945us total) trans 0 rc 0/0 00000100:00100000:2.0:1789049499.355636:0:6705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.26@tcp, seq: 28 00010000:00010000:2.0:1789049499.356968:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789049499.357115:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.26@tcp (source: 12345-192.168.206.26@tcp) 00000100:00100000:3.0:1789049499.357622:0:6720:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954089632640 00000100:00100000:3.0:1789049499.357633:0:6720:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954089632640 00010000:00010000:3.0:1789049499.357677:0:6720:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000f535ea4e/0xf4f48ce5e1bbf326 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a345c expref: 7 pid: 6704 timeout: 425 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789049499.357720:0:6720:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.26@tcp, seq: 42 00000100:00100000:3.0:1789049499.357729:0:6720:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8c7dec050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e823b53a-3591-475c-8624-c682227e5c13+7:2357:x1875954089632640:12345-192.168.206.26@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789049499.357742:0:6720:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789049499.357764:0:6720:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000f535ea4e/0xf4f48ce5e1bbf326 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a345c expref: 7 pid: 6704 timeout: 425 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049499.357779:0:6720:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000f535ea4e/0xf4f48ce5e1bbf326 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a345c expref: 7 pid: 6704 timeout: 425 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049499.357802:0:6720:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f535ea4e/0xf4f48ce5e1bbf326 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a345c expref: 7 pid: 6704 timeout: 425 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049499.357819:0:6720:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789049499.357823:0:6720:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789049499.357831:0:6720:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000e3341081/0xf4f48ce5e1bbf32d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a3463 expref: 6 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049499.357888:0:6720:0:(ldlm_resource.c:1751:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e3341081/0xf4f48ce5e1bbf32d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a3463 expref: 6 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049499.357938:0:6720:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000e3341081/0xf4f48ce5e1bbf32d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a3463 expref: 6 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789049499.357954:0:6720:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb8c633dc00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:6720:1875954110625664:192.168.206.26@tcp:105: 00000100:00100000:3.0:1789049499.358021:0:6720:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cb7c4e73240 going to sleep for 11 seconds 00000100:00100000:2.0:1789049499.370553:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.26@tcp (source: 12345-192.168.206.26@tcp) 00000100:00100000:3.0:1789049499.370688:0:6720:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb8c633dc00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:6720:1875954110625664:192.168.206.26@tcp:105: 00010000:00010000:3.0:1789049499.370728:0:6720:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789049499.370789:0:6720:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8c7dec050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e823b53a-3591-475c-8624-c682227e5c13+6:2357:x1875954089632640:12345-192.168.206.26@tcp:103:ldlm_bl.0 Request processed in 13060us (13676us total) trans 0 rc 0/0 00000100:00100000:3.0:1789049499.370800:0:6720:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.26@tcp, seq: 42 00000100:00100000:1.0:1789049499.371013:0:6710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954089632768 00000100:00100000:1.0:1789049499.371020:0:6710:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954089632768 00002000:00100000:1.0:1789049499.371060:0:6710:0:(ofd_dev.c:2725:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3:0x0] (0->8) req@ffff8cb8df260a80 x1875954089632768/t0(0) o4->e823b53a-3591-475c-8624-c682227e5c13@192.168.206.26@tcp:0/0 lens 504/0 e 0 to 0 dl 1789049510 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789049499.371070:0:6710:0:(ofd_dev.c:2581:ofd_prolong_extent_locks()) Prolong locks for req ffff8cb8df260a80 with x1875954089632768 ext(0->8) 00002000:00010000:1.0:1789049499.371075:0:6710:0:(ofd_dev.c:2730:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8cb8df260a80 00000100:00100000:1.0:1789049499.371104:0:6710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.26@tcp, seq: 0 00000100:00100000:1.0:1789049499.371114:0:6710:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8df260a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e823b53a-3591-475c-8624-c682227e5c13+6:2357:x1875954089632768:12345-192.168.206.26@tcp:4:lhsmtool_posix.0 00000100:00100000:1.0:1789049499.372514:0:6710:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8df260a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e823b53a-3591-475c-8624-c682227e5c13+8:2357:x1875954089632768:12345-192.168.206.26@tcp:4:lhsmtool_posix.0 Request processed in 1395us (1962us total) trans 4294967302 rc 0/0 00000100:00100000:1.0:1789049499.372526:0:6710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.26@tcp, seq: 0 00002000:00100000:1.0:1789049499.372535:0:6710:0:(ofd_dev.c:2725:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3:0x0] (0->8) req@ffff8cb8df260a80 x1875954089632768/t4294967302(0) o4->e823b53a-3591-475c-8624-c682227e5c13@192.168.206.26@tcp:0/0 lens 504/448 e 0 to 0 dl 1789049510 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789049499.372544:0:6710:0:(ofd_dev.c:2581:ofd_prolong_extent_locks()) Prolong locks for req ffff8cb8df260a80 with x1875954089632768 ext(0->8) 00002000:00010000:1.0:1789049499.372549:0:6710:0:(ofd_dev.c:2730:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8cb8df260a80 00000100:00100000:3.0:1789049499.385398:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.26@tcp (source: 12345-192.168.206.26@tcp) 00000100:00100000:0.0:1789049499.386592:0:6841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954089632896 00000100:00100000:0.0:1789049499.386604:0:6841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954089632896 00000100:00100000:0.0:1789049499.386673:0:6841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.26@tcp, seq: 80 00000100:00100000:0.0:1789049499.386683:0:6841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8c633dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e823b53a-3591-475c-8624-c682227e5c13+32:10431:x1875954089632896:12345-192.168.206.26@tcp:44:lhsmtool_posix.0 00000100:00100000:0.0:1789049499.456994:0:6841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8c633dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e823b53a-3591-475c-8624-c682227e5c13+32:10431:x1875954089632896:12345-192.168.206.26@tcp:44:lhsmtool_posix.0 Request processed in 70302us (71595us total) trans 0 rc 0/0 00000100:00100000:0.0:1789049499.457008:0:6841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.26@tcp, seq: 80 00000001:00080000:3.0:1789049499.457483:0:5872:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967355 is committed 00000004:00080000:3.0:1789049499.457490:0:5872:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 4 committed 00000001:00080000:3.0:1789049499.457518:0:5872:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967356 is committed 00000020:00080000:3.0:1789049499.457548:0:5872:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 1 batchid updated 00000020:00080000:3.0:1789049499.457567:0:5883:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 1 00000020:00080000:3.0:1789049499.457576:0:5883:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 1 00000100:00100000:0.0:1789049499.458512:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb8df260e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3311:1875954110625792:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1789049499.458586:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789049499.460269:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.26@tcp (source: 12345-192.168.206.26@tcp) 00000100:00100000:3.0:1789049499.460304:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954110625792 00000100:00100000:3.0:1789049499.460328:0:6704:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954110625792 00000100:00100000:3.0:1789049499.460387:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954089633024 00000100:00100000:3.0:1789049499.460391:0:6704:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954089633024 00000100:00100000:3.0:1789049499.460432:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1789049499.460442:0:6704:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb900a55500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3311:x1875954110625792:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:3.0:1789049499.460613:0:6704:0:(ofd_lvb.c:321:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:3.0:1789049499.460617:0:6704:0:(ofd_lvb.c:328:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb mtime from disk: 0 -> 1789049498684044724 00002000:00010000:3.0:1789049499.460620:0:6704:0:(ofd_lvb.c:334:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1789049499.460622:0:6704:0:(ofd_lvb.c:340:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb ctime from disk: 1789049498504000000 -> 1789049498684044724 00002000:00010000:3.0:1789049499.460624:0:6704:0:(ofd_lvb.c:346:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:3.0:1789049499.460682:0:6704:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb900a55500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3311:x1875954110625792:12345-0@lo:2:osp-syn-0-0.0 Request processed in 241us (2096us total) trans 4294967303 rc 0/0 00000100:00100000:3.0:1789049499.460690:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1789049499.461887:0:6703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.26@tcp, seq: 30 00000100:00080000:3.0:1789049499.462077:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789049499.462077:0:6703:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8c633ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e823b53a-3591-475c-8624-c682227e5c13+8:2356:x1875954089633024:12345-192.168.206.26@tcp:16:lhsmtool_posix.0 00000004:00080000:3.0:1789049499.462140:0:3311:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8cb8df260e00/2, rc 0, transno 4294967303 00000100:00100000:3.0:1789049499.462149:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb8df260e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3311:1875954110625792:0@lo:2:osp-syn-0-0.0 00000001:00080000:3.0:1789049499.519181:0:6731:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967302 is committed 00000001:00080000:3.0:1789049499.519201:0:6731:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967303 is committed 00000100:00100000:1.0:1789049499.519667:0:6703:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8c633ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e823b53a-3591-475c-8624-c682227e5c13+6:2356:x1875954089633024:12345-192.168.206.26@tcp:16:lhsmtool_posix.0 Request processed in 57764us (59402us total) trans 0 rc 0/0 00000100:00100000:1.0:1789049499.519679:0:6703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.26@tcp, seq: 30 00000100:00100000:2.0:1789049499.532098:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.26@tcp (source: 12345-192.168.206.26@tcp) 00000100:00100000:1.0:1789049499.532197:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954089633280 00000100:00100000:1.0:1789049499.532206:0:5850:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954089633280 00000100:00100000:1.0:1789049499.532261:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.26@tcp, seq: 81 00000100:00100000:1.0:1789049499.532271:0:5850:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8df260700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e823b53a-3591-475c-8624-c682227e5c13+13:10431:x1875954089633280:12345-192.168.206.26@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1789049499.532333:0:5850:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789049499.532359:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c3800/0xf4f48ce5e1bbf31f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a3455 expref: 13 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049499.532378:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff8cb8c396d900) 00010000:00010000:1.0:1789049499.532383:0:5850:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789049499.532411:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c3200/0xf4f48ce5e1bbf334 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049499.532424:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c3200/0xf4f48ce5e1bbf334 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049499.532452:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c3200/0xf4f48ce5e1bbf334 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789049499.532829:0:5850:0:(mdt_handler.c:4507:mdt_save_lock()) ### save lock request 00000000ff30d269 reply state 00000000f26d3317 transno 4294967357 ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c3200/0xf4f48ce5e1bbf334 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789049499.532839:0:5850:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1789049499.532992:0:5850:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8df260700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e823b53a-3591-475c-8624-c682227e5c13+14:10431:x1875954089633280:12345-192.168.206.26@tcp:36:lhsmtool_posix.0 Request processed in 721us (901us total) trans 4294967357 rc 0/0 00000100:00100000:1.0:1789049499.533000:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.26@tcp, seq: 81 00010000:00010000:2.0:1789049499.541409:0:3294:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c3200/0xf4f48ce5e1bbf334 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049499.541429:0:3294:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c3200/0xf4f48ce5e1bbf334 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049499.541438:0:3294:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c3200/0xf4f48ce5e1bbf334 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049499.541445:0:3294:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cb8c28c3200 already unused, calling callback (ffffffffc20ca4f0) 00010000:00010000:2.0:1789049499.541451:0:3294:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c3200/0xf4f48ce5e1bbf334 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049499.541459:0:3294:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c3200/0xf4f48ce5e1bbf334 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049499.541476:0:3294:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff8cb8c396d900) 00010000:00010000:2.0:1789049499.541479:0:3294:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789049499.541485:0:3294:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c3200/0xf4f48ce5e1bbf334 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049499.541491:0:3294:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c3200/0xf4f48ce5e1bbf334 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789049499.551763:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.26@tcp (source: 12345-192.168.206.26@tcp) 00000100:00100000:3.0:1789049499.552529:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954089633408 00000100:00100000:3.0:1789049499.552541:0:6704:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954089633408 00000100:00100000:3.0:1789049499.552606:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.26@tcp, seq: 31 00000100:00100000:3.0:1789049499.552616:0:6704:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb900a55180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e823b53a-3591-475c-8624-c682227e5c13+6:2357:x1875954089633408:12345-192.168.206.26@tcp:2:lhsmtool_posix.0 00002000:00010000:3.0:1789049499.552884:0:6704:0:(ofd_lvb.c:321:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb size from disk: 9 -> 9 00002000:00010000:3.0:1789049499.552887:0:6704:0:(ofd_lvb.c:328:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb mtime from disk: 1789049498684044724 -> 1789049497933000000 00002000:00010000:3.0:1789049499.552891:0:6704:0:(ofd_lvb.c:334:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb atime from disk: 0 -> 1789049496082000000 00002000:00010000:3.0:1789049499.552893:0:6704:0:(ofd_lvb.c:340:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb ctime from disk: 1789049498684044724 -> 1789049497933000000 00002000:00010000:3.0:1789049499.552895:0:6704:0:(ofd_lvb.c:346:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:3.0:1789049499.552963:0:6704:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb900a55180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e823b53a-3591-475c-8624-c682227e5c13+7:2357:x1875954089633408:12345-192.168.206.26@tcp:2:lhsmtool_posix.0 Request processed in 348us (1208us total) trans 4294967304 rc 0/0 00000100:00100000:3.0:1789049499.552986:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.26@tcp, seq: 31 00000100:00100000:3.0:1789049499.557944:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.26@tcp (source: 12345-192.168.206.26@tcp) 00000100:00100000:0.0:1789049499.558047:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954089633664 00000100:00100000:0.0:1789049499.558057:0:5852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954089633664 00000100:00100000:0.0:1789049499.558111:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.26@tcp, seq: 82 00000100:00100000:0.0:1789049499.558121:0:5852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8c633c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e823b53a-3591-475c-8624-c682227e5c13+13:10431:x1875954089633664:12345-192.168.206.26@tcp:55:lhsmtool_posix.0 00010000:00010000:0.0:1789049499.558192:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb7c4c38400/0xf4f48ce5e1bbf33b lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049499.558210:0:5852:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c2c00/0xf4f48ce5e1bbf2fc lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a3447 expref: 13 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049499.558221:0:5852:0:(ldlm_resource.c:1751:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cb7c4c38400/0xf4f48ce5e1bbf33b lrc: 4/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049499.558274:0:5852:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c2c00/0xf4f48ce5e1bbf2fc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a3447 expref: 13 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049499.558289:0:5852:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c2c00/0xf4f48ce5e1bbf2fc lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a3447 expref: 13 pid: 5850 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789049499.558305:0:5852:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb900a57800 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5852:1875954110625920:192.168.206.26@tcp:104: 00000100:00100000:0.0:1789049499.558411:0:5852:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cb8c6b2a000 going to sleep for 11 seconds 00000100:00100000:1.0:1789049499.563291:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.26@tcp (source: 12345-192.168.206.26@tcp) 00000100:00100000:3.0:1789049499.563362:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954089633792 00000100:00100000:3.0:1789049499.563371:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954089633792 00010000:00010000:3.0:1789049499.563800:0:5837:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c2c00/0xf4f48ce5e1bbf2fc lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a3447 expref: 14 pid: 5850 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789049499.564422:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.26@tcp, seq: 43 00000100:00100000:3.0:1789049499.564435:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8df208000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e823b53a-3591-475c-8624-c682227e5c13+14:2358:x1875954089633792:12345-192.168.206.26@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789049499.564450:0:5837:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789049499.564457:0:5837:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c2c00/0xf4f48ce5e1bbf2fc lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a3447 expref: 14 pid: 5850 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049499.564471:0:5837:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c2c00/0xf4f48ce5e1bbf2fc lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a3447 expref: 14 pid: 5850 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049499.564493:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff8cb8c396d900) 00010000:00010000:3.0:1789049499.564498:0:5837:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8cb7c4c38400/0xf4f48ce5e1bbf33b lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049499.564508:0:5837:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb7c4c38400/0xf4f48ce5e1bbf33b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049499.564516:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cb7c4c38400/0xf4f48ce5e1bbf33b lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049499.564536:0:5837:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789049499.564590:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8df208000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e823b53a-3591-475c-8624-c682227e5c13+14:2358:x1875954089633792:12345-192.168.206.26@tcp:103:ldlm_bl.0 Request processed in 159us (1307us total) trans 0 rc 0/0 00000100:00100000:3.0:1789049499.564605:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.26@tcp, seq: 43 00010000:00010000:0.0:1789049499.565250:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c2c00/0xf4f48ce5e1bbf2fc lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a3447 expref: 13 pid: 5850 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789049499.565270:0:5852:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb900a57800 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5852:1875954110625920:192.168.206.26@tcp:104: 00010000:00010000:0.0:1789049499.565301:0:5852:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8cb7c4c38400/0xf4f48ce5e1bbf33b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049499.565310:0:5852:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8cb7c4c38400/0xf4f48ce5e1bbf33b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049499.565728:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb7c4c38400/0xf4f48ce5e1bbf33b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049499.565764:0:5852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb7c4c38400/0xf4f48ce5e1bbf33b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049499.565772:0:5852:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cb7c4c38400/0xf4f48ce5e1bbf33b lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049499.565779:0:5852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cb7c4c38400/0xf4f48ce5e1bbf33b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049499.565786:0:5852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cb7c4c38400 already unused, calling callback (ffffffffc20ca4f0) 00010000:00010000:0.0:1789049499.565791:0:5852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb7c4c38400/0xf4f48ce5e1bbf33b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049499.565798:0:5852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb7c4c38400/0xf4f48ce5e1bbf33b lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049499.565812:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff8cb8c396d900) 00010000:00010000:0.0:1789049499.565815:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:0.0:1789049499.565820:0:5852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cb7c4c38400/0xf4f48ce5e1bbf33b lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049499.565827:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb7c4c38400/0xf4f48ce5e1bbf33b lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789049499.565953:0:5852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8c633c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e823b53a-3591-475c-8624-c682227e5c13+12:10431:x1875954089633664:12345-192.168.206.26@tcp:55:lhsmtool_posix.0 Request processed in 7832us (8019us total) trans 0 rc -22/-22 00000100:00100000:0.0:1789049499.565963:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.26@tcp, seq: 82 00000100:00100000:1.0:1789049499.571176:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.26@tcp (source: 12345-192.168.206.26@tcp) 00000100:00100000:3.0:1789049499.571262:0:6705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954089633920 00000100:00100000:3.0:1789049499.571273:0:6705:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954089633920 00000100:00100000:3.0:1789049499.571336:0:6705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.26@tcp, seq: 32 00000100:00100000:3.0:1789049499.571346:0:6705:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8df20ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e823b53a-3591-475c-8624-c682227e5c13+7:2355:x1875954089633920:12345-192.168.206.26@tcp:1:lhsmtool_posix.0 00010000:00010000:3.0:1789049499.571396:0:6705:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000081773780/0xf4f48ce5e1bbf342 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049499.571417:0:6705:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000e3341081/0xf4f48ce5e1bbf32d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a3463 expref: 7 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049499.571425:0:6705:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789049499.571429:0:6705:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1789049499.571434:0:6705:0:(ldlm_resource.c:1751:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000081773780/0xf4f48ce5e1bbf342 lrc: 4/1,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049499.571468:0:6705:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000e3341081/0xf4f48ce5e1bbf32d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a3463 expref: 7 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049499.571483:0:6705:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000e3341081/0xf4f48ce5e1bbf32d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a3463 expref: 7 pid: 6705 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789049499.571497:0:6705:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb8ff3c8e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6705:1875954110626048:192.168.206.26@tcp:104: 00000100:00100000:3.0:1789049499.571732:0:6705:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cb7c4e73540 going to sleep for 11 seconds 00000100:00100000:3.0:1789049499.575172:0:6705:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb8ff3c8e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6705:1875954110626048:192.168.206.26@tcp:104: 00010000:00010000:3.0:1789049499.575212:0:6705:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000081773780/0xf4f48ce5e1bbf342 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789049499.577029:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.26@tcp (source: 12345-192.168.206.26@tcp) 00000100:00100000:2.0:1789049499.577079:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954089634048 00000100:00100000:2.0:1789049499.577089:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954089634048 00010000:00010000:2.0:1789049499.577128:0:5835:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000e3341081/0xf4f48ce5e1bbf32d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a3463 expref: 8 pid: 6705 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789049499.577170:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.26@tcp, seq: 44 00000100:00100000:2.0:1789049499.577192:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8df209f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e823b53a-3591-475c-8624-c682227e5c13+8:2357:x1875954089634048:12345-192.168.206.26@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789049499.577207:0:5835:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789049499.577229:0:5835:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000e3341081/0xf4f48ce5e1bbf32d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a3463 expref: 8 pid: 6705 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049499.577243:0:5835:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000e3341081/0xf4f48ce5e1bbf32d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a3463 expref: 8 pid: 6705 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049499.577265:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e3341081/0xf4f48ce5e1bbf32d lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a3463 expref: 8 pid: 6705 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049499.577279:0:5835:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1789049499.577283:0:5835:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1789049499.577289:0:5835:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000081773780/0xf4f48ce5e1bbf342 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049499.577298:0:5835:0:(ldlm_resource.c:1751:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000081773780/0xf4f48ce5e1bbf342 lrc: 4/1,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049499.577332:0:5835:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789049499.577363:0:6705:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000081773780/0xf4f48ce5e1bbf342 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049499.577375:0:6705:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000081773780/0xf4f48ce5e1bbf342 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789049499.577393:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8df209f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e823b53a-3591-475c-8624-c682227e5c13+7:2357:x1875954089634048:12345-192.168.206.26@tcp:103:ldlm_bl.0 Request processed in 201us (372us total) trans 0 rc 0/0 00000100:00100000:2.0:1789049499.577404:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.26@tcp, seq: 44 00010000:00010000:3.0:1789049499.577417:0:6705:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000081773780/0xf4f48ce5e1bbf342 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049499.577427:0:6705:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000081773780/0xf4f48ce5e1bbf342 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049499.577435:0:6705:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000081773780/0xf4f48ce5e1bbf342 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049499.577442:0:6705:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cb8c6b35c00 already unused, calling callback (ffffffffc166a8f0) 00010000:00010000:3.0:1789049499.577446:0:6705:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000081773780/0xf4f48ce5e1bbf342 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049499.577455:0:6705:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000081773780/0xf4f48ce5e1bbf342 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049499.577467:0:6705:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000081773780/0xf4f48ce5e1bbf342 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049499.577483:0:6705:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000081773780/0xf4f48ce5e1bbf342 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789049499.577529:0:6705:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8df20ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e823b53a-3591-475c-8624-c682227e5c13+6:2355:x1875954089633920:12345-192.168.206.26@tcp:1:lhsmtool_posix.0 Request processed in 6184us (6361us total) trans 0 rc 0/0 00000100:00100000:3.0:1789049499.577537:0:6705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.26@tcp, seq: 32 00000100:00100000:0.0:1789049499.579492:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.26@tcp (source: 12345-192.168.206.26@tcp) 00000100:00100000:2.0:1789049499.579557:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954089634304 00000100:00100000:2.0:1789049499.579565:0:5851:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954089634304 00000100:00100000:2.0:1789049499.579618:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.26@tcp, seq: 83 00000100:00100000:2.0:1789049499.579628:0:5851:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb900a57800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e823b53a-3591-475c-8624-c682227e5c13+12:10431:x1875954089634304:12345-192.168.206.26@tcp:57:lhsmtool_posix.0 00010000:00010000:2.0:1789049499.579710:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6714a00/0xf4f48ce5e1bbf349 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049499.579726:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6714a00/0xf4f48ce5e1bbf349 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049499.579739:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6714a00/0xf4f48ce5e1bbf349 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049499.580045:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6715200/0xf4f48ce5e1bbf350 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049499.580057:0:5851:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c6b35800/0xf4f48ce5e1bbf30a lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a344e expref: 13 pid: 6841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049499.580065:0:5851:0:(ldlm_resource.c:1751:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6715200/0xf4f48ce5e1bbf350 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049499.580099:0:5851:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c6b35800/0xf4f48ce5e1bbf30a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a344e expref: 13 pid: 6841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049499.580113:0:5851:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c6b35800/0xf4f48ce5e1bbf30a lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a344e expref: 13 pid: 6841 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789049499.580128:0:5851:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb8df261500 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5851:1875954110626176:192.168.206.26@tcp:104: 00000100:00100000:2.0:1789049499.580214:0:5851:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cb8d0aaa6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789049499.599445:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.26@tcp (source: 12345-192.168.206.26@tcp) 00000100:00100000:1.0:1789049499.599522:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954089634432 00000100:00100000:1.0:1789049499.599531:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954089634432 00010000:00010000:1.0:1789049499.599582:0:5836:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c6b35800/0xf4f48ce5e1bbf30a lrc: 5/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a344e expref: 14 pid: 6841 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789049499.599622:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.26@tcp, seq: 45 00000100:00100000:1.0:1789049499.599632:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8ff3c8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e823b53a-3591-475c-8624-c682227e5c13+14:2358:x1875954089634432:12345-192.168.206.26@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789049499.599645:0:5836:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789049499.599652:0:5836:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c6b35800/0xf4f48ce5e1bbf30a lrc: 5/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a344e expref: 14 pid: 6841 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049499.599665:0:5836:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c6b35800/0xf4f48ce5e1bbf30a lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a344e expref: 14 pid: 6841 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049499.599705:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff8cb8c396d900) 00010000:00010000:1.0:1789049499.599710:0:5836:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6715200/0xf4f48ce5e1bbf350 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049499.599719:0:5836:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6715200/0xf4f48ce5e1bbf350 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049499.599726:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6715200/0xf4f48ce5e1bbf350 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049499.599744:0:5836:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789049499.599797:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8ff3c8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e823b53a-3591-475c-8624-c682227e5c13+14:2358:x1875954089634432:12345-192.168.206.26@tcp:103:ldlm_bl.0 Request processed in 166us (372us total) trans 0 rc 0/0 00000100:00100000:1.0:1789049499.599805:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.26@tcp, seq: 45 00010000:00010000:2.0:1789049499.600047:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c6b35800/0xf4f48ce5e1bbf30a lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a344e expref: 13 pid: 6841 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789049499.600062:0:5851:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb8df261500 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5851:1875954110626176:192.168.206.26@tcp:104: 00010000:00010000:2.0:1789049499.600084:0:5851:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6715200/0xf4f48ce5e1bbf350 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049499.600093:0:5851:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6715200/0xf4f48ce5e1bbf350 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049499.600099:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6715200/0xf4f48ce5e1bbf350 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789049499.600259:0:5851:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967358 00000001:00080000:2.0:1789049499.600394:0:5851:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967359 00000001:00080000:2.0:1789049499.600436:0:5851:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967360 00000100:00100000:2.0:1789049499.600508:0:5851:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb8df261500 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5851:1875954110626304:0@lo:1000:mdt00_001.0 00000100:00100000:2.0:1789049499.600553:0:5851:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789049499.600574:0:5851:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cb8d0aaa780 going to sleep for 11 seconds 00000100:00100000:1.0:1789049499.600767:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954110626304 00000100:00100000:1.0:1789049499.600773:0:5856:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954110626304 00000100:00100000:1.0:1789049499.600812:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1789049499.600819:0:5856:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8df261180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5851:x1875954110626304:12345-0@lo:1000:mdt00_001.0 00000100:00100000:1.0:1789049499.600916:0:5856:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8df261180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5851:x1875954110626304:12345-0@lo:1000:mdt00_001.0 Request processed in 86us (351us total) trans 0 rc 0/0 00000100:00100000:1.0:1789049499.600922:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1789049499.601137:0:5851:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967303 gen 2 00000004:00080000:2.0:1789049499.601142:0:5851:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8cb8df260e00, transno 4294967303 00000100:00100000:2.0:1789049499.601154:0:5851:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb8df261500 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5851:1875954110626304:0@lo:1000:mdt00_001.0 00000001:00080000:2.0:1789049499.601665:0:5851:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967361 00000100:00100000:2.0:1789049499.601729:0:5851:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb8df261500 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5851:1875954110626432:0@lo:1000:mdt00_001.0 00000100:00100000:2.0:1789049499.601769:0:5851:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789049499.601792:0:5851:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cb8d0aaa6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789049499.602008:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954110626432 00000100:00100000:2.0:1789049499.602013:0:5856:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954110626432 00000100:00100000:2.0:1789049499.602055:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1789049499.602064:0:5856:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8df263800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5851:x1875954110626432:12345-0@lo:1000:mdt00_001.0 00000100:00100000:2.0:1789049499.602244:0:5856:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8df263800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5851:x1875954110626432:12345-0@lo:1000:mdt00_001.0 Request processed in 181us (473us total) trans 4294967305 rc 0/0 00000100:00100000:2.0:1789049499.602261:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1789049499.602302:0:5851:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb8df261500 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5851:1875954110626432:0@lo:1000:mdt00_001.0 00010000:00010000:2.0:1789049499.602334:0:5851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6715200/0xf4f48ce5e1bbf350 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049499.602345:0:5851:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6715200/0xf4f48ce5e1bbf350 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049499.602353:0:5851:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6715200/0xf4f48ce5e1bbf350 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049499.602359:0:5851:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cb8d6715200 already unused, calling callback (ffffffffc20ca4f0) 00010000:00010000:2.0:1789049499.602363:0:5851:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6715200/0xf4f48ce5e1bbf350 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049499.602372:0:5851:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6715200/0xf4f48ce5e1bbf350 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049499.602386:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff8cb8c396d900) 00010000:00010000:2.0:1789049499.602389:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1789049499.602394:0:5851:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6715200/0xf4f48ce5e1bbf350 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049499.602400:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6715200/0xf4f48ce5e1bbf350 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049499.602433:0:5851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6715a00/0xf4f48ce5e1bbf285 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049499.602441:0:5851:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6715a00/0xf4f48ce5e1bbf285 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049499.602457:0:5851:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6715a00/0xf4f48ce5e1bbf285 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049499.602463:0:5851:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cb8d6715a00 already unused, calling callback (ffffffffc20ca4f0) 00010000:00010000:2.0:1789049499.602466:0:5851:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6715a00/0xf4f48ce5e1bbf285 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049499.602474:0:5851:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6715a00/0xf4f48ce5e1bbf285 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049499.602483:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8cb8e0130f00) 00010000:00010000:2.0:1789049499.602486:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1789049499.602489:0:5851:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6715a00/0xf4f48ce5e1bbf285 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049499.602494:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6715a00/0xf4f48ce5e1bbf285 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049499.602516:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6715800/0xf4f48ce5e1bbf357 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049499.602531:0:5851:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c3400/0xf4f48ce5e1bbf2a1 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a3432 expref: 16 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049499.602540:0:5851:0:(ldlm_resource.c:1751:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6715800/0xf4f48ce5e1bbf357 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049499.602568:0:5851:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c3400/0xf4f48ce5e1bbf2a1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a3432 expref: 16 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049499.602595:0:5851:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c3400/0xf4f48ce5e1bbf2a1 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a3432 expref: 16 pid: 5851 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789049499.602608:0:5851:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb8df260e00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5851:1875954110626560:192.168.206.26@tcp:104: 00000100:00100000:2.0:1789049499.602676:0:5851:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cb8d0aaa6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789049499.612702:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.26@tcp (source: 12345-192.168.206.26@tcp) 00000100:00100000:0.0:1789049499.612732:0:6720:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954089634560 00000100:00100000:0.0:1789049499.612741:0:6720:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954089634560 00010000:00010000:0.0:1789049499.612776:0:6720:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c3400/0xf4f48ce5e1bbf2a1 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a3432 expref: 17 pid: 5851 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789049499.612823:0:6720:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.26@tcp, seq: 46 00000100:00100000:0.0:1789049499.612833:0:6720:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb900a54000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e823b53a-3591-475c-8624-c682227e5c13+17:2357:x1875954089634560:12345-192.168.206.26@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789049499.612860:0:6720:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789049499.612868:0:6720:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c3400/0xf4f48ce5e1bbf2a1 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a3432 expref: 17 pid: 5851 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049499.612881:0:6720:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c3400/0xf4f48ce5e1bbf2a1 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a3432 expref: 17 pid: 5851 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049499.612913:0:6720:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8cb8e0130f00) 00010000:00010000:0.0:1789049499.612919:0:6720:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6715800/0xf4f48ce5e1bbf357 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049499.612929:0:6720:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6715800/0xf4f48ce5e1bbf357 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049499.612937:0:6720:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6715800/0xf4f48ce5e1bbf357 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049499.612963:0:6720:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789049499.613019:0:6720:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb900a54000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e823b53a-3591-475c-8624-c682227e5c13+17:2357:x1875954089634560:12345-192.168.206.26@tcp:103:ldlm_bl.0 Request processed in 186us (323us total) trans 0 rc 0/0 00000100:00100000:0.0:1789049499.613026:0:6720:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.26@tcp, seq: 46 00010000:00010000:3.0:1789049499.613620:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c3400/0xf4f48ce5e1bbf2a1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a3432 expref: 16 pid: 5851 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789049499.613636:0:5851:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb8df260e00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5851:1875954110626560:192.168.206.26@tcp:104: 00010000:00010000:3.0:1789049499.613656:0:5851:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6715800/0xf4f48ce5e1bbf357 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049499.613666:0:5851:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6715800/0xf4f48ce5e1bbf357 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049499.613672:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6715800/0xf4f48ce5e1bbf357 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049499.613684:0:5851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6715800/0xf4f48ce5e1bbf357 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049499.613692:0:5851:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6715800/0xf4f48ce5e1bbf357 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049499.613699:0:5851:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6715800/0xf4f48ce5e1bbf357 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049499.613713:0:5851:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cb8d6715800 already unused, calling callback (ffffffffc20ca4f0) 00010000:00010000:3.0:1789049499.613718:0:5851:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6715800/0xf4f48ce5e1bbf357 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049499.613725:0:5851:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6715800/0xf4f48ce5e1bbf357 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049499.613735:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8cb8e0130f00) 00010000:00010000:3.0:1789049499.613738:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789049499.613742:0:5851:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6715800/0xf4f48ce5e1bbf357 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049499.613748:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6715800/0xf4f48ce5e1bbf357 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049499.613760:0:5851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6714a00/0xf4f48ce5e1bbf349 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049499.613766:0:5851:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6714a00/0xf4f48ce5e1bbf349 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049499.613772:0:5851:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6714a00/0xf4f48ce5e1bbf349 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049499.613777:0:5851:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cb8d6714a00 already unused, calling callback (ffffffffc20ca4f0) 00010000:00010000:3.0:1789049499.613779:0:5851:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6714a00/0xf4f48ce5e1bbf349 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049499.613785:0:5851:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6714a00/0xf4f48ce5e1bbf349 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049499.613803:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8cb8e0130f00) 00010000:00010000:3.0:1789049499.613805:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1789049499.613809:0:5851:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6714a00/0xf4f48ce5e1bbf349 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049499.613814:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6714a00/0xf4f48ce5e1bbf349 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789049499.614063:0:5851:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb900a57800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e823b53a-3591-475c-8624-c682227e5c13+15:10431:x1875954089634304:12345-192.168.206.26@tcp:57:lhsmtool_posix.0 Request processed in 34434us (34575us total) trans 4294967362 rc 0/0 00000100:00100000:3.0:1789049499.614071:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.26@tcp, seq: 83 00000020:00080000:3.0:1789049499.614076:0:5851:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:0.0:1789049499.614242:0:11704:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1789049499.614247:0:11704:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1789049499.614442:0:11704:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:0.0:1789049499.614449:0:11704:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1789049499.622204:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.26@tcp (source: 12345-192.168.206.26@tcp) 00000100:00100000:0.0:1789049499.622238:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954089634816 00000100:00100000:0.0:1789049499.622248:0:5853:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954089634816 00000100:00100000:0.0:1789049499.622465:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.26@tcp, seq: 20 00000100:00100000:0.0:1789049499.622475:0:5853:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb900a56680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e823b53a-3591-475c-8624-c682227e5c13+15:10431:x1875954089634816:12345-192.168.206.26@tcp:35:lhsmtool_posix.0 00000004:00080000:0.0:1789049499.623435:0:5853:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0x6:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:0.0:1789049499.623704:0:5853:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967363 00010000:00010000:0.0:1789049499.623759:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb7c4c38c00/0xf4f48ce5e1bbf35e lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049499.623776:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cb7c4c38c00/0xf4f48ce5e1bbf35e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049499.623788:0:5853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb7c4c38c00/0xf4f48ce5e1bbf35e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049499.623797:0:5853:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb7c4c38c00/0xf4f48ce5e1bbf35e lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049499.623804:0:5853:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb7c4c38c00/0xf4f48ce5e1bbf35e lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049499.623816:0:5853:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cb7c4c38c00/0xf4f48ce5e1bbf35e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049499.623916:0:5853:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1789049499.624001:0:5853:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb900a56680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e823b53a-3591-475c-8624-c682227e5c13+17:10431:x1875954089634816:12345-192.168.206.26@tcp:35:lhsmtool_posix.0 Request processed in 1525us (1803us total) trans 4294967364 rc 0/0 00000100:00100000:0.0:1789049499.624010:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.26@tcp, seq: 20 00000020:00080000:0.0:1789049499.624015:0:5853:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1789049499.625260:0:6719:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789049499.625271:0:6719:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cb7c4c38c00/0xf4f48ce5e1bbf35e lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049499.625281:0:6719:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cb7c4c38c00 already unused, calling callback (ffffffffc166a8f0) 00010000:00010000:2.0:1789049499.625285:0:6719:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb7c4c38c00/0xf4f48ce5e1bbf35e lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049499.625294:0:6719:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb7c4c38c00/0xf4f48ce5e1bbf35e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049499.625307:0:6719:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff8cb8ce751800) 00010000:00010000:2.0:1789049499.625310:0:6719:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1789049499.625314:0:6719:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cb7c4c38c00/0xf4f48ce5e1bbf35e lrc: 1/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049499.625420:0:6719:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb7c4c38c00/0xf4f48ce5e1bbf35e lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049499.625458:0:6719:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789049499.625460:0:6719:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789049499.625462:0:6719:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1789049499.970478:0:12017:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1789049499.970488:0:12017:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1789049499.970534:0:12017:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:2.0:1789049499.970539:0:12017:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1789049500.088213:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.26@tcp (source: 12345-192.168.206.26@tcp) 00000100:00100000:1.0:1789049500.089613:0:6841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954089635072 00000100:00100000:1.0:1789049500.089626:0:6841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954089635072 00000100:00100000:1.0:1789049500.089712:0:6841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.26@tcp, seq: 84 00000100:00100000:1.0:1789049500.089722:0:6841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8df260000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e823b53a-3591-475c-8624-c682227e5c13+17:10450:x1875954089635072:12345-192.168.206.26@tcp:101:lfs.0 00010000:00010000:1.0:1789049500.089744:0:6841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00080000:2.0:1789049500.089755:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1789049500.089764:0:6841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c3c00/0xf4f48ce5e1bbf365 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7fc5e358805a346a expref: -99 pid: 6841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049500.089882:0:6841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c2a00/0xf4f48ce5e1bbf36c lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049500.089896:0:6841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c2a00/0xf4f48ce5e1bbf36c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049500.089919:0:6841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c2a00/0xf4f48ce5e1bbf36c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6841 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789049500.089932:0:6841:0:(mdt_handler.c:922:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00010000:00010000:1.0:1789049500.090043:0:6841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c3c00/0xf4f48ce5e1bbf365 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a346a expref: 20 pid: 6841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049500.090059:0:6841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c2a00/0xf4f48ce5e1bbf36c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a346a expref: 19 pid: 6841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049500.090067:0:6841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8cb8c396df00) 00010000:00010000:1.0:1789049500.090070:0:6841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1789049500.090074:0:6841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cb8c28c2a00, rc 0) 00000100:00100000:1.0:1789049500.090144:0:6841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8df260000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e823b53a-3591-475c-8624-c682227e5c13+19:10450:x1875954089635072:12345-192.168.206.26@tcp:101:lfs.0 Request processed in 424us (1940us total) trans 4294967365 rc 0/0 00000100:00100000:1.0:1789049500.090151:0:6841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.26@tcp, seq: 84 00000100:00100000:3.0:1789049500.107558:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.26@tcp (source: 12345-192.168.206.26@tcp) 00000100:00100000:2.0:1789049500.107627:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954089635200 00000100:00100000:2.0:1789049500.107636:0:5850:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954089635200 00000100:00100000:2.0:1789049500.107693:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.26@tcp, seq: 85 00000100:00100000:2.0:1789049500.107703:0:5850:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8df299880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e823b53a-3591-475c-8624-c682227e5c13+19:10450:x1875954089635200:12345-192.168.206.26@tcp:34:lfs.0 00010000:00010000:2.0:1789049500.107773:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6715200/0xf4f48ce5e1bbf37a lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049500.107789:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6715200/0xf4f48ce5e1bbf37a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049500.107800:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6715200/0xf4f48ce5e1bbf37a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049500.107827:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6715a00/0xf4f48ce5e1bbf381 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049500.107835:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6715a00/0xf4f48ce5e1bbf381 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049500.107863:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6715a00/0xf4f48ce5e1bbf381 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049500.108062:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6714000/0xf4f48ce5e1bbf388 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049500.108071:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6714000/0xf4f48ce5e1bbf388 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049500.108086:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6714000/0xf4f48ce5e1bbf388 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789049500.108120:0:5850:0:(mdt_handler.c:2522:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6714000/0xf4f48ce5e1bbf388 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049500.108131:0:5850:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6715200/0xf4f48ce5e1bbf37a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049500.108137:0:5850:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6715200/0xf4f48ce5e1bbf37a lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049500.108144:0:5850:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6715200/0xf4f48ce5e1bbf37a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049500.108150:0:5850:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cb8d6715200 already unused, calling callback (ffffffffc20ca4f0) 00010000:00010000:2.0:1789049500.108153:0:5850:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6715200/0xf4f48ce5e1bbf37a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049500.108160:0:5850:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6715200/0xf4f48ce5e1bbf37a lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049500.108182:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8cb8c396df00) 00010000:00010000:2.0:1789049500.108185:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789049500.108190:0:5850:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6715200/0xf4f48ce5e1bbf37a lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049500.108196:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6715200/0xf4f48ce5e1bbf37a lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049500.108208:0:5850:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6715a00/0xf4f48ce5e1bbf381 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049500.108218:0:5850:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6715a00/0xf4f48ce5e1bbf381 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049500.108224:0:5850:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6715a00/0xf4f48ce5e1bbf381 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049500.108229:0:5850:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cb8d6715a00 already unused, calling callback (ffffffffc20ca4f0) 00010000:00010000:2.0:1789049500.108232:0:5850:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6715a00/0xf4f48ce5e1bbf381 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049500.108238:0:5850:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6715a00/0xf4f48ce5e1bbf381 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049500.108245:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8cb8e0130e00) 00010000:00010000:2.0:1789049500.108247:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789049500.108250:0:5850:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6715a00/0xf4f48ce5e1bbf381 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049500.108255:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6715a00/0xf4f48ce5e1bbf381 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049500.108277:0:5850:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6714000/0xf4f48ce5e1bbf388 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049500.108282:0:5850:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6714000/0xf4f48ce5e1bbf388 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049500.108288:0:5850:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6714000/0xf4f48ce5e1bbf388 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049500.108293:0:5850:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cb8d6714000 already unused, calling callback (ffffffffc20ca4f0) 00010000:00010000:2.0:1789049500.108299:0:5850:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6714000/0xf4f48ce5e1bbf388 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049500.108306:0:5850:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6714000/0xf4f48ce5e1bbf388 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049500.108312:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8cb8e0130c00) 00010000:00010000:2.0:1789049500.108314:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789049500.108317:0:5850:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6714000/0xf4f48ce5e1bbf388 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049500.108323:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6714000/0xf4f48ce5e1bbf388 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789049500.108393:0:5850:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8df299880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e823b53a-3591-475c-8624-c682227e5c13+19:10450:x1875954089635200:12345-192.168.206.26@tcp:34:lfs.0 Request processed in 690us (842us total) trans 0 rc 0/0 00000100:00100000:2.0:1789049500.108401:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.26@tcp, seq: 85 00000100:00100000:2.0:1789049500.173675:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.26@tcp (source: 12345-192.168.206.26@tcp) 00000100:00100000:1.0:1789049500.173739:0:6841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954089635456 00000100:00100000:1.0:1789049500.173749:0:6841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954089635456 00000100:00100000:1.0:1789049500.173814:0:6841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.26@tcp, seq: 86 00000100:00100000:1.0:1789049500.173824:0:6841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8df262d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e823b53a-3591-475c-8624-c682227e5c13+19:10453:x1875954089635456:12345-192.168.206.26@tcp:101:lfs.0 00010000:00010000:1.0:1789049500.173870:0:6841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789049500.173914:0:6841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c3c00/0xf4f48ce5e1bbf38f lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7fc5e358805a3471 expref: -99 pid: 6841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049500.173983:0:6841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c3400/0xf4f48ce5e1bbf396 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049500.173997:0:6841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c3400/0xf4f48ce5e1bbf396 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049500.174009:0:6841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c3400/0xf4f48ce5e1bbf396 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049500.174023:0:6841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c2200/0xf4f48ce5e1bbf39d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049500.174030:0:6841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c2200/0xf4f48ce5e1bbf39d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049500.174037:0:6841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c2200/0xf4f48ce5e1bbf39d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049500.174277:0:6841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c3800/0xf4f48ce5e1bbf3a4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049500.174286:0:6841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c3800/0xf4f48ce5e1bbf3a4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049500.174294:0:6841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c3800/0xf4f48ce5e1bbf3a4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6841 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789049500.174304:0:6841:0:(mdt_handler.c:922:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 9 00010000:00010000:1.0:1789049500.174400:0:6841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c3400/0xf4f48ce5e1bbf396 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049500.174418:0:6841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c3400/0xf4f48ce5e1bbf396 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049500.174424:0:6841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c3400/0xf4f48ce5e1bbf396 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049500.174430:0:6841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cb8c28c3400 already unused, calling callback (ffffffffc20ca4f0) 00010000:00010000:1.0:1789049500.174435:0:6841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c3400/0xf4f48ce5e1bbf396 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049500.174443:0:6841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c3400/0xf4f48ce5e1bbf396 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049500.174455:0:6841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8cb8c396df00) 00010000:00010000:1.0:1789049500.174458:0:6841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789049500.174463:0:6841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c3400/0xf4f48ce5e1bbf396 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049500.174469:0:6841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c3400/0xf4f48ce5e1bbf396 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049500.174480:0:6841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c2200/0xf4f48ce5e1bbf39d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049500.174486:0:6841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c2200/0xf4f48ce5e1bbf39d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049500.174492:0:6841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c2200/0xf4f48ce5e1bbf39d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049500.174497:0:6841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cb8c28c2200 already unused, calling callback (ffffffffc20ca4f0) 00010000:00010000:1.0:1789049500.174506:0:6841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c2200/0xf4f48ce5e1bbf39d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049500.174512:0:6841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c2200/0xf4f48ce5e1bbf39d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049500.174520:0:6841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8cb8c396dd00) 00010000:00010000:1.0:1789049500.174523:0:6841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789049500.174526:0:6841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c2200/0xf4f48ce5e1bbf39d lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049500.174532:0:6841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c2200/0xf4f48ce5e1bbf39d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049500.174570:0:6841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c3c00/0xf4f48ce5e1bbf38f lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a3471 expref: 22 pid: 6841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049500.174583:0:6841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c3800/0xf4f48ce5e1bbf3a4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a3471 expref: 21 pid: 6841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049500.174590:0:6841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8cb8c396d200) 00010000:00010000:1.0:1789049500.174592:0:6841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789049500.174594:0:6841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cb8c28c3800, rc 0) 00000100:00100000:1.0:1789049500.174793:0:6841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8df262d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e823b53a-3591-475c-8624-c682227e5c13+21:10453:x1875954089635456:12345-192.168.206.26@tcp:101:lfs.0 Request processed in 969us (1126us total) trans 4294967366 rc 0/0 00000100:00100000:1.0:1789049500.174801:0:6841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.26@tcp, seq: 86 00000100:00100000:0.0:1789049500.179269:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.26@tcp (source: 12345-192.168.206.26@tcp) 00000100:00100000:1.0:1789049500.179348:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954089635584 00000100:00100000:1.0:1789049500.179357:0:5850:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954089635584 00000100:00100000:1.0:1789049500.179415:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.26@tcp, seq: 87 00000100:00100000:1.0:1789049500.179424:0:5850:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb900a54700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e823b53a-3591-475c-8624-c682227e5c13+21:10453:x1875954089635584:12345-192.168.206.26@tcp:54:lfs.0 00010000:00010000:1.0:1789049500.179514:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c2c00/0xf4f48ce5e1bbf3b2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049500.179530:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c2c00/0xf4f48ce5e1bbf3b2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049500.179541:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c2c00/0xf4f48ce5e1bbf3b2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049500.179565:0:5850:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c2c00/0xf4f48ce5e1bbf3b2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049500.179571:0:5850:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c2c00/0xf4f48ce5e1bbf3b2 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049500.179577:0:5850:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c2c00/0xf4f48ce5e1bbf3b2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049500.179583:0:5850:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cb8c28c2c00 already unused, calling callback (ffffffffc20ca4f0) 00010000:00010000:1.0:1789049500.179587:0:5850:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c2c00/0xf4f48ce5e1bbf3b2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049500.179593:0:5850:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c2c00/0xf4f48ce5e1bbf3b2 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049500.179603:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8cb8c396d200) 00010000:00010000:1.0:1789049500.179606:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1789049500.179611:0:5850:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c2c00/0xf4f48ce5e1bbf3b2 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049500.179616:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c2c00/0xf4f48ce5e1bbf3b2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789049500.179709:0:5850:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb900a54700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e823b53a-3591-475c-8624-c682227e5c13+21:10453:x1875954089635584:12345-192.168.206.26@tcp:54:lfs.0 Request processed in 286us (449us total) trans 0 rc 0/0 00000100:00100000:1.0:1789049500.179717:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.26@tcp, seq: 87 00000100:00100000:3.0:1789049500.187043:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.26@tcp (source: 12345-192.168.206.26@tcp) 00000100:00100000:2.0:1789049500.187130:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954089635840 00000100:00100000:2.0:1789049500.187142:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954089635840 00000100:00100000:2.0:1789049500.187247:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.26@tcp, seq: 21 00000100:00100000:2.0:1789049500.187267:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8d1d28c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e823b53a-3591-475c-8624-c682227e5c13+21:10453:x1875954089635840:12345-192.168.206.26@tcp:35:lfs.0 00000100:00100000:2.0:1789049500.187505:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8d1d28c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e823b53a-3591-475c-8624-c682227e5c13+22:10453:x1875954089635840:12345-192.168.206.26@tcp:35:lfs.0 Request processed in 240us (472us total) trans 4294967367 rc 0/0 00000100:00100000:2.0:1789049500.187513:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.26@tcp, seq: 21 00000100:00100000:0.0:1789049500.218402:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.26@tcp (source: 12345-192.168.206.26@tcp) 00000100:00100000:2.0:1789049500.218509:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954089636096 00000100:00100000:2.0:1789049500.218520:0:5852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954089636096 00000100:00100000:2.0:1789049500.218584:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.26@tcp, seq: 88 00000100:00100000:2.0:1789049500.218594:0:5852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb900a54380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e823b53a-3591-475c-8624-c682227e5c13+22:9983:x1875954089636096:12345-192.168.206.26@tcp:101:bash.0 00010000:00010000:2.0:1789049500.218634:0:5852:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789049500.218657:0:5852:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6714000/0xf4f48ce5e1bbf3b9 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7fc5e358805a3478 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049500.218758:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6715a00/0xf4f48ce5e1bbf3c0 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049500.218773:0:5852:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c3800/0xf4f48ce5e1bbf3a4 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a3471 expref: 23 pid: 6841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049500.218781:0:5852:0:(ldlm_resource.c:1751:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6715a00/0xf4f48ce5e1bbf3c0 lrc: 4/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049500.218814:0:5852:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c3800/0xf4f48ce5e1bbf3a4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a3471 expref: 23 pid: 6841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049500.218828:0:5852:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c3800/0xf4f48ce5e1bbf3a4 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a3471 expref: 23 pid: 6841 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789049500.218879:0:5852:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb8df261f80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5852:1875954110626688:192.168.206.26@tcp:104: 00000100:00100000:2.0:1789049500.218979:0:5852:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cb8d0aaaf00 going to sleep for 11 seconds 00000100:00100000:2.0:1789049500.222183:0:5852:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb8df261f80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5852:1875954110626688:192.168.206.26@tcp:104: 00010000:00010000:2.0:1789049500.222212:0:5852:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6715a00/0xf4f48ce5e1bbf3c0 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789049500.224608:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.26@tcp (source: 12345-192.168.206.26@tcp) 00000100:00100000:1.0:1789049500.224695:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954089636224 00000100:00100000:1.0:1789049500.224704:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954089636224 00010000:00010000:1.0:1789049500.224742:0:5836:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c3800/0xf4f48ce5e1bbf3a4 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a3471 expref: 24 pid: 6841 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789049500.224820:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.26@tcp, seq: 47 00000100:00100000:1.0:1789049500.224829:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb900a56d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e823b53a-3591-475c-8624-c682227e5c13+24:2358:x1875954089636224:12345-192.168.206.26@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789049500.224875:0:5836:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789049500.224883:0:5836:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c3800/0xf4f48ce5e1bbf3a4 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a3471 expref: 24 pid: 6841 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049500.224896:0:5836:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c3800/0xf4f48ce5e1bbf3a4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a3471 expref: 24 pid: 6841 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049500.224928:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c3800/0xf4f48ce5e1bbf3a4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a3471 expref: 24 pid: 6841 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049500.224943:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8cb8c396d200) 00010000:00010000:1.0:1789049500.224948:0:5836:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6715a00/0xf4f48ce5e1bbf3c0 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049500.224958:0:5836:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6715a00/0xf4f48ce5e1bbf3c0 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049500.224981:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6715a00/0xf4f48ce5e1bbf3c0 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049500.225010:0:5836:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789049500.225073:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb900a56d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e823b53a-3591-475c-8624-c682227e5c13+23:2358:x1875954089636224:12345-192.168.206.26@tcp:103:ldlm_bl.0 Request processed in 244us (473us total) trans 0 rc 0/0 00000100:00100000:1.0:1789049500.225081:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.26@tcp, seq: 47 00010000:00010000:2.0:1789049500.225348:0:5852:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6715a00/0xf4f48ce5e1bbf3c0 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049500.225357:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6715a00/0xf4f48ce5e1bbf3c0 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789049500.225382:0:5852:0:(mdt_handler.c:922:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 9 00010000:00010000:2.0:1789049500.225520:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6714000/0xf4f48ce5e1bbf3b9 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a3478 expref: 24 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049500.225537:0:5852:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6715a00/0xf4f48ce5e1bbf3c0 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a3478 expref: 23 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049500.225544:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8cb8c396d200) 00010000:00010000:2.0:1789049500.225546:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1789049500.225549:0:5852:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cb8d6715a00, rc 0) 00000100:00100000:2.0:1789049500.225590:0:5852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb900a54380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e823b53a-3591-475c-8624-c682227e5c13+23:9983:x1875954089636096:12345-192.168.206.26@tcp:101:bash.0 Request processed in 6997us (7197us total) trans 4294967368 rc 0/0 00000100:00100000:2.0:1789049500.225597:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.26@tcp, seq: 88 00000100:00100000:0.0:1789049500.230157:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.26@tcp (source: 12345-192.168.206.26@tcp) 00000100:00100000:1.0:1789049500.230226:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954089636480 00000100:00100000:1.0:1789049500.230236:0:5850:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954089636480 00000100:00100000:1.0:1789049500.230293:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.26@tcp, seq: 89 00000100:00100000:1.0:1789049500.230303:0:5850:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb900a57100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e823b53a-3591-475c-8624-c682227e5c13+23:9983:x1875954089636480:12345-192.168.206.26@tcp:36:bash.0 00010000:00010000:1.0:1789049500.230542:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c2c00/0xf4f48ce5e1bbf3ce lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049500.230558:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c2c00/0xf4f48ce5e1bbf3ce lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049500.230570:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c2c00/0xf4f48ce5e1bbf3ce lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789049500.230620:0:5850:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967369 00000004:00010000:1.0:1789049500.230644:0:5850:0:(mdt_handler.c:4507:mdt_save_lock()) ### save lock request 00000000e9ee95c9 reply state 00000000e3c5e042 transno 4294967370 ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c2c00/0xf4f48ce5e1bbf3ce lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789049500.230653:0:5850:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000001:00080000:1.0:1789049500.230704:0:5850:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967370 00000100:00100000:1.0:1789049500.230992:0:5850:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb900a57100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e823b53a-3591-475c-8624-c682227e5c13+27:9983:x1875954089636480:12345-192.168.206.26@tcp:36:bash.0 Request processed in 689us (844us total) trans 4294967371 rc 0/0 00000100:00100000:1.0:1789049500.231001:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.26@tcp, seq: 89 00000020:00080000:1.0:1789049500.231018:0:5850:0:(tgt_main.c:784:tgt_ses_key_exit()) total 3 transactions per RPC 00010000:00010000:1.0:1789049500.232733:0:3295:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c2c00/0xf4f48ce5e1bbf3ce lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049500.232748:0:3295:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c2c00/0xf4f48ce5e1bbf3ce lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049500.232756:0:3295:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c2c00/0xf4f48ce5e1bbf3ce lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049500.232762:0:3295:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cb8c28c2c00 already unused, calling callback (ffffffffc20ca4f0) 00010000:00010000:1.0:1789049500.232767:0:3295:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c2c00/0xf4f48ce5e1bbf3ce lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049500.232774:0:3295:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c2c00/0xf4f48ce5e1bbf3ce lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049500.232789:0:3295:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8cb8c396d200) 00010000:00010000:1.0:1789049500.232792:0:3295:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789049500.232797:0:3295:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c2c00/0xf4f48ce5e1bbf3ce lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049500.232803:0:3295:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c2c00/0xf4f48ce5e1bbf3ce lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789049500.234296:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.26@tcp (source: 12345-192.168.206.26@tcp) 00000100:00100000:1.0:1789049500.234382:0:6841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954089636608 00000100:00100000:1.0:1789049500.234391:0:6841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954089636608 00000100:00100000:1.0:1789049500.234448:0:6841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.26@tcp, seq: 90 00000100:00100000:1.0:1789049500.234457:0:6841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb900a54a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e823b53a-3591-475c-8624-c682227e5c13+26:9983:x1875954089636608:12345-192.168.206.26@tcp:101:bash.0 00010000:00010000:1.0:1789049500.234480:0:6841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789049500.234497:0:6841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c3c00/0xf4f48ce5e1bbf3d5 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7fc5e358805a347f expref: -99 pid: 6841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049500.234572:0:6841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c3c00/0xf4f48ce5e1bbf3d5 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a347f expref: 27 pid: 6841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049500.234588:0:6841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c3c00/0xf4f48ce5e1bbf3d5 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a347f expref: 27 pid: 6841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049500.234606:0:6841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8cb8c396d200) 00010000:00010000:1.0:1789049500.234609:0:6841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1789049500.234612:0:6841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cb8c28c3c00, rc 0) 00000100:00100000:1.0:1789049500.234669:0:6841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb900a54a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e823b53a-3591-475c-8624-c682227e5c13+27:9983:x1875954089636608:12345-192.168.206.26@tcp:101:bash.0 Request processed in 213us (382us total) trans 0 rc 0/0 00000100:00100000:1.0:1789049500.234676:0:6841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.26@tcp, seq: 90 00000100:00100000:0.0:1789049500.238725:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.26@tcp (source: 12345-192.168.206.26@tcp) 00000100:00100000:3.0:1789049500.238801:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954089636736 00000100:00100000:3.0:1789049500.238813:0:6704:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954089636736 00000100:00100000:3.0:1789049500.238909:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.26@tcp, seq: 33 00000100:00100000:3.0:1789049500.238920:0:6704:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb900a56680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e823b53a-3591-475c-8624-c682227e5c13+6:9983:x1875954089636736:12345-192.168.206.26@tcp:101:bash.0 00010000:00010000:3.0:1789049500.238937:0:6704:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789049500.238956:0:6704:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000081773780/0xf4f48ce5e1bbf3dc lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x7fc5e358805a3486 expref: -99 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789049500.238979:0:6704:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x3:0x0] initial LVB size: 9, mtime: 0x18d3fb0a21e32d40, atime: 0x18d3fb09b38f2880, ctime: 0x18d3fb0a21e32d40, blocks: 0xb 00010000:00010000:3.0:1789049500.238999:0:6704:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=326s v=(0 0) 00010000:00010000:3.0:1789049500.239003:0:6704:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789049500.239011:0:6704:0:(ldlm_resource.c:1751:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000081773780/0xf4f48ce5e1bbf3dc lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a3486 expref: 7 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049500.239048:0:6704:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000081773780/0xf4f48ce5e1bbf3dc lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a3486 expref: 7 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049500.239060:0:6704:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cb8c6b35c00, rc 0) 00000100:00100000:3.0:1789049500.239181:0:6704:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb900a56680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e823b53a-3591-475c-8624-c682227e5c13+7:9983:x1875954089636736:12345-192.168.206.26@tcp:101:bash.0 Request processed in 262us (464us total) trans 0 rc 0/0 00000100:00100000:3.0:1789049500.239187:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.26@tcp, seq: 33 00000100:00100000:0.0:1789049500.242162:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.26@tcp (source: 12345-192.168.206.26@tcp) 00000100:00100000:3.0:1789049500.242245:0:6708:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954089636864 00000100:00100000:3.0:1789049500.242263:0:6708:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954089636864 00002000:00010000:3.0:1789049500.242303:0:6708:0:(ofd_dev.c:2841:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/3 (0->18446744073709551615) 00002000:00100000:3.0:1789049500.242308:0:6708:0:(ofd_dev.c:2581:ofd_prolong_extent_locks()) Prolong locks for req ffff8cb8df4d1c00 with x1875954089636864 ext(0->18446744073709551615) 00002000:00010000:3.0:1789049500.242319:0:6708:0:(ofd_dev.c:2846:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8cb8df4d1c00. 00000100:00100000:3.0:1789049500.242348:0:6708:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.26@tcp, seq: 1 00000100:00100000:3.0:1789049500.242357:0:6708:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8df4d1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:e823b53a-3591-475c-8624-c682227e5c13+7:2357:x1875954089636864:12345-192.168.206.26@tcp:10:bash.0 00002000:00010000:3.0:1789049500.242622:0:6708:0:(ofd_lvb.c:321:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb size from disk: 9 -> 0 00002000:00010000:3.0:1789049500.242626:0:6708:0:(ofd_lvb.c:328:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb mtime from disk: 1789049497933000000 -> 1789049499545000000 00002000:00010000:3.0:1789049500.242629:0:6708:0:(ofd_lvb.c:334:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb atime from disk: 1789049496082000000 -> 1789049496082000000 00002000:00010000:3.0:1789049500.242631:0:6708:0:(ofd_lvb.c:340:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb ctime from disk: 1789049497933000000 -> 1789049499545000000 00002000:00010000:3.0:1789049500.242632:0:6708:0:(ofd_lvb.c:346:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb blocks from disk: 11 -> 11 00000100:00100000:3.0:1789049500.242688:0:6708:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8df4d1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:e823b53a-3591-475c-8624-c682227e5c13+8:2357:x1875954089636864:12345-192.168.206.26@tcp:10:bash.0 Request processed in 331us (533us total) trans 4294967306 rc 0/0 00000100:00100000:3.0:1789049500.242694:0:6708:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.26@tcp, seq: 1 00002000:00010000:3.0:1789049500.242698:0:6708:0:(ofd_dev.c:2841:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/3 (0->18446744073709551615) 00002000:00100000:3.0:1789049500.242707:0:6708:0:(ofd_dev.c:2581:ofd_prolong_extent_locks()) Prolong locks for req ffff8cb8df4d1c00 with x1875954089636864 ext(0->18446744073709551615) 00002000:00010000:3.0:1789049500.242713:0:6708:0:(ofd_dev.c:2846:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8cb8df4d1c00. 00000100:00100000:2.0:1789049500.300105:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.26@tcp (source: 12345-192.168.206.26@tcp) 00000100:00100000:3.0:1789049500.300804:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954089636992 00000100:00100000:3.0:1789049500.300814:0:5851:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954089636992 00000100:00100000:3.0:1789049500.300907:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.26@tcp, seq: 91 00000100:00100000:3.0:1789049500.300919:0:5851:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8df261f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e823b53a-3591-475c-8624-c682227e5c13+27:10467:x1875954089636992:12345-192.168.206.26@tcp:34:lfs.0 00010000:00010000:3.0:1789049500.300992:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c6b34000/0xf4f48ce5e1bbf3e3 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049500.301013:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c6b34000/0xf4f48ce5e1bbf3e3 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049500.301024:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c6b34000/0xf4f48ce5e1bbf3e3 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049500.301040:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c6b34200/0xf4f48ce5e1bbf3ea lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049500.301047:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c6b34200/0xf4f48ce5e1bbf3ea lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049500.301054:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c6b34200/0xf4f48ce5e1bbf3ea lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049500.301304:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c6b35a00/0xf4f48ce5e1bbf3f1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049500.301314:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c6b35a00/0xf4f48ce5e1bbf3f1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049500.301321:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c6b35a00/0xf4f48ce5e1bbf3f1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789049500.301384:0:5851:0:(mdt_handler.c:2522:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c6b35a00/0xf4f48ce5e1bbf3f1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049500.301396:0:5851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c6b34000/0xf4f48ce5e1bbf3e3 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049500.301403:0:5851:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c6b34000/0xf4f48ce5e1bbf3e3 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049500.301409:0:5851:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c6b34000/0xf4f48ce5e1bbf3e3 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049500.301414:0:5851:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cb8c6b34000 already unused, calling callback (ffffffffc20ca4f0) 00010000:00010000:3.0:1789049500.301418:0:5851:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c6b34000/0xf4f48ce5e1bbf3e3 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049500.301425:0:5851:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c6b34000/0xf4f48ce5e1bbf3e3 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049500.301436:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8cb8c396df00) 00010000:00010000:3.0:1789049500.301439:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789049500.301443:0:5851:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c6b34000/0xf4f48ce5e1bbf3e3 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049500.301449:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c6b34000/0xf4f48ce5e1bbf3e3 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049500.301460:0:5851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c6b34200/0xf4f48ce5e1bbf3ea lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049500.301466:0:5851:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c6b34200/0xf4f48ce5e1bbf3ea lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049500.301477:0:5851:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c6b34200/0xf4f48ce5e1bbf3ea lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049500.301482:0:5851:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cb8c6b34200 already unused, calling callback (ffffffffc20ca4f0) 00010000:00010000:3.0:1789049500.301485:0:5851:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c6b34200/0xf4f48ce5e1bbf3ea lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049500.301491:0:5851:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c6b34200/0xf4f48ce5e1bbf3ea lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049500.301499:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8cb8c687d000) 00010000:00010000:3.0:1789049500.301501:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789049500.301504:0:5851:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c6b34200/0xf4f48ce5e1bbf3ea lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049500.301510:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c6b34200/0xf4f48ce5e1bbf3ea lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049500.301524:0:5851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c6b35a00/0xf4f48ce5e1bbf3f1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049500.301530:0:5851:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c6b35a00/0xf4f48ce5e1bbf3f1 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049500.301536:0:5851:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c6b35a00/0xf4f48ce5e1bbf3f1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049500.301541:0:5851:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cb8c6b35a00 already unused, calling callback (ffffffffc20ca4f0) 00010000:00010000:3.0:1789049500.301544:0:5851:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c6b35a00/0xf4f48ce5e1bbf3f1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049500.301558:0:5851:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c6b35a00/0xf4f48ce5e1bbf3f1 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049500.301566:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8cb8c396d200) 00010000:00010000:3.0:1789049500.301569:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789049500.301572:0:5851:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c6b35a00/0xf4f48ce5e1bbf3f1 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049500.301578:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c6b35a00/0xf4f48ce5e1bbf3f1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789049500.301665:0:5851:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8df261f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e823b53a-3591-475c-8624-c682227e5c13+27:10467:x1875954089636992:12345-192.168.206.26@tcp:34:lfs.0 Request processed in 747us (1568us total) trans 0 rc 0/0 00000100:00100000:3.0:1789049500.301674:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.26@tcp, seq: 91 00000100:00100000:0.0:1789049500.354935:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.26@tcp (source: 12345-192.168.206.26@tcp) 00000100:00100000:1.0:1789049500.355022:0:6841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954089637248 00000100:00100000:1.0:1789049500.355031:0:6841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954089637248 00000100:00100000:1.0:1789049500.355086:0:6841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.26@tcp, seq: 92 00000100:00100000:1.0:1789049500.355110:0:6841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8df4d0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e823b53a-3591-475c-8624-c682227e5c13+27:10470:x1875954089637248:12345-192.168.206.26@tcp:101:lfs.0 00010000:00010000:1.0:1789049500.355130:0:6841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789049500.355151:0:6841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c2c00/0xf4f48ce5e1bbf3f8 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7fc5e358805a348d expref: -99 pid: 6841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049500.355231:0:6841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c3800/0xf4f48ce5e1bbf3ff lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049500.355244:0:6841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c3800/0xf4f48ce5e1bbf3ff lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049500.355262:0:6841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c3800/0xf4f48ce5e1bbf3ff lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049500.355290:0:6841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c2200/0xf4f48ce5e1bbf406 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049500.355298:0:6841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c2200/0xf4f48ce5e1bbf406 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049500.355305:0:6841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c2200/0xf4f48ce5e1bbf406 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049500.355549:0:6841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c3400/0xf4f48ce5e1bbf40d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049500.355560:0:6841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c3400/0xf4f48ce5e1bbf40d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049500.355567:0:6841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c3400/0xf4f48ce5e1bbf40d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6841 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789049500.355578:0:6841:0:(mdt_handler.c:922:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:1.0:1789049500.355658:0:6841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c3800/0xf4f48ce5e1bbf3ff lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049500.355666:0:6841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c3800/0xf4f48ce5e1bbf3ff lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049500.355673:0:6841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c3800/0xf4f48ce5e1bbf3ff lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049500.355678:0:6841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cb8c28c3800 already unused, calling callback (ffffffffc20ca4f0) 00010000:00010000:1.0:1789049500.355682:0:6841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c3800/0xf4f48ce5e1bbf3ff lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049500.355698:0:6841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c3800/0xf4f48ce5e1bbf3ff lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049500.355710:0:6841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8cb8c396df00) 00010000:00010000:1.0:1789049500.355712:0:6841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789049500.355717:0:6841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c3800/0xf4f48ce5e1bbf3ff lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049500.355723:0:6841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c3800/0xf4f48ce5e1bbf3ff lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049500.355733:0:6841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c2200/0xf4f48ce5e1bbf406 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049500.355739:0:6841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c2200/0xf4f48ce5e1bbf406 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049500.355744:0:6841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c2200/0xf4f48ce5e1bbf406 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049500.355750:0:6841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cb8c28c2200 already unused, calling callback (ffffffffc20ca4f0) 00010000:00010000:1.0:1789049500.355752:0:6841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c2200/0xf4f48ce5e1bbf406 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049500.355758:0:6841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c2200/0xf4f48ce5e1bbf406 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049500.355764:0:6841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8cb8c396dd00) 00010000:00010000:1.0:1789049500.355766:0:6841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789049500.355768:0:6841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c2200/0xf4f48ce5e1bbf406 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049500.355782:0:6841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c2200/0xf4f48ce5e1bbf406 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049500.355818:0:6841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c2c00/0xf4f48ce5e1bbf3f8 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a348d expref: 30 pid: 6841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049500.355831:0:6841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c3400/0xf4f48ce5e1bbf40d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a348d expref: 29 pid: 6841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049500.355837:0:6841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8cb8c396d200) 00010000:00010000:1.0:1789049500.355839:0:6841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1789049500.355895:0:6841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cb8c28c3400, rc 0) 00000100:00100000:1.0:1789049500.355971:0:6841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8df4d0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e823b53a-3591-475c-8624-c682227e5c13+29:10470:x1875954089637248:12345-192.168.206.26@tcp:101:lfs.0 Request processed in 876us (1045us total) trans 4294967372 rc 0/0 00000100:00100000:1.0:1789049500.355979:0:6841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.26@tcp, seq: 92 00000100:00100000:0.0:1789049500.362284:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.26@tcp (source: 12345-192.168.206.26@tcp) 00000100:00100000:1.0:1789049500.362408:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954089637376 00000100:00100000:1.0:1789049500.362417:0:5850:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954089637376 00000100:00100000:1.0:1789049500.362470:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.26@tcp, seq: 93 00000100:00100000:1.0:1789049500.362479:0:5850:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8df4d0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e823b53a-3591-475c-8624-c682227e5c13+29:10470:x1875954089637376:12345-192.168.206.26@tcp:54:lfs.0 00010000:00010000:1.0:1789049500.362538:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c2c00/0xf4f48ce5e1bbf41b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049500.362553:0:5850:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6715a00/0xf4f48ce5e1bbf3c0 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a3478 expref: 29 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049500.362562:0:5850:0:(ldlm_resource.c:1751:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c2c00/0xf4f48ce5e1bbf41b lrc: 4/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049500.362608:0:5850:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6715a00/0xf4f48ce5e1bbf3c0 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a3478 expref: 29 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049500.362620:0:5850:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6715a00/0xf4f48ce5e1bbf3c0 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a3478 expref: 29 pid: 5852 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789049500.362744:0:5850:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb8df209880 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5850:1875954110626816:192.168.206.26@tcp:104: 00000100:00100000:1.0:1789049500.362833:0:5850:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cb8c79e0840 going to sleep for 11 seconds 00000100:00100000:3.0:1789049500.366506:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.26@tcp (source: 12345-192.168.206.26@tcp) 00000100:00100000:1.0:1789049500.366964:0:5850:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb8df209880 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5850:1875954110626816:192.168.206.26@tcp:104: 00010000:00010000:1.0:1789049500.366989:0:5850:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c2c00/0xf4f48ce5e1bbf41b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789049500.367206:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954089637632 00000100:00100000:0.0:1789049500.367229:0:5853:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954089637632 00000100:00100000:0.0:1789049500.367289:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.26@tcp, seq: 22 00000100:00100000:0.0:1789049500.367299:0:5853:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8df29aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e823b53a-3591-475c-8624-c682227e5c13+30:5594:x1875954089637632:12345-192.168.206.26@tcp:35:ldlm_bl.0 00000001:00080000:0.0:1789049500.367546:0:5853:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967373 00000100:00100000:0.0:1789049500.367664:0:5853:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8df29aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e823b53a-3591-475c-8624-c682227e5c13+32:5594:x1875954089637632:12345-192.168.206.26@tcp:35:ldlm_bl.0 Request processed in 365us (1166us total) trans 4294967374 rc 0/0 00000100:00100000:0.0:1789049500.367671:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.26@tcp, seq: 22 00000020:00080000:0.0:1789049500.367676:0:5853:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1789049500.371039:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.26@tcp (source: 12345-192.168.206.26@tcp) 00000100:00100000:3.0:1789049500.371128:0:6720:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954089637760 00000100:00100000:3.0:1789049500.371137:0:6720:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954089637760 00010000:00010000:3.0:1789049500.371174:0:6720:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6715a00/0xf4f48ce5e1bbf3c0 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a3478 expref: 32 pid: 5852 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789049500.371226:0:6720:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.26@tcp, seq: 48 00000100:00100000:3.0:1789049500.371236:0:6720:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8df4d0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e823b53a-3591-475c-8624-c682227e5c13+32:2358:x1875954089637760:12345-192.168.206.26@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789049500.371256:0:6720:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789049500.371263:0:6720:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6715a00/0xf4f48ce5e1bbf3c0 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a3478 expref: 32 pid: 5852 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049500.371278:0:6720:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6715a00/0xf4f48ce5e1bbf3c0 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a3478 expref: 32 pid: 5852 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049500.371319:0:6720:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6715a00/0xf4f48ce5e1bbf3c0 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a3478 expref: 32 pid: 5852 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049500.371335:0:6720:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8cb8c396d200) 00010000:00010000:3.0:1789049500.371340:0:6720:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c2c00/0xf4f48ce5e1bbf41b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049500.371349:0:6720:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c2c00/0xf4f48ce5e1bbf41b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049500.371356:0:6720:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c2c00/0xf4f48ce5e1bbf41b lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049500.371698:0:6720:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789049500.371753:0:6720:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8df4d0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e823b53a-3591-475c-8624-c682227e5c13+31:2358:x1875954089637760:12345-192.168.206.26@tcp:103:ldlm_bl.0 Request processed in 516us (720us total) trans 0 rc 0/0 00000100:00100000:3.0:1789049500.371762:0:6720:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.26@tcp, seq: 48 00010000:00010000:1.0:1789049500.373392:0:5850:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c2c00/0xf4f48ce5e1bbf41b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049500.373407:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c2c00/0xf4f48ce5e1bbf41b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049500.373441:0:5850:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c2c00/0xf4f48ce5e1bbf41b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049500.373448:0:5850:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c2c00/0xf4f48ce5e1bbf41b lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049500.373454:0:5850:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c2c00/0xf4f48ce5e1bbf41b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049500.373460:0:5850:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cb8c28c2c00 already unused, calling callback (ffffffffc20ca4f0) 00010000:00010000:1.0:1789049500.373464:0:5850:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c2c00/0xf4f48ce5e1bbf41b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049500.373487:0:5850:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c2c00/0xf4f48ce5e1bbf41b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049500.373501:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8cb8c396d200) 00010000:00010000:1.0:1789049500.373505:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1789049500.373509:0:5850:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c2c00/0xf4f48ce5e1bbf41b lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049500.373516:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c2c00/0xf4f48ce5e1bbf41b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789049500.373597:0:5850:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8df4d0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e823b53a-3591-475c-8624-c682227e5c13+30:10470:x1875954089637376:12345-192.168.206.26@tcp:54:lfs.0 Request processed in 11116us (11319us total) trans 0 rc 0/0 00000100:00100000:1.0:1789049500.373607:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.26@tcp, seq: 93 00000100:00100000:0.0:1789049500.376802:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.26@tcp (source: 12345-192.168.206.26@tcp) 00000100:00100000:1.0:1789049500.376928:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954089638016 00000100:00100000:1.0:1789049500.376938:0:5853:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954089638016 00000100:00100000:1.0:1789049500.376994:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.26@tcp, seq: 23 00000100:00100000:1.0:1789049500.377004:0:5853:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8df4d1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e823b53a-3591-475c-8624-c682227e5c13+30:10470:x1875954089638016:12345-192.168.206.26@tcp:35:lfs.0 00000100:00100000:1.0:1789049500.377219:0:5853:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8df4d1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e823b53a-3591-475c-8624-c682227e5c13+31:10470:x1875954089638016:12345-192.168.206.26@tcp:35:lfs.0 Request processed in 215us (424us total) trans 4294967375 rc 0/0 00000100:00100000:1.0:1789049500.377227:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.26@tcp, seq: 23 00010000:00010000:0.0:1789049500.379023:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789049500.501423:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.26@tcp (source: 12345-192.168.206.26@tcp) 00000100:00100000:1.0:1789049500.501638:0:6841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954089638272 00000100:00100000:1.0:1789049500.501647:0:6841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954089638272 00000100:00100000:1.0:1789049500.501710:0:6841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.26@tcp, seq: 94 00000100:00100000:1.0:1789049500.501720:0:6841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8df298e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e823b53a-3591-475c-8624-c682227e5c13+31:10481:x1875954089638272:12345-192.168.206.26@tcp:101:cat.0 00010000:00010000:1.0:1789049500.501745:0:6841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789049500.501765:0:6841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c2c00/0xf4f48ce5e1bbf422 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7fc5e358805a3494 expref: -99 pid: 6841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049500.501886:0:6841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c2200/0xf4f48ce5e1bbf429 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049500.501912:0:6841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c2200/0xf4f48ce5e1bbf429 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049500.501925:0:6841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c2200/0xf4f48ce5e1bbf429 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049500.502107:0:6841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c3800/0xf4f48ce5e1bbf430 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049500.502117:0:6841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c3800/0xf4f48ce5e1bbf430 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049500.502124:0:6841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c3800/0xf4f48ce5e1bbf430 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049500.502381:0:6841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c3200/0xf4f48ce5e1bbf437 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049500.502391:0:6841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c3200/0xf4f48ce5e1bbf437 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049500.502398:0:6841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c3200/0xf4f48ce5e1bbf437 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6841 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789049500.502409:0:6841:0:(mdt_handler.c:922:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 8 00010000:00010000:1.0:1789049500.502707:0:6841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c2200/0xf4f48ce5e1bbf429 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049500.502717:0:6841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c2200/0xf4f48ce5e1bbf429 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049500.502731:0:6841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c2200/0xf4f48ce5e1bbf429 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049500.502738:0:6841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cb8c28c2200 already unused, calling callback (ffffffffc20ca4f0) 00010000:00010000:1.0:1789049500.502743:0:6841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c2200/0xf4f48ce5e1bbf429 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049500.502751:0:6841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c2200/0xf4f48ce5e1bbf429 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049500.502765:0:6841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8cb8c396df00) 00010000:00010000:1.0:1789049500.502768:0:6841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789049500.502772:0:6841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c2200/0xf4f48ce5e1bbf429 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049500.502779:0:6841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c2200/0xf4f48ce5e1bbf429 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049500.502792:0:6841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c3800/0xf4f48ce5e1bbf430 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049500.502798:0:6841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c3800/0xf4f48ce5e1bbf430 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049500.502805:0:6841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c3800/0xf4f48ce5e1bbf430 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049500.503102:0:6841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cb8c28c3800 already unused, calling callback (ffffffffc20ca4f0) 00010000:00010000:1.0:1789049500.503106:0:6841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c3800/0xf4f48ce5e1bbf430 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049500.503122:0:6841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c3800/0xf4f48ce5e1bbf430 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049500.503132:0:6841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8cb8c396dd00) 00010000:00010000:1.0:1789049500.503134:0:6841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789049500.503138:0:6841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c3800/0xf4f48ce5e1bbf430 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049500.503144:0:6841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c3800/0xf4f48ce5e1bbf430 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049500.503196:0:6841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c2c00/0xf4f48ce5e1bbf422 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a3494 expref: 34 pid: 6841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049500.503210:0:6841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c3200/0xf4f48ce5e1bbf437 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a3494 expref: 33 pid: 6841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049500.503227:0:6841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8cb8c396d200) 00010000:00010000:1.0:1789049500.503229:0:6841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789049500.503232:0:6841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cb8c28c3200, rc 0) 00000100:00100000:1.0:1789049500.503300:0:6841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8df298e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e823b53a-3591-475c-8624-c682227e5c13+33:10481:x1875954089638272:12345-192.168.206.26@tcp:101:cat.0 Request processed in 1581us (1887us total) trans 4294967376 rc 0/0 00000100:00100000:1.0:1789049500.503308:0:6841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.26@tcp, seq: 94 00000100:00100000:3.0:1789049500.509266:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.26@tcp (source: 12345-192.168.206.26@tcp) 00000100:00100000:1.0:1789049500.509348:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954089638528 00000100:00100000:1.0:1789049500.509358:0:5853:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954089638528 00000100:00100000:1.0:1789049500.509414:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.26@tcp, seq: 24 00000100:00100000:1.0:1789049500.509424:0:5853:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8df299500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e823b53a-3591-475c-8624-c682227e5c13+33:10481:x1875954089638528:12345-192.168.206.26@tcp:35:cat.0 00000100:00100000:1.0:1789049500.509712:0:5853:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8df299500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e823b53a-3591-475c-8624-c682227e5c13+34:10481:x1875954089638528:12345-192.168.206.26@tcp:35:cat.0 Request processed in 288us (462us total) trans 4294967377 rc 0/0 00000100:00100000:1.0:1789049500.509720:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.26@tcp, seq: 24 00000100:00100000:3.0:1789049500.532790:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.26@tcp (source: 12345-192.168.206.26@tcp) 00000100:00100000:2.0:1789049500.532992:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954089638784 00000100:00100000:2.0:1789049500.533002:0:5851:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954089638784 00000100:00100000:2.0:1789049500.533058:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.26@tcp, seq: 95 00000100:00100000:2.0:1789049500.533068:0:5851:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb900a5b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e823b53a-3591-475c-8624-c682227e5c13+34:10482:x1875954089638784:12345-192.168.206.26@tcp:36:rm.0 00010000:00010000:2.0:1789049500.533134:0:5851:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:2.0:1789049500.533162:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c3200/0xf4f48ce5e1bbf437 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a3494 expref: 34 pid: 6841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049500.533184:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c3400/0xf4f48ce5e1bbf40d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a348d expref: 33 pid: 6841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049500.533197:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c3c00/0xf4f48ce5e1bbf3d5 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a347f expref: 32 pid: 6841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049500.533221:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8cb8c396d200) 00010000:00010000:2.0:1789049500.533231:0:5851:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789049500.533261:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6715800/0xf4f48ce5e1bbf445 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049500.533276:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6715800/0xf4f48ce5e1bbf445 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049500.533286:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6715800/0xf4f48ce5e1bbf445 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049500.533301:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6715c00/0xf4f48ce5e1bbf44c lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049500.533308:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6715c00/0xf4f48ce5e1bbf44c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049500.533315:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6715c00/0xf4f48ce5e1bbf44c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049500.533769:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6714c00/0xf4f48ce5e1bbf453 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049500.533779:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6714c00/0xf4f48ce5e1bbf453 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049500.533787:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6714c00/0xf4f48ce5e1bbf453 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1789049500.536198:0:5851:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].4, 64 off8472 00000004:00080000:2.0:1789049500.536213:0:5851:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 326588369036ns, next at 327588365568ns, rc = 0 00010000:00010000:2.0:1789049500.536307:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6715a00/0xf4f48ce5e1bbf45a lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049500.536324:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6715a00/0xf4f48ce5e1bbf45a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049500.536336:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6715a00/0xf4f48ce5e1bbf45a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049500.536345:0:5851:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6715a00/0xf4f48ce5e1bbf45a lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049500.536352:0:5851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6715a00/0xf4f48ce5e1bbf45a lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049500.536359:0:5851:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6715a00/0xf4f48ce5e1bbf45a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049500.536454:0:5851:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789049500.536476:0:5851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6714c00/0xf4f48ce5e1bbf453 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049500.536493:0:5851:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6714c00/0xf4f48ce5e1bbf453 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049500.536498:0:5851:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6714c00/0xf4f48ce5e1bbf453 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049500.536503:0:5851:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cb8d6714c00 already unused, calling callback (ffffffffc20ca4f0) 00010000:00010000:2.0:1789049500.536507:0:5851:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6714c00/0xf4f48ce5e1bbf453 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049500.536514:0:5851:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6714c00/0xf4f48ce5e1bbf453 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049500.536531:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8cb8e0130c00) 00010000:00010000:2.0:1789049500.536534:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1789049500.536539:0:5851:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6714c00/0xf4f48ce5e1bbf453 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049500.536545:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6714c00/0xf4f48ce5e1bbf453 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049500.536566:0:5851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6715800/0xf4f48ce5e1bbf445 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049500.536573:0:5851:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6715800/0xf4f48ce5e1bbf445 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049500.536579:0:5851:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6715800/0xf4f48ce5e1bbf445 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049500.536584:0:5851:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cb8d6715800 already unused, calling callback (ffffffffc20ca4f0) 00010000:00010000:2.0:1789049500.536587:0:5851:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6715800/0xf4f48ce5e1bbf445 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049500.536592:0:5851:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6715800/0xf4f48ce5e1bbf445 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049500.536599:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8cb8c396df00) 00010000:00010000:2.0:1789049500.536601:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789049500.536604:0:5851:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6715800/0xf4f48ce5e1bbf445 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049500.536611:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6715800/0xf4f48ce5e1bbf445 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789049500.536632:0:5851:0:(mdt_handler.c:4507:mdt_save_lock()) ### save lock request 000000006a5a6e49 reply state 00000000e00c05f7 transno 4294967378 ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6715c00/0xf4f48ce5e1bbf44c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789049500.536641:0:5851:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1789049500.536732:0:5851:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb900a5b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e823b53a-3591-475c-8624-c682227e5c13+33:10482:x1875954089638784:12345-192.168.206.26@tcp:36:rm.0 Request processed in 3662us (3949us total) trans 4294967378 rc 0/0 00000100:00100000:2.0:1789049500.536741:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.26@tcp, seq: 95 00010000:00010000:2.0:1789049500.541448:0:3294:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6715c00/0xf4f48ce5e1bbf44c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049500.541466:0:3294:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6715c00/0xf4f48ce5e1bbf44c lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049500.541473:0:3294:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6715c00/0xf4f48ce5e1bbf44c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049500.541478:0:3294:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cb8d6715c00 already unused, calling callback (ffffffffc20ca4f0) 00010000:00010000:2.0:1789049500.541482:0:3294:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6715c00/0xf4f48ce5e1bbf44c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049500.541489:0:3294:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6715c00/0xf4f48ce5e1bbf44c lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049500.541505:0:3294:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8cb8e0130900) 00010000:00010000:2.0:1789049500.541508:0:3294:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789049500.541512:0:3294:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6715c00/0xf4f48ce5e1bbf44c lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049500.541518:0:3294:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6715c00/0xf4f48ce5e1bbf44c lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049500.541947:0:5838:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789049500.541955:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6715a00/0xf4f48ce5e1bbf45a lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049500.541961:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cb8d6715a00 already unused, calling callback (ffffffffc166a8f0) 00010000:00010000:0.0:1789049500.541965:0:5838:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6715a00/0xf4f48ce5e1bbf45a lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049500.541972:0:5838:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6715a00/0xf4f48ce5e1bbf45a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049500.541982:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8cb8e0130c00) 00010000:00010000:0.0:1789049500.541985:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1789049500.541988:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6715a00/0xf4f48ce5e1bbf45a lrc: 1/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049500.541993:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6715a00/0xf4f48ce5e1bbf45a lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049500.542009:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789049500.542011:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789049500.542012:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789049500.598836:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.26@tcp (source: 12345-192.168.206.26@tcp) 00000100:00100000:2.0:1789049500.599135:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954089639040 00000100:00100000:2.0:1789049500.599146:0:5852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954089639040 00000100:00100000:2.0:1789049500.599206:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.26@tcp, seq: 96 00000100:00100000:2.0:1789049500.599217:0:5852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb900a59c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e823b53a-3591-475c-8624-c682227e5c13+32:10488:x1875954089639040:12345-192.168.206.26@tcp:101:bash.0 00010000:00010000:2.0:1789049500.599239:0:5852:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789049500.599258:0:5852:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6715c00/0xf4f48ce5e1bbf461 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7fc5e358805a349b expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049500.599368:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6715800/0xf4f48ce5e1bbf468 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049500.599383:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6715800/0xf4f48ce5e1bbf468 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049500.599409:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6715800/0xf4f48ce5e1bbf468 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049500.599425:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6714c00/0xf4f48ce5e1bbf46f lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049500.599432:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6714c00/0xf4f48ce5e1bbf46f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049500.599438:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6714c00/0xf4f48ce5e1bbf46f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1789049500.600354:0:5852:0:(osp_object.c:1667:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x3:0x0], index 1: 0 00010000:00010000:2.0:1789049500.600525:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6715200/0xf4f48ce5e1bbf476 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049500.600548:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6715200/0xf4f48ce5e1bbf476 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049500.600557:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6715200/0xf4f48ce5e1bbf476 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049500.600596:0:5852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6715800/0xf4f48ce5e1bbf468 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049500.600617:0:5852:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6715800/0xf4f48ce5e1bbf468 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049500.600624:0:5852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6715800/0xf4f48ce5e1bbf468 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049500.600630:0:5852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cb8d6715800 already unused, calling callback (ffffffffc20ca4f0) 00010000:00010000:2.0:1789049500.600634:0:5852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6715800/0xf4f48ce5e1bbf468 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049500.600641:0:5852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6715800/0xf4f48ce5e1bbf468 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049500.600653:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8cb8c396df00) 00010000:00010000:2.0:1789049500.600656:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789049500.600661:0:5852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6715800/0xf4f48ce5e1bbf468 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049500.600668:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6715800/0xf4f48ce5e1bbf468 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789049500.600683:0:5852:0:(mdt_handler.c:4507:mdt_save_lock()) ### save lock request 0000000081133da4 reply state 00000000974d7a2c transno 4294967379 ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6714c00/0xf4f48ce5e1bbf46f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789049500.600698:0:5852:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1789049500.600729:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6715c00/0xf4f48ce5e1bbf461 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a349b expref: 35 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049500.600745:0:5852:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6715200/0xf4f48ce5e1bbf476 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a349b expref: 34 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049500.600753:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8cb8e0130e00) 00010000:00010000:2.0:1789049500.600755:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789049500.600758:0:5852:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cb8d6715200, rc 0) 00000100:00100000:2.0:1789049500.600833:0:5852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb900a59c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e823b53a-3591-475c-8624-c682227e5c13+35:10488:x1875954089639040:12345-192.168.206.26@tcp:101:bash.0 Request processed in 1618us (2368us total) trans 4294967379 rc 0/0 00000100:00100000:2.0:1789049500.600881:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.26@tcp, seq: 96 00010000:00010000:1.0:1789049500.602359:0:3295:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6714c00/0xf4f48ce5e1bbf46f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049500.602370:0:3295:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6714c00/0xf4f48ce5e1bbf46f lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049500.602377:0:3295:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6714c00/0xf4f48ce5e1bbf46f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049500.602382:0:3295:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cb8d6714c00 already unused, calling callback (ffffffffc20ca4f0) 00010000:00010000:1.0:1789049500.602385:0:3295:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6714c00/0xf4f48ce5e1bbf46f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049500.602392:0:3295:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6714c00/0xf4f48ce5e1bbf46f lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049500.602404:0:3295:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8cb8e0130900) 00010000:00010000:1.0:1789049500.602407:0:3295:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789049500.602411:0:3295:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6714c00/0xf4f48ce5e1bbf46f lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049500.602416:0:3295:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6714c00/0xf4f48ce5e1bbf46f lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789049500.603995:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.26@tcp (source: 12345-192.168.206.26@tcp) 00000100:00100000:1.0:1789049500.604120:0:6703:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954089639168 00000100:00100000:1.0:1789049500.604130:0:6703:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954089639168 00000100:00100000:1.0:1789049500.604194:0:6703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.26@tcp, seq: 34 00000100:00100000:1.0:1789049500.604205:0:6703:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8ff3ed180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e823b53a-3591-475c-8624-c682227e5c13+7:2358:x1875954089639168:12345-192.168.206.26@tcp:101:bash.0 00010000:00010000:1.0:1789049500.604234:0:6703:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789049500.604251:0:6703:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009adbd380/0xf4f48ce5e1bbf484 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x7fc5e358805a34a2 expref: -99 pid: 6703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1789049500.604275:0:6703:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789049500.604294:0:6703:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=326s v=(0 0) 00010000:00010000:1.0:1789049500.604298:0:6703:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789049500.604307:0:6703:0:(ldlm_resource.c:1751:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009adbd380/0xf4f48ce5e1bbf484 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a34a2 expref: 8 pid: 6703 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049500.604324:0:6703:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000009adbd380/0xf4f48ce5e1bbf484 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a34a2 expref: 8 pid: 6703 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049500.604336:0:6703:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cb8c28c2c00, rc 0) 00000100:00100000:1.0:1789049500.604395:0:6703:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8ff3ed180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e823b53a-3591-475c-8624-c682227e5c13+8:2358:x1875954089639168:12345-192.168.206.26@tcp:101:bash.0 Request processed in 191us (405us total) trans 0 rc 0/0 00000100:00100000:1.0:1789049500.604403:0:6703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.26@tcp, seq: 34 00000100:00080000:2.0:1789049500.604649:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789049500.607994:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.26@tcp (source: 12345-192.168.206.26@tcp) 00000100:00100000:0.0:1789049500.610853:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954089639296 00000100:00100000:0.0:1789049500.610870:0:6704:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954089639296 00000100:00100000:0.0:1789049500.610950:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.26@tcp, seq: 35 00000100:00100000:0.0:1789049500.610960:0:6704:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8ff3ec000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e823b53a-3591-475c-8624-c682227e5c13+8:10488:x1875954089639296:12345-192.168.206.26@tcp:101:bash.0 00010000:00010000:0.0:1789049500.610977:0:6704:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789049500.610995:0:6704:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d266eacc/0xf4f48ce5e1bbf48b lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x7fc5e358805a34a9 expref: -99 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049500.611056:0:6704:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000009adbd380/0xf4f48ce5e1bbf484 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a34a2 expref: 9 pid: 6703 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049500.611065:0:6704:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789049500.611070:0:6704:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789049500.611075:0:6704:0:(ldlm_resource.c:1751:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d266eacc/0xf4f48ce5e1bbf48b lrc: 4/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a34a9 expref: 9 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049500.611105:0:6704:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000009adbd380/0xf4f48ce5e1bbf484 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a34a2 expref: 9 pid: 6703 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049500.611119:0:6704:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000009adbd380/0xf4f48ce5e1bbf484 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a34a2 expref: 9 pid: 6703 timeout: 426 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789049500.611132:0:6704:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb8df4d1180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6704:1875954110626944:192.168.206.26@tcp:104: 00000100:00100000:0.0:1789049500.611233:0:6704:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cb8c6b2a780 going to sleep for 11 seconds 00000100:00100000:2.0:1789049500.623607:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.26@tcp (source: 12345-192.168.206.26@tcp) 00000100:00100000:3.0:1789049500.623684:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954089639424 00000100:00100000:3.0:1789049500.623693:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954089639424 00010000:00010000:3.0:1789049500.623750:0:5837:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000009adbd380/0xf4f48ce5e1bbf484 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a34a2 expref: 10 pid: 6703 timeout: 426 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789049500.623818:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.26@tcp, seq: 49 00000100:00100000:3.0:1789049500.623829:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8c7decc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e823b53a-3591-475c-8624-c682227e5c13+10:2358:x1875954089639424:12345-192.168.206.26@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789049500.623871:0:5837:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789049500.623893:0:5837:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000009adbd380/0xf4f48ce5e1bbf484 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a34a2 expref: 10 pid: 6703 timeout: 426 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049500.623917:0:5837:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000009adbd380/0xf4f48ce5e1bbf484 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a34a2 expref: 10 pid: 6703 timeout: 426 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049500.623940:0:5837:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789049500.623945:0:5837:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789049500.623952:0:5837:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000d266eacc/0xf4f48ce5e1bbf48b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a34a9 expref: 10 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049500.623963:0:5837:0:(ldlm_resource.c:1751:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d266eacc/0xf4f48ce5e1bbf48b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a34a9 expref: 10 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049500.624000:0:5837:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000d266eacc/0xf4f48ce5e1bbf48b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a34a9 expref: 10 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789049500.624014:0:5837:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb8f7744a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5837:1875954110627072:192.168.206.26@tcp:105: 00000100:00100000:3.0:1789049500.624092:0:5837:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cb8c63ea0c0 going to sleep for 11 seconds 00010000:00010000:0.0:1789049500.624580:0:6704:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009adbd380/0xf4f48ce5e1bbf484 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a34a2 expref: 10 pid: 6703 timeout: 426 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789049500.624596:0:6704:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb8df4d1180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6704:1875954110626944:192.168.206.26@tcp:104: 00010000:00010000:0.0:1789049500.624620:0:6704:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000d266eacc/0xf4f48ce5e1bbf48b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a34a9 expref: 9 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049500.624631:0:6704:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cb7c4c39000, rc 0) 00000100:00100000:0.0:1789049500.624674:0:6704:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8ff3ec000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e823b53a-3591-475c-8624-c682227e5c13+9:10488:x1875954089639296:12345-192.168.206.26@tcp:101:bash.0 Request processed in 13715us (16690us total) trans 0 rc 0/0 00000100:00100000:0.0:1789049500.624682:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.26@tcp, seq: 35 00000100:00100000:3.0:1789049500.628839:0:5837:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb8f7744a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5837:1875954110627072:192.168.206.26@tcp:105: 00010000:00010000:3.0:1789049500.630071:0:5837:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789049500.630181:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8c7decc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e823b53a-3591-475c-8624-c682227e5c13+8:2358:x1875954089639424:12345-192.168.206.26@tcp:103:ldlm_bl.0 Request processed in 6352us (6579us total) trans 0 rc 0/0 00000100:00100000:3.0:1789049500.630192:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.26@tcp, seq: 49 00000100:00100000:2.0:1789049500.634735:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.26@tcp (source: 12345-192.168.206.26@tcp) 00000040:00080000:0.0:1789049500.636914:0:11704:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1789049500.636921:0:11704:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1789049500.636954:0:11704:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:0.0:1789049500.636961:0:11704:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1789049500.638159:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954089639680 00000100:00100000:1.0:1789049500.638170:0:5853:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954089639680 00000100:00100000:1.0:1789049500.638223:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.26@tcp, seq: 25 00000100:00100000:1.0:1789049500.638233:0:5853:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8df261880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e823b53a-3591-475c-8624-c682227e5c13+34:10488:x1875954089639680:12345-192.168.206.26@tcp:35:bash.0 00000001:00080000:1.0:1789049500.638512:0:5853:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967380 00000100:00100000:1.0:1789049500.638625:0:5853:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8df261880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e823b53a-3591-475c-8624-c682227e5c13+36:10488:x1875954089639680:12345-192.168.206.26@tcp:35:bash.0 Request processed in 394us (3899us total) trans 4294967381 rc 0/0 00000100:00100000:1.0:1789049500.638634:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.26@tcp, seq: 25 00000020:00080000:1.0:1789049500.638639:0:5853:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1789049500.812407:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.26@tcp (source: 12345-192.168.206.26@tcp) 00000100:00100000:1.0:1789049500.812716:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954089639808 00000100:00100000:1.0:1789049500.812735:0:5850:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954089639808 00000100:00100000:1.0:1789049500.812794:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.26@tcp, seq: 97 00000100:00100000:1.0:1789049500.812804:0:5850:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8f7744a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e823b53a-3591-475c-8624-c682227e5c13+36:10504:x1875954089639808:12345-192.168.206.26@tcp:101:lfs.0 00010000:00010000:1.0:1789049500.812827:0:5850:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789049500.812886:0:5850:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c3800/0xf4f48ce5e1bbf492 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7fc5e358805a34b0 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049500.812959:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c2200/0xf4f48ce5e1bbf499 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049500.812973:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c2200/0xf4f48ce5e1bbf499 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049500.812985:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c2200/0xf4f48ce5e1bbf499 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789049500.813015:0:5850:0:(mdt_handler.c:922:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00000004:00200000:1.0:1789049500.813019:0:5850:0:(mdt_handler.c:1587:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1789049500.813033:0:5850:0:(mdt_handler.c:2522:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c2200/0xf4f48ce5e1bbf499 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049500.813056:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c3800/0xf4f48ce5e1bbf492 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a34b0 expref: 38 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049500.813073:0:5850:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c2200/0xf4f48ce5e1bbf499 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a34b0 expref: 37 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049500.813082:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8cb8c396df00) 00010000:00010000:1.0:1789049500.813085:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1789049500.813115:0:5850:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cb8c28c2200, rc 0) 00000100:00100000:1.0:1789049500.813178:0:5850:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8f7744a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e823b53a-3591-475c-8624-c682227e5c13+37:10504:x1875954089639808:12345-192.168.206.26@tcp:101:lfs.0 Request processed in 375us (780us total) trans 0 rc 0/0 00000100:00100000:1.0:1789049500.813185:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.26@tcp, seq: 97 00000100:00100000:0.0:1789049500.818374:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.26@tcp (source: 12345-192.168.206.26@tcp) 00000100:00100000:2.0:1789049500.818471:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954089640064 00000100:00100000:2.0:1789049500.818483:0:5852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954089640064 00000100:00100000:2.0:1789049500.818536:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.26@tcp, seq: 98 00000100:00100000:2.0:1789049500.818545:0:5852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8df4d1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e823b53a-3591-475c-8624-c682227e5c13+37:10504:x1875954089640064:12345-192.168.206.26@tcp:101:lfs.0 00010000:00010000:2.0:1789049500.818564:0:5852:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789049500.818583:0:5852:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6714000/0xf4f48ce5e1bbf4a0 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7fc5e358805a34b7 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049500.818674:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6714a00/0xf4f48ce5e1bbf4a7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049500.818705:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6714a00/0xf4f48ce5e1bbf4a7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049500.818717:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6714a00/0xf4f48ce5e1bbf4a7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789049500.818743:0:5852:0:(mdt_handler.c:922:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:2.0:1789049500.819073:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6714000/0xf4f48ce5e1bbf4a0 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a34b7 expref: 40 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049500.819094:0:5852:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6714a00/0xf4f48ce5e1bbf4a7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a34b7 expref: 39 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049500.819114:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8cb8e0130e00) 00010000:00010000:2.0:1789049500.819117:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789049500.819121:0:5852:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cb8d6714a00, rc 0) 00000100:00100000:2.0:1789049500.819184:0:5852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8df4d1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e823b53a-3591-475c-8624-c682227e5c13+39:10504:x1875954089640064:12345-192.168.206.26@tcp:101:lfs.0 Request processed in 640us (820us total) trans 4294967382 rc 0/0 00000100:00100000:2.0:1789049500.819192:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.26@tcp, seq: 98 00000100:00100000:3.0:1789049500.824176:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.26@tcp (source: 12345-192.168.206.26@tcp) 00000100:00100000:3.0:1789049500.824213:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.26@tcp (source: 12345-192.168.206.26@tcp) 00000100:00100000:2.0:1789049500.824281:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954089640448 00000100:00100000:2.0:1789049500.824290:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954089640448 00000100:00100000:2.0:1789049500.824349:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.26@tcp, seq: 6 00000100:00100000:2.0:1789049500.824357:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8ff3c8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e823b53a-3591-475c-8624-c682227e5c13+39:2358:x1875954089640448:12345-192.168.206.26@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789049500.824371:0:5835:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789049500.824392:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6714a00/0xf4f48ce5e1bbf4a7 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a34b7 expref: 39 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049500.824427:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8cb8e0130e00) 00010000:00010000:2.0:1789049500.824432:0:5835:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789049500.824486:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8ff3c8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e823b53a-3591-475c-8624-c682227e5c13+38:2358:x1875954089640448:12345-192.168.206.26@tcp:103:ldlm_bl.0 Request processed in 129us (271us total) trans 0 rc 0/0 00000100:00100000:2.0:1789049500.824493:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.26@tcp, seq: 6 00000100:00100000:1.0:1789049500.824743:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954089640320 00000100:00100000:1.0:1789049500.824747:0:5850:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954089640320 00000100:00100000:1.0:1789049500.824781:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.26@tcp, seq: 99 00000100:00100000:1.0:1789049500.824788:0:5850:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8f7747800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e823b53a-3591-475c-8624-c682227e5c13+38:10504:x1875954089640320:12345-192.168.206.26@tcp:101:lfs.0 00010000:00010000:1.0:1789049500.824803:0:5850:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789049500.824817:0:5850:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c3800/0xf4f48ce5e1bbf4b5 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7fc5e358805a34be expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049500.824930:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c2800/0xf4f48ce5e1bbf4bc lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049500.824944:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c2800/0xf4f48ce5e1bbf4bc lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049500.824955:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c2800/0xf4f48ce5e1bbf4bc lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789049500.824967:0:5850:0:(mdt_handler.c:922:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:1.0:1789049500.825077:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c3800/0xf4f48ce5e1bbf4b5 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a34be expref: 41 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049500.825091:0:5850:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c2800/0xf4f48ce5e1bbf4bc lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a34be expref: 40 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049500.825098:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8cb8e0130e00) 00010000:00010000:1.0:1789049500.825108:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1789049500.825111:0:5850:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cb8c28c2800, rc 0) 00000100:00100000:1.0:1789049500.825141:0:5850:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8f7747800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e823b53a-3591-475c-8624-c682227e5c13+40:10504:x1875954089640320:12345-192.168.206.26@tcp:101:lfs.0 Request processed in 352us (973us total) trans 4294967383 rc 0/0 00000100:00100000:1.0:1789049500.825147:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.26@tcp, seq: 99 00000100:00100000:3.0:1789049500.835239:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.26@tcp (source: 12345-192.168.206.26@tcp) 00000100:00100000:2.0:1789049500.835387:0:6705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954089640576 00000100:00100000:2.0:1789049500.835396:0:6705:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954089640576 00000100:00100000:2.0:1789049500.835450:0:6705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.26@tcp, seq: 36 00000100:00100000:2.0:1789049500.835470:0:6705:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb900a54000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e823b53a-3591-475c-8624-c682227e5c13+8:2358:x1875954089640576:12345-192.168.206.26@tcp:1:lfs.0 00010000:00010000:2.0:1789049500.835511:0:6705:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007011bca5/0xf4f48ce5e1bbf4ca lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049500.835531:0:6705:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000d266eacc/0xf4f48ce5e1bbf48b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a34a9 expref: 8 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049500.835540:0:6705:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789049500.835544:0:6705:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1789049500.835548:0:6705:0:(ldlm_resource.c:1751:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007011bca5/0xf4f48ce5e1bbf4ca lrc: 4/0,1 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049500.835582:0:6705:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000d266eacc/0xf4f48ce5e1bbf48b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a34a9 expref: 8 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049500.835595:0:6705:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000d266eacc/0xf4f48ce5e1bbf48b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a34a9 expref: 8 pid: 6704 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789049500.835630:0:6705:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb8df263100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6705:1875954110627200:192.168.206.26@tcp:104: 00000100:00100000:2.0:1789049500.836164:0:6705:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cb8d0aaaf00 going to sleep for 11 seconds 00000100:00100000:2.0:1789049500.840288:0:6705:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb8df263100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6705:1875954110627200:192.168.206.26@tcp:104: 00010000:00010000:2.0:1789049500.840316:0:6705:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000007011bca5/0xf4f48ce5e1bbf4ca lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789049500.842160:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.26@tcp (source: 12345-192.168.206.26@tcp) 00000100:00100000:1.0:1789049500.842610:0:6710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954089640704 00000100:00100000:1.0:1789049500.842619:0:6710:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954089640704 00002000:00100000:1.0:1789049500.842670:0:6710:0:(ofd_dev.c:2725:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x3:0x0] (0->8) req@ffff8cb900a56d80 x1875954089640704/t0(0) o4->e823b53a-3591-475c-8624-c682227e5c13@192.168.206.26@tcp:1/0 lens 504/0 e 0 to 0 dl 1789049511 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789049500.842681:0:6710:0:(ofd_dev.c:2581:ofd_prolong_extent_locks()) Prolong locks for req ffff8cb900a56d80 with x1875954089640704 ext(0->8) 00010000:00010000:1.0:1789049500.842690:0:6710:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000d266eacc/0xf4f48ce5e1bbf48b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a34a9 expref: 9 pid: 6704 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049500.842707:0:6710:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000d266eacc/0xf4f48ce5e1bbf48b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a34a9 expref: 9 pid: 6704 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1789049500.842715:0:6710:0:(ofd_dev.c:2730:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8cb900a56d80 00000100:00100000:1.0:1789049500.842754:0:6710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.26@tcp, seq: 1 00000100:00100000:1.0:1789049500.842763:0:6710:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb900a56d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e823b53a-3591-475c-8624-c682227e5c13+9:2357:x1875954089640704:12345-192.168.206.26@tcp:4:lfs.0 00000100:00100000:1.0:1789049500.843247:0:6710:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb900a56d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e823b53a-3591-475c-8624-c682227e5c13+11:2357:x1875954089640704:12345-192.168.206.26@tcp:4:lfs.0 Request processed in 482us (1092us total) trans 4294967302 rc 0/0 00000100:00100000:1.0:1789049500.843267:0:6710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.26@tcp, seq: 1 00002000:00100000:1.0:1789049500.843275:0:6710:0:(ofd_dev.c:2725:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x3:0x0] (0->8) req@ffff8cb900a56d80 x1875954089640704/t4294967302(0) o4->e823b53a-3591-475c-8624-c682227e5c13@192.168.206.26@tcp:1/0 lens 504/448 e 0 to 0 dl 1789049511 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789049500.843285:0:6710:0:(ofd_dev.c:2581:ofd_prolong_extent_locks()) Prolong locks for req ffff8cb900a56d80 with x1875954089640704 ext(0->8) 00010000:00010000:1.0:1789049500.843297:0:6710:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000d266eacc/0xf4f48ce5e1bbf48b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a34a9 expref: 11 pid: 6704 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049500.843309:0:6710:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000d266eacc/0xf4f48ce5e1bbf48b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a34a9 expref: 11 pid: 6704 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1789049500.843316:0:6710:0:(ofd_dev.c:2730:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8cb900a56d80 00000100:00100000:3.0:1789049500.847053:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.26@tcp (source: 12345-192.168.206.26@tcp) 00000100:00100000:1.0:1789049500.847157:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954089640832 00000100:00100000:1.0:1789049500.847167:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954089640832 00010000:00010000:1.0:1789049500.847206:0:5836:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000d266eacc/0xf4f48ce5e1bbf48b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a34a9 expref: 11 pid: 6704 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789049500.847245:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.26@tcp, seq: 50 00000100:00100000:1.0:1789049500.847262:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8c5819f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e823b53a-3591-475c-8624-c682227e5c13+11:2358:x1875954089640832:12345-192.168.206.26@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789049500.847277:0:5836:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:1.0:1789049500.847296:0:5836:0:(ofd_lvb.c:321:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:1.0:1789049500.847298:0:5836:0:(ofd_lvb.c:328:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb mtime from disk: 0 -> 1789049499945360312 00002000:00010000:1.0:1789049500.847300:0:5836:0:(ofd_lvb.c:334:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb atime from disk: 0 -> 1789049500150404633 00002000:00010000:1.0:1789049500.847302:0:5836:0:(ofd_lvb.c:340:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb ctime from disk: 0 -> 1789049499945360312 00010000:00010000:1.0:1789049500.847309:0:5836:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000d266eacc/0xf4f48ce5e1bbf48b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a34a9 expref: 11 pid: 6704 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049500.847322:0:5836:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000d266eacc/0xf4f48ce5e1bbf48b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a34a9 expref: 11 pid: 6704 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049500.847344:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d266eacc/0xf4f48ce5e1bbf48b lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a34a9 expref: 11 pid: 6704 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049500.847389:0:5836:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1789049500.847393:0:5836:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1789049500.847399:0:5836:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000007011bca5/0xf4f48ce5e1bbf4ca lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049500.847408:0:5836:0:(ldlm_resource.c:1751:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007011bca5/0xf4f48ce5e1bbf4ca lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049500.847440:0:5836:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789049500.848040:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8c5819f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e823b53a-3591-475c-8624-c682227e5c13+10:2358:x1875954089640832:12345-192.168.206.26@tcp:103:ldlm_bl.0 Request processed in 777us (993us total) trans 0 rc 0/0 00000100:00100000:1.0:1789049500.848050:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.26@tcp, seq: 50 00010000:00010000:2.0:1789049500.848495:0:6705:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000007011bca5/0xf4f48ce5e1bbf4ca lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049500.848509:0:6705:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007011bca5/0xf4f48ce5e1bbf4ca lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049500.848537:0:6705:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007011bca5/0xf4f48ce5e1bbf4ca lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049500.848544:0:6705:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000007011bca5/0xf4f48ce5e1bbf4ca lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049500.848552:0:6705:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000007011bca5/0xf4f48ce5e1bbf4ca lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049500.848558:0:6705:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cb8d6714a00 already unused, calling callback (ffffffffc166a8f0) 00010000:00010000:2.0:1789049500.848562:0:6705:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000007011bca5/0xf4f48ce5e1bbf4ca lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049500.848586:0:6705:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000007011bca5/0xf4f48ce5e1bbf4ca lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049500.848601:0:6705:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000007011bca5/0xf4f48ce5e1bbf4ca lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049500.848609:0:6705:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007011bca5/0xf4f48ce5e1bbf4ca lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789049500.848676:0:6705:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb900a54000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e823b53a-3591-475c-8624-c682227e5c13+9:2358:x1875954089640576:12345-192.168.206.26@tcp:1:lfs.0 Request processed in 13215us (13442us total) trans 0 rc 0/0 00000100:00100000:2.0:1789049500.848684:0:6705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.26@tcp, seq: 36 00000100:00100000:3.0:1789049500.853691:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.26@tcp (source: 12345-192.168.206.26@tcp) 00000100:00100000:1.0:1789049500.853789:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954089641088 00000100:00100000:1.0:1789049500.853798:0:5853:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954089641088 00000100:00100000:1.0:1789049500.853884:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.26@tcp, seq: 26 00000100:00100000:1.0:1789049500.853894:0:5853:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8d1d2a450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e823b53a-3591-475c-8624-c682227e5c13+40:10504:x1875954089641088:12345-192.168.206.26@tcp:35:lfs.0 00000004:00010000:1.0:1789049500.853959:0:5853:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0x7:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c2800/0xf4f48ce5e1bbf4bc lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a34be expref: 40 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789049500.854182:0:5853:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967384 00000001:00080000:1.0:1789049500.854220:0:5853:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967385 00000001:00080000:1.0:1789049500.854506:0:5853:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967386 00010000:00010000:1.0:1789049500.854557:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c3800/0xf4f48ce5e1bbf4d1 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049500.854573:0:5853:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6715200/0xf4f48ce5e1bbf476 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a349b expref: 44 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049500.854594:0:5853:0:(ldlm_resource.c:1751:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c3800/0xf4f48ce5e1bbf4d1 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049500.854626:0:5853:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6715200/0xf4f48ce5e1bbf476 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a349b expref: 44 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049500.854640:0:5853:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6715200/0xf4f48ce5e1bbf476 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a349b expref: 44 pid: 5852 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789049500.854655:0:5853:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb8df209880 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5853:1875954110627328:192.168.206.26@tcp:104: 00000100:00100000:1.0:1789049500.854734:0:5853:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cb8c79e0180 going to sleep for 11 seconds 00000100:00100000:1.0:1789049500.859179:0:5853:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb8df209880 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5853:1875954110627328:192.168.206.26@tcp:104: 00010000:00010000:1.0:1789049500.859209:0:5853:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c3800/0xf4f48ce5e1bbf4d1 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789049500.860329:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.26@tcp (source: 12345-192.168.206.26@tcp) 00000100:00100000:2.0:1789049500.860424:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954089641216 00000100:00100000:2.0:1789049500.860434:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954089641216 00010000:00010000:2.0:1789049500.860483:0:5835:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6715200/0xf4f48ce5e1bbf476 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a349b expref: 45 pid: 5852 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789049500.860520:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.26@tcp, seq: 51 00000100:00100000:2.0:1789049500.860529:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8c581b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e823b53a-3591-475c-8624-c682227e5c13+45:2357:x1875954089641216:12345-192.168.206.26@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789049500.860544:0:5835:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789049500.860551:0:5835:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6715200/0xf4f48ce5e1bbf476 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a349b expref: 45 pid: 5852 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049500.860564:0:5835:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6715200/0xf4f48ce5e1bbf476 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a349b expref: 45 pid: 5852 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049500.860606:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6715200/0xf4f48ce5e1bbf476 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a349b expref: 45 pid: 5852 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049500.860624:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8cb8e0130e00) 00010000:00010000:2.0:1789049500.860629:0:5835:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c3800/0xf4f48ce5e1bbf4d1 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049500.860637:0:5835:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c3800/0xf4f48ce5e1bbf4d1 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049500.860645:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c3800/0xf4f48ce5e1bbf4d1 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049500.860675:0:5835:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789049500.860746:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8c581b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e823b53a-3591-475c-8624-c682227e5c13+44:2357:x1875954089641216:12345-192.168.206.26@tcp:103:ldlm_bl.0 Request processed in 217us (422us total) trans 0 rc 0/0 00000100:00100000:2.0:1789049500.860754:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.26@tcp, seq: 51 00010000:00010000:1.0:1789049500.861167:0:5853:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c3800/0xf4f48ce5e1bbf4d1 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049500.861176:0:5853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c3800/0xf4f48ce5e1bbf4d1 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789049500.861285:0:5853:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967387 00000001:00080000:1.0:1789049500.861490:0:5853:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967388 00000100:00100000:1.0:1789049500.861615:0:5853:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb8df209880 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5853:1875954110627456:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1789049500.861664:0:5853:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789049500.861698:0:5853:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cb8c79e03c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789049500.861921:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954110627456 00000100:00100000:2.0:1789049500.861928:0:5856:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954110627456 00000100:00100000:2.0:1789049500.861979:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1789049500.861987:0:5856:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8df20b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:5853:x1875954110627456:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1789049500.862060:0:5856:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8df20b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:5853:x1875954110627456:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 74us (395us total) trans 0 rc 0/0 00000100:00100000:2.0:1789049500.862068:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00080000:0.0:1789049500.862131:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789049500.862321:0:5853:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb8df209880 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5853:1875954110627456:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:1.0:1789049500.863655:0:5853:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967389 00000100:00100000:1.0:1789049500.865091:0:5853:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb8df209880 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5853:1875954110627584:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1789049500.865160:0:5853:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789049500.865241:0:5853:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cb8c79e0180 going to sleep for 11 seconds 00000100:00100000:2.0:1789049500.866236:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954110627584 00000100:00100000:2.0:1789049500.866298:0:5856:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954110627584 00000100:00100000:2.0:1789049500.866399:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1789049500.866409:0:5856:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8df20a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:5853:x1875954110627584:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1789049500.866785:0:5856:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8df20a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+8:5853:x1875954110627584:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 376us (1624us total) trans 4294967303 rc 0/0 00000100:00100000:2.0:1789049500.866792:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1789049500.866907:0:5853:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb8df209880 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5853:1875954110627584:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:3.0:1789049500.866977:0:5853:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967390 00010000:00010000:3.0:1789049500.867021:0:5853:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c3800/0xf4f48ce5e1bbf4d1 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049500.867032:0:5853:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c3800/0xf4f48ce5e1bbf4d1 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049500.867040:0:5853:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c3800/0xf4f48ce5e1bbf4d1 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049500.867046:0:5853:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cb8c28c3800 already unused, calling callback (ffffffffc20ca4f0) 00010000:00010000:3.0:1789049500.867051:0:5853:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c3800/0xf4f48ce5e1bbf4d1 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049500.867058:0:5853:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c3800/0xf4f48ce5e1bbf4d1 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049500.867086:0:5853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8cb8e0130e00) 00010000:00010000:3.0:1789049500.867089:0:5853:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:3.0:1789049500.867094:0:5853:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c3800/0xf4f48ce5e1bbf4d1 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049500.867113:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c3800/0xf4f48ce5e1bbf4d1 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1789049500.867302:0:5853:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0x8:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:3.0:1789049500.867957:0:5853:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].3, 64 off8384 00000004:00080000:3.0:1789049500.867974:0:5853:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 326920129979ns, next at 327920126940ns, rc = 0 00000001:00080000:3.0:1789049500.867985:0:5853:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967391 00010000:00010000:3.0:1789049500.868032:0:5853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8cb8e0130e00) 00010000:00010000:3.0:1789049500.868037:0:5853:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1789049500.868045:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c2800/0xf4f48ce5e1bbf4bc lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a34be expref: 48 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789049500.868168:0:5853:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8d1d2a450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e823b53a-3591-475c-8624-c682227e5c13+47:10504:x1875954089641088:12345-192.168.206.26@tcp:35:lfs.0 Request processed in 14275us (14486us total) trans 4294967392 rc 0/0 00000100:00100000:3.0:1789049500.868178:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.26@tcp, seq: 26 00000020:00080000:3.0:1789049500.868182:0:5853:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:3.0:1789049500.871834:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.26@tcp (source: 12345-192.168.206.26@tcp) 00000100:00100000:0.0:1789049500.872036:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954089641344 00000100:00100000:0.0:1789049500.872045:0:5852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954089641344 00000100:00100000:0.0:1789049500.872095:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.26@tcp, seq: 100 00000100:00100000:0.0:1789049500.872104:0:5852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8c5819180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e823b53a-3591-475c-8624-c682227e5c13+47:10504:x1875954089641344:12345-192.168.206.26@tcp:101:lfs.0 00010000:00010000:0.0:1789049500.872129:0:5852:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789049500.872152:0:5852:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb7c4c38c00/0xf4f48ce5e1bbf4d8 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7fc5e358805a34c5 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049500.872211:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cb7c4c38c00/0xf4f48ce5e1bbf4d8 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a34c5 expref: 48 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049500.872225:0:5852:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb7c4c38c00/0xf4f48ce5e1bbf4d8 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a34c5 expref: 48 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049500.872254:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8cb8ce751200) 00010000:00010000:0.0:1789049500.872257:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1789049500.872260:0:5852:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cb7c4c38c00, rc 0) 00000100:00100000:0.0:1789049500.872309:0:5852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8c5819180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e823b53a-3591-475c-8624-c682227e5c13+48:10504:x1875954089641344:12345-192.168.206.26@tcp:101:lfs.0 Request processed in 206us (483us total) trans 0 rc 0/0 00000100:00100000:0.0:1789049500.872331:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.26@tcp, seq: 100 00000100:00100000:0.0:1789049500.876530:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.26@tcp (source: 12345-192.168.206.26@tcp) 00000100:00100000:2.0:1789049500.876687:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954089641600 00000100:00100000:2.0:1789049500.876697:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954089641600 00000100:00100000:2.0:1789049500.876757:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.26@tcp, seq: 27 00000100:00100000:2.0:1789049500.876766:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8df4d3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e823b53a-3591-475c-8624-c682227e5c13+48:10504:x1875954089641600:12345-192.168.206.26@tcp:35:lfs.0 00000100:00100000:2.0:1789049500.877039:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8df4d3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e823b53a-3591-475c-8624-c682227e5c13+49:10504:x1875954089641600:12345-192.168.206.26@tcp:35:lfs.0 Request processed in 273us (517us total) trans 4294967393 rc 0/0 00000100:00100000:2.0:1789049500.877047:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.26@tcp, seq: 27 00000100:00100000:0.0:1789049501.013287:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.26@tcp (source: 12345-192.168.206.26@tcp) 00000100:00100000:1.0:1789049501.013569:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954089641728 00000100:00100000:1.0:1789049501.013579:0:5850:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954089641728 00000100:00100000:1.0:1789049501.013636:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.26@tcp, seq: 101 00000100:00100000:1.0:1789049501.013646:0:5850:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8df4d0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e823b53a-3591-475c-8624-c682227e5c13+49:10514:x1875954089641728:12345-192.168.206.26@tcp:34:lfs.0 00010000:00010000:1.0:1789049501.013714:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c2e00/0xf4f48ce5e1bbf4df lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049501.013741:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c2e00/0xf4f48ce5e1bbf4df lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049501.013754:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c2e00/0xf4f48ce5e1bbf4df lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049501.013769:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c2600/0xf4f48ce5e1bbf4e6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049501.013776:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c2600/0xf4f48ce5e1bbf4e6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049501.013782:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c2600/0xf4f48ce5e1bbf4e6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049501.013904:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c2000/0xf4f48ce5e1bbf4ed lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049501.013913:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c2000/0xf4f48ce5e1bbf4ed lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049501.013936:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c2000/0xf4f48ce5e1bbf4ed lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789049501.013976:0:5850:0:(mdt_handler.c:2522:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c2000/0xf4f48ce5e1bbf4ed lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049501.013988:0:5850:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c2e00/0xf4f48ce5e1bbf4df lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049501.013995:0:5850:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c2e00/0xf4f48ce5e1bbf4df lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049501.014002:0:5850:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c2e00/0xf4f48ce5e1bbf4df lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049501.014007:0:5850:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cb8c28c2e00 already unused, calling callback (ffffffffc20ca4f0) 00010000:00010000:1.0:1789049501.014012:0:5850:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c2e00/0xf4f48ce5e1bbf4df lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049501.014018:0:5850:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c2e00/0xf4f48ce5e1bbf4df lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049501.014029:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8cb8c396df00) 00010000:00010000:1.0:1789049501.014031:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789049501.014036:0:5850:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c2e00/0xf4f48ce5e1bbf4df lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049501.014042:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c2e00/0xf4f48ce5e1bbf4df lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049501.014055:0:5850:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c2600/0xf4f48ce5e1bbf4e6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049501.014066:0:5850:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c2600/0xf4f48ce5e1bbf4e6 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049501.014071:0:5850:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c2600/0xf4f48ce5e1bbf4e6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049501.014076:0:5850:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cb8c28c2600 already unused, calling callback (ffffffffc20ca4f0) 00010000:00010000:1.0:1789049501.014079:0:5850:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c2600/0xf4f48ce5e1bbf4e6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049501.014085:0:5850:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c2600/0xf4f48ce5e1bbf4e6 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049501.014094:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8cb8c396dc00) 00010000:00010000:1.0:1789049501.014096:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789049501.014099:0:5850:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c2600/0xf4f48ce5e1bbf4e6 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049501.014105:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c2600/0xf4f48ce5e1bbf4e6 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049501.014121:0:5850:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c2000/0xf4f48ce5e1bbf4ed lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049501.014127:0:5850:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c2000/0xf4f48ce5e1bbf4ed lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049501.014132:0:5850:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c2000/0xf4f48ce5e1bbf4ed lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049501.014136:0:5850:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cb8c28c2000 already unused, calling callback (ffffffffc20ca4f0) 00010000:00010000:1.0:1789049501.014145:0:5850:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c2000/0xf4f48ce5e1bbf4ed lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049501.014151:0:5850:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c2000/0xf4f48ce5e1bbf4ed lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049501.014170:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8cb8ce751200) 00010000:00010000:1.0:1789049501.014173:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789049501.014176:0:5850:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c2000/0xf4f48ce5e1bbf4ed lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049501.014181:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c2000/0xf4f48ce5e1bbf4ed lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789049501.014262:0:5850:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8df4d0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e823b53a-3591-475c-8624-c682227e5c13+49:10514:x1875954089641728:12345-192.168.206.26@tcp:34:lfs.0 Request processed in 617us (986us total) trans 0 rc 0/0 00000100:00100000:1.0:1789049501.014270:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.26@tcp, seq: 101 00000100:00100000:0.0:1789049501.065295:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.26@tcp (source: 12345-192.168.206.26@tcp) 00000100:00100000:2.0:1789049501.065688:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954089641984 00000100:00100000:2.0:1789049501.065698:0:5852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954089641984 00000100:00100000:2.0:1789049501.065766:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.26@tcp, seq: 102 00000100:00100000:2.0:1789049501.065775:0:5852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8df4d2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e823b53a-3591-475c-8624-c682227e5c13+49:10517:x1875954089641984:12345-192.168.206.26@tcp:101:lfs.0 00010000:00010000:2.0:1789049501.065795:0:5852:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789049501.065814:0:5852:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6714a00/0xf4f48ce5e1bbf4f4 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7fc5e358805a34cc expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049501.065921:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6714000/0xf4f48ce5e1bbf4fb lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049501.065935:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6714000/0xf4f48ce5e1bbf4fb lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049501.065944:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6714000/0xf4f48ce5e1bbf4fb lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049501.065958:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6714e00/0xf4f48ce5e1bbf502 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049501.065978:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6714e00/0xf4f48ce5e1bbf502 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049501.065985:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6714e00/0xf4f48ce5e1bbf502 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049501.066094:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6715200/0xf4f48ce5e1bbf509 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049501.066103:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6715200/0xf4f48ce5e1bbf509 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049501.066110:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6715200/0xf4f48ce5e1bbf509 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789049501.066120:0:5852:0:(mdt_handler.c:922:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:2.0:1789049501.066228:0:5852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6714000/0xf4f48ce5e1bbf4fb lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049501.066236:0:5852:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6714000/0xf4f48ce5e1bbf4fb lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049501.066252:0:5852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6714000/0xf4f48ce5e1bbf4fb lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049501.066257:0:5852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cb8d6714000 already unused, calling callback (ffffffffc20ca4f0) 00010000:00010000:2.0:1789049501.066262:0:5852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6714000/0xf4f48ce5e1bbf4fb lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049501.066268:0:5852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6714000/0xf4f48ce5e1bbf4fb lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049501.066290:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8cb8c396df00) 00010000:00010000:2.0:1789049501.066292:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789049501.066297:0:5852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6714000/0xf4f48ce5e1bbf4fb lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049501.066303:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6714000/0xf4f48ce5e1bbf4fb lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049501.066317:0:5852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6714e00/0xf4f48ce5e1bbf502 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049501.066323:0:5852:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6714e00/0xf4f48ce5e1bbf502 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049501.066328:0:5852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6714e00/0xf4f48ce5e1bbf502 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049501.066333:0:5852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cb8d6714e00 already unused, calling callback (ffffffffc20ca4f0) 00010000:00010000:2.0:1789049501.066335:0:5852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6714e00/0xf4f48ce5e1bbf502 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049501.066341:0:5852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6714e00/0xf4f48ce5e1bbf502 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049501.066348:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8cb8e0130400) 00010000:00010000:2.0:1789049501.066351:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789049501.066353:0:5852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6714e00/0xf4f48ce5e1bbf502 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049501.066359:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6714e00/0xf4f48ce5e1bbf502 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049501.066712:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6714a00/0xf4f48ce5e1bbf4f4 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a34cc expref: 52 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049501.066825:0:5852:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6715200/0xf4f48ce5e1bbf509 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a34cc expref: 51 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049501.066833:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8cb8ce751200) 00010000:00010000:2.0:1789049501.066835:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789049501.066838:0:5852:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cb8d6715200, rc 0) 00000100:00100000:2.0:1789049501.067203:0:5852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8df4d2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e823b53a-3591-475c-8624-c682227e5c13+51:10517:x1875954089641984:12345-192.168.206.26@tcp:101:lfs.0 Request processed in 1427us (1915us total) trans 4294967394 rc 0/0 00000100:00100000:2.0:1789049501.067248:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.26@tcp, seq: 102 00000100:00100000:2.0:1789049501.072052:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.26@tcp (source: 12345-192.168.206.26@tcp) 00000100:00100000:1.0:1789049501.073148:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954089642112 00000100:00100000:1.0:1789049501.073169:0:5850:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954089642112 00000100:00100000:1.0:1789049501.073235:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.26@tcp, seq: 103 00000100:00100000:1.0:1789049501.073254:0:5850:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8df263100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e823b53a-3591-475c-8624-c682227e5c13+51:10517:x1875954089642112:12345-192.168.206.26@tcp:54:lfs.0 00010000:00010000:1.0:1789049501.073317:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c2000/0xf4f48ce5e1bbf517 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049501.073334:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c2000/0xf4f48ce5e1bbf517 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049501.073347:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c2000/0xf4f48ce5e1bbf517 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049501.073540:0:5850:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c2000/0xf4f48ce5e1bbf517 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049501.073560:0:5850:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c2000/0xf4f48ce5e1bbf517 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049501.073566:0:5850:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c2000/0xf4f48ce5e1bbf517 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049501.073573:0:5850:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cb8c28c2000 already unused, calling callback (ffffffffc20ca4f0) 00010000:00010000:1.0:1789049501.073577:0:5850:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c2000/0xf4f48ce5e1bbf517 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049501.073585:0:5850:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c2000/0xf4f48ce5e1bbf517 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049501.073596:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8cb8ce751200) 00010000:00010000:1.0:1789049501.073599:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1789049501.073605:0:5850:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c2000/0xf4f48ce5e1bbf517 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049501.073611:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c2000/0xf4f48ce5e1bbf517 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789049501.073690:0:5850:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8df263100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e823b53a-3591-475c-8624-c682227e5c13+51:10517:x1875954089642112:12345-192.168.206.26@tcp:54:lfs.0 Request processed in 446us (1646us total) trans 0 rc 0/0 00000100:00100000:1.0:1789049501.073698:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.26@tcp, seq: 103 00000100:00100000:0.0:1789049501.077672:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.26@tcp (source: 12345-192.168.206.26@tcp) 00000100:00100000:2.0:1789049501.077769:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954089642368 00000100:00100000:2.0:1789049501.077778:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954089642368 00000100:00100000:2.0:1789049501.077823:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.26@tcp, seq: 28 00000100:00100000:2.0:1789049501.077832:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8df4d1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e823b53a-3591-475c-8624-c682227e5c13+51:10517:x1875954089642368:12345-192.168.206.26@tcp:35:lfs.0 00000100:00100000:2.0:1789049501.078084:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8df4d1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e823b53a-3591-475c-8624-c682227e5c13+52:10517:x1875954089642368:12345-192.168.206.26@tcp:35:lfs.0 Request processed in 251us (422us total) trans 4294967395 rc 0/0 00000100:00100000:2.0:1789049501.078092:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.26@tcp, seq: 28 00000100:00100000:3.0:1789049501.083629:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789049501.086102:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb8df262680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3309:1875954110627712:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789049501.086339:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789049501.086565:0:6706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954110627712 00000100:00100000:0.0:1789049501.086573:0:6706:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954110627712 00000100:00100000:0.0:1789049501.086664:0:6706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1789049501.086674:0:6706:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8c5818a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3309:x1875954110627712:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789049501.086706:0:6706:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789049501.086875:0:6706:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8c5818a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3309:x1875954110627712:12345-0@lo:13:osp-pre-0-0.0 Request processed in 203us (537us total) trans 0 rc 0/0 00000100:00100000:0.0:1789049501.086883:0:6706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1789049501.086978:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb8df262680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3309:1875954110627712:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1789049501.087079:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789049501.195119:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.26@tcp (source: 12345-192.168.206.26@tcp) 00000100:00100000:1.0:1789049501.195242:0:6841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954089642624 00000100:00100000:1.0:1789049501.195310:0:6841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954089642624 00000100:00100000:1.0:1789049501.195470:0:6841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.26@tcp, seq: 104 00000100:00100000:1.0:1789049501.195481:0:6841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8df4d1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e823b53a-3591-475c-8624-c682227e5c13+52:10527:x1875954089642624:12345-192.168.206.26@tcp:101:bash.0 00010000:00010000:1.0:1789049501.195516:0:6841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789049501.195532:0:6841:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1789049501.195559:0:6841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c2200/0xf4f48ce5e1bbf499 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a34b0 expref: 52 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049501.195579:0:6841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8cb8c396df00) 00010000:00010000:1.0:1789049501.195584:0:6841:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789049501.195596:0:6841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c2000/0xf4f48ce5e1bbf51e lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7fc5e358805a34d3 expref: -99 pid: 6841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049501.195681:0:6841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c2600/0xf4f48ce5e1bbf525 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049501.195695:0:6841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c2600/0xf4f48ce5e1bbf525 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049501.195706:0:6841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c2600/0xf4f48ce5e1bbf525 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6841 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789049501.195716:0:6841:0:(mdt_handler.c:922:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:1.0:1789049501.196039:0:6841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c2000/0xf4f48ce5e1bbf51e lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a34d3 expref: 54 pid: 6841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049501.196054:0:6841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c2600/0xf4f48ce5e1bbf525 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a34d3 expref: 53 pid: 6841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049501.196062:0:6841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8cb8ce751200) 00010000:00010000:1.0:1789049501.196066:0:6841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789049501.196068:0:6841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cb8c28c2600, rc 0) 00000100:00100000:1.0:1789049501.196133:0:6841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8df4d1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e823b53a-3591-475c-8624-c682227e5c13+53:10527:x1875954089642624:12345-192.168.206.26@tcp:101:bash.0 Request processed in 655us (1026us total) trans 4294967396 rc 0/0 00000100:00100000:1.0:1789049501.196151:0:6841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.26@tcp, seq: 104 00000100:00100000:0.0:1789049501.199326:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.26@tcp (source: 12345-192.168.206.26@tcp) 00000100:00100000:2.0:1789049501.199421:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954089642880 00000100:00100000:2.0:1789049501.199430:0:5851:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954089642880 00000100:00100000:2.0:1789049501.199480:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.26@tcp, seq: 105 00000100:00100000:2.0:1789049501.199489:0:5851:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8df4d3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e823b53a-3591-475c-8624-c682227e5c13+53:10527:x1875954089642880:12345-192.168.206.26@tcp:36:bash.0 00010000:00010000:2.0:1789049501.199567:0:5851:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:2.0:1789049501.199592:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c2600/0xf4f48ce5e1bbf525 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a34d3 expref: 53 pid: 6841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049501.199615:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6715200/0xf4f48ce5e1bbf509 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a34cc expref: 52 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049501.199626:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8cb8ce751200) 00010000:00010000:2.0:1789049501.199631:0:5851:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789049501.200138:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6714a00/0xf4f48ce5e1bbf533 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049501.200155:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6714a00/0xf4f48ce5e1bbf533 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049501.200165:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6714a00/0xf4f48ce5e1bbf533 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789049501.200219:0:5851:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967397 00000004:00010000:2.0:1789049501.200243:0:5851:0:(mdt_handler.c:4507:mdt_save_lock()) ### save lock request 000000000520d72f reply state 00000000f2e11b2e transno 4294967398 ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6714a00/0xf4f48ce5e1bbf533 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789049501.200252:0:5851:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1789049501.200445:0:5851:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8df4d3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e823b53a-3591-475c-8624-c682227e5c13+54:10527:x1875954089642880:12345-192.168.206.26@tcp:36:bash.0 Request processed in 955us (1127us total) trans 4294967398 rc 0/0 00000100:00100000:2.0:1789049501.200453:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.26@tcp, seq: 105 00000020:00080000:2.0:1789049501.200458:0:5851:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1789049501.207741:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.26@tcp (source: 12345-192.168.206.26@tcp) 00010000:00010000:2.0:1789049501.207806:0:3294:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6714a00/0xf4f48ce5e1bbf533 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789049501.207806:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954089643008 00000100:00100000:1.0:1789049501.207816:0:5852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954089643008 00010000:00010000:2.0:1789049501.207834:0:3294:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6714a00/0xf4f48ce5e1bbf533 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049501.207859:0:3294:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6714a00/0xf4f48ce5e1bbf533 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049501.207866:0:3294:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cb8d6714a00 already unused, calling callback (ffffffffc20ca4f0) 00010000:00010000:2.0:1789049501.207871:0:3294:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6714a00/0xf4f48ce5e1bbf533 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049501.207879:0:3294:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6714a00/0xf4f48ce5e1bbf533 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789049501.207886:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.26@tcp, seq: 106 00010000:00010000:2.0:1789049501.207905:0:3294:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8cb8ce751200) 00000100:00100000:1.0:1789049501.207905:0:5852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8df4d2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e823b53a-3591-475c-8624-c682227e5c13+54:10527:x1875954089643008:12345-192.168.206.26@tcp:101:bash.0 00010000:00010000:2.0:1789049501.207908:0:3294:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789049501.207914:0:3294:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6714a00/0xf4f48ce5e1bbf533 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049501.207919:0:3294:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6714a00/0xf4f48ce5e1bbf533 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049501.207928:0:5852:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789049501.207944:0:5852:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c2200/0xf4f48ce5e1bbf53a lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7fc5e358805a34da expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049501.208030:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c2e00/0xf4f48ce5e1bbf541 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049501.208043:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c2e00/0xf4f48ce5e1bbf541 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049501.208053:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c2e00/0xf4f48ce5e1bbf541 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789049501.208085:0:5852:0:(mdt_handler.c:922:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:1.0:1789049501.208090:0:5852:0:(mdt_handler.c:1587:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1789049501.208110:0:5852:0:(mdt_handler.c:2522:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c2e00/0xf4f48ce5e1bbf541 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049501.208138:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c2200/0xf4f48ce5e1bbf53a lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a34da expref: 55 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049501.208153:0:5852:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c2e00/0xf4f48ce5e1bbf541 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a34da expref: 54 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049501.208172:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8cb8ce751200) 00010000:00010000:1.0:1789049501.208174:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789049501.208177:0:5852:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cb8c28c2e00, rc 0) 00000100:00100000:1.0:1789049501.213143:0:5852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8df4d2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e823b53a-3591-475c-8624-c682227e5c13+54:10527:x1875954089643008:12345-192.168.206.26@tcp:101:bash.0 Request processed in 5234us (5397us total) trans 0 rc 0/0 00000100:00100000:1.0:1789049501.213166:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.26@tcp, seq: 106 00000100:00100000:3.0:1789049501.218662:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.26@tcp (source: 12345-192.168.206.26@tcp) 00000100:00100000:1.0:1789049501.221059:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954089643264 00000100:00100000:1.0:1789049501.221071:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954089643264 00000100:00100000:1.0:1789049501.221225:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.26@tcp, seq: 29 00000100:00100000:1.0:1789049501.221236:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8df29aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e823b53a-3591-475c-8624-c682227e5c13+54:10527:x1875954089643264:12345-192.168.206.26@tcp:35:bash.0 00000100:00100000:1.0:1789049501.221471:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8df29aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e823b53a-3591-475c-8624-c682227e5c13+55:10527:x1875954089643264:12345-192.168.206.26@tcp:35:bash.0 Request processed in 236us (2818us total) trans 4294967399 rc 0/0 00000100:00100000:1.0:1789049501.221478:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.26@tcp, seq: 29 00000100:00100000:3.0:1789049501.293674:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.26@tcp (source: 12345-192.168.206.26@tcp) 00000100:00100000:1.0:1789049501.293966:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954089643392 00000100:00100000:1.0:1789049501.293975:0:5850:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954089643392 00000100:00100000:1.0:1789049501.294038:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.26@tcp, seq: 107 00000100:00100000:1.0:1789049501.294049:0:5850:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8df299500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e823b53a-3591-475c-8624-c682227e5c13+55:10533:x1875954089643392:12345-192.168.206.26@tcp:101:lfs.0 00010000:00010000:1.0:1789049501.294071:0:5850:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789049501.294090:0:5850:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c2200/0xf4f48ce5e1bbf548 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7fc5e358805a34e1 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049501.294153:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c2000/0xf4f48ce5e1bbf54f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049501.294180:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c2000/0xf4f48ce5e1bbf54f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049501.294208:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c2000/0xf4f48ce5e1bbf54f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789049501.294252:0:5850:0:(mdt_handler.c:922:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00000004:00200000:1.0:1789049501.294256:0:5850:0:(mdt_handler.c:1587:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1789049501.294272:0:5850:0:(mdt_handler.c:2522:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c2000/0xf4f48ce5e1bbf54f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049501.294296:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c2200/0xf4f48ce5e1bbf548 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a34e1 expref: 57 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049501.294313:0:5850:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c2000/0xf4f48ce5e1bbf54f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a34e1 expref: 56 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049501.294321:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8cb8c396df00) 00010000:00010000:1.0:1789049501.294324:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1789049501.294327:0:5850:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cb8c28c2000, rc 0) 00000100:00100000:1.0:1789049501.294397:0:5850:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8df299500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e823b53a-3591-475c-8624-c682227e5c13+56:10533:x1875954089643392:12345-192.168.206.26@tcp:101:lfs.0 Request processed in 350us (732us total) trans 0 rc 0/0 00000100:00100000:1.0:1789049501.294405:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.26@tcp, seq: 107 00000100:00100000:2.0:1789049501.298228:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.26@tcp (source: 12345-192.168.206.26@tcp) 00000100:00100000:1.0:1789049501.298493:0:6841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954089643520 00000100:00100000:1.0:1789049501.298512:0:6841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954089643520 00000100:00100000:1.0:1789049501.298566:0:6841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.26@tcp, seq: 108 00000100:00100000:1.0:1789049501.298576:0:6841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8df263b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e823b53a-3591-475c-8624-c682227e5c13+56:10533:x1875954089643520:12345-192.168.206.26@tcp:101:lfs.0 00010000:00010000:1.0:1789049501.298595:0:6841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789049501.298614:0:6841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c3e00/0xf4f48ce5e1bbf556 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7fc5e358805a34e8 expref: -99 pid: 6841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049501.298692:0:6841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c3000/0xf4f48ce5e1bbf55d lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049501.298706:0:6841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c3000/0xf4f48ce5e1bbf55d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049501.298716:0:6841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c3000/0xf4f48ce5e1bbf55d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049501.298743:0:6841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c2400/0xf4f48ce5e1bbf564 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049501.298749:0:6841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c2400/0xf4f48ce5e1bbf564 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049501.298755:0:6841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c2400/0xf4f48ce5e1bbf564 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049501.298828:0:6841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c3a00/0xf4f48ce5e1bbf56b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049501.298835:0:6841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c3a00/0xf4f48ce5e1bbf56b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049501.298880:0:6841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c3a00/0xf4f48ce5e1bbf56b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6841 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789049501.298924:0:6841:0:(mdt_handler.c:922:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:1.0:1789049501.298928:0:6841:0:(mdt_handler.c:1587:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1789049501.298946:0:6841:0:(mdt_handler.c:2522:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c3a00/0xf4f48ce5e1bbf56b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049501.298969:0:6841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c3a00/0xf4f48ce5e1bbf56b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049501.298977:0:6841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c3000/0xf4f48ce5e1bbf55d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049501.298983:0:6841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c3000/0xf4f48ce5e1bbf55d lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049501.298989:0:6841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c3000/0xf4f48ce5e1bbf55d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049501.298994:0:6841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cb8c28c3000 already unused, calling callback (ffffffffc20ca4f0) 00010000:00010000:1.0:1789049501.298998:0:6841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c3000/0xf4f48ce5e1bbf55d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049501.299006:0:6841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c3000/0xf4f48ce5e1bbf55d lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049501.299017:0:6841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8cb8c396df00) 00010000:00010000:1.0:1789049501.299020:0:6841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789049501.299024:0:6841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c3000/0xf4f48ce5e1bbf55d lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049501.299030:0:6841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c3000/0xf4f48ce5e1bbf55d lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049501.299041:0:6841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c2400/0xf4f48ce5e1bbf564 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049501.299048:0:6841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c2400/0xf4f48ce5e1bbf564 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049501.299059:0:6841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c2400/0xf4f48ce5e1bbf564 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049501.299064:0:6841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cb8c28c2400 already unused, calling callback (ffffffffc20ca4f0) 00010000:00010000:1.0:1789049501.299067:0:6841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c2400/0xf4f48ce5e1bbf564 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049501.299073:0:6841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c2400/0xf4f48ce5e1bbf564 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049501.299080:0:6841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8cb8c396dc00) 00010000:00010000:1.0:1789049501.299082:0:6841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789049501.299085:0:6841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c2400/0xf4f48ce5e1bbf564 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049501.299090:0:6841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c2400/0xf4f48ce5e1bbf564 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049501.299131:0:6841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c3e00/0xf4f48ce5e1bbf556 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a34e8 expref: 58 pid: 6841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049501.299142:0:6841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c3a00/0xf4f48ce5e1bbf56b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a34e8 expref: 57 pid: 6841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049501.299148:0:6841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8cb8ce751200) 00010000:00010000:1.0:1789049501.299150:0:6841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789049501.299152:0:6841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cb8c28c3a00, rc 0) 00000100:00100000:1.0:1789049501.299735:0:6841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8df263b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e823b53a-3591-475c-8624-c682227e5c13+57:10533:x1875954089643520:12345-192.168.206.26@tcp:101:lfs.0 Request processed in 1159us (1515us total) trans 0 rc 0/0 00000100:00100000:1.0:1789049501.299753:0:6841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.26@tcp, seq: 108 00000100:00100000:0.0:1789049501.305117:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.26@tcp (source: 12345-192.168.206.26@tcp) 00000100:00100000:1.0:1789049501.305287:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954089643776 00000100:00100000:1.0:1789049501.305297:0:5850:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954089643776 00000100:00100000:1.0:1789049501.305354:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.26@tcp, seq: 109 00000100:00100000:1.0:1789049501.305363:0:5850:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8df4d3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e823b53a-3591-475c-8624-c682227e5c13+57:10533:x1875954089643776:12345-192.168.206.26@tcp:101:lfs.0 00010000:00010000:1.0:1789049501.305394:0:5850:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789049501.305414:0:5850:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c2200/0xf4f48ce5e1bbf572 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7fc5e358805a34ef expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049501.305523:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c3600/0xf4f48ce5e1bbf579 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049501.305540:0:5850:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c2e00/0xf4f48ce5e1bbf541 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a34da expref: 58 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049501.305549:0:5850:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c3a00/0xf4f48ce5e1bbf56b lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a34e8 expref: 58 pid: 6841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049501.305557:0:5850:0:(ldlm_resource.c:1751:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c3600/0xf4f48ce5e1bbf579 lrc: 5/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049501.305589:0:5850:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c3a00/0xf4f48ce5e1bbf56b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a34e8 expref: 58 pid: 6841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049501.305603:0:5850:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c3a00/0xf4f48ce5e1bbf56b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a34e8 expref: 58 pid: 6841 timeout: 427 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789049501.305617:0:5850:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb8df20bb80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5850:1875954110627840:192.168.206.26@tcp:104: 00010000:00010000:1.0:1789049501.305738:0:5850:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c2e00/0xf4f48ce5e1bbf541 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a34da expref: 58 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049501.305748:0:5850:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c2e00/0xf4f48ce5e1bbf541 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a34da expref: 58 pid: 5852 timeout: 427 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789049501.305756:0:5850:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb8df208380 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5850:1875954110627968:192.168.206.26@tcp:104: 00000100:00100000:1.0:1789049501.305776:0:5850:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cb8c79e0840 going to sleep for 11 seconds 00000100:00100000:0.0:1789049501.309803:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.26@tcp (source: 12345-192.168.206.26@tcp) 00000100:00100000:3.0:1789049501.310091:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954089643904 00000100:00100000:3.0:1789049501.310112:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954089643904 00010000:00010000:3.0:1789049501.310166:0:5837:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c3a00/0xf4f48ce5e1bbf56b lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a34e8 expref: 59 pid: 6841 timeout: 427 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789049501.310215:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.26@tcp, seq: 52 00000100:00100000:3.0:1789049501.310225:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8df4d0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e823b53a-3591-475c-8624-c682227e5c13+59:2358:x1875954089643904:12345-192.168.206.26@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789049501.310250:0:5837:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789049501.310260:0:5837:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c3a00/0xf4f48ce5e1bbf56b lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a34e8 expref: 59 pid: 6841 timeout: 427 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049501.310273:0:5837:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c3a00/0xf4f48ce5e1bbf56b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a34e8 expref: 59 pid: 6841 timeout: 427 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049501.310294:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8cb8ce751200) 00010000:00010000:3.0:1789049501.310299:0:5837:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c3600/0xf4f48ce5e1bbf579 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049501.310309:0:5837:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c3600/0xf4f48ce5e1bbf579 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049501.310315:0:5837:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789049501.310376:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8df4d0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e823b53a-3591-475c-8624-c682227e5c13+59:2358:x1875954089643904:12345-192.168.206.26@tcp:103:ldlm_bl.0 Request processed in 144us (575us total) trans 0 rc 0/0 00000100:00100000:3.0:1789049501.310384:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.26@tcp, seq: 52 00010000:00010000:1.0:1789049501.312268:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c3a00/0xf4f48ce5e1bbf56b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a34e8 expref: 58 pid: 6841 timeout: 427 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789049501.312293:0:5850:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb8df20bb80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5850:1875954110627840:192.168.206.26@tcp:104: 00000100:00100000:2.0:1789049501.316005:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.26@tcp (source: 12345-192.168.206.26@tcp) 00000100:00100000:1.0:1789049501.316128:0:5850:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb8df208380 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5850:1875954110627968:192.168.206.26@tcp:104: 00010000:00010000:1.0:1789049501.316167:0:5850:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c3600/0xf4f48ce5e1bbf579 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789049501.316230:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954089644032 00000100:00100000:3.0:1789049501.316237:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954089644032 00010000:00010000:3.0:1789049501.316282:0:5835:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c2e00/0xf4f48ce5e1bbf541 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a34da expref: 58 pid: 5852 timeout: 427 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789049501.316326:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.26@tcp, seq: 53 00000100:00100000:3.0:1789049501.316335:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8df260380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e823b53a-3591-475c-8624-c682227e5c13+58:2358:x1875954089644032:12345-192.168.206.26@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789049501.316349:0:5835:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789049501.316356:0:5835:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c2e00/0xf4f48ce5e1bbf541 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a34da expref: 58 pid: 5852 timeout: 427 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049501.316378:0:5835:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c2e00/0xf4f48ce5e1bbf541 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a34da expref: 58 pid: 5852 timeout: 427 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049501.316400:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c2e00/0xf4f48ce5e1bbf541 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a34da expref: 58 pid: 5852 timeout: 427 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049501.316416:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8cb8ce751200) 00010000:00010000:3.0:1789049501.316420:0:5835:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c3600/0xf4f48ce5e1bbf579 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049501.316430:0:5835:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c3600/0xf4f48ce5e1bbf579 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049501.316439:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c3600/0xf4f48ce5e1bbf579 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049501.316466:0:5835:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789049501.316517:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8df260380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e823b53a-3591-475c-8624-c682227e5c13+57:2358:x1875954089644032:12345-192.168.206.26@tcp:103:ldlm_bl.0 Request processed in 182us (521us total) trans 0 rc 0/0 00000100:00100000:3.0:1789049501.316525:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.26@tcp, seq: 53 00010000:00010000:1.0:1789049501.316572:0:5850:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c3600/0xf4f48ce5e1bbf579 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049501.316579:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c3600/0xf4f48ce5e1bbf579 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789049501.316599:0:5850:0:(mdt_handler.c:922:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:1.0:1789049501.316742:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c2200/0xf4f48ce5e1bbf572 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a34ef expref: 58 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049501.316756:0:5850:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c3600/0xf4f48ce5e1bbf579 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a34ef expref: 57 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049501.316775:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8cb8ce751200) 00010000:00010000:1.0:1789049501.316778:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1789049501.316781:0:5850:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cb8c28c3600, rc 0) 00000100:00100000:1.0:1789049501.316806:0:5850:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8df4d3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e823b53a-3591-475c-8624-c682227e5c13+57:10533:x1875954089643776:12345-192.168.206.26@tcp:101:lfs.0 Request processed in 11444us (11708us total) trans 4294967400 rc 0/0 00000100:00100000:1.0:1789049501.316812:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.26@tcp, seq: 109 00000100:00100000:0.0:1789049501.322654:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.26@tcp (source: 12345-192.168.206.26@tcp) 00000100:00100000:3.0:1789049501.322732:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954089644288 00000100:00100000:3.0:1789049501.322754:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954089644288 00000100:00100000:3.0:1789049501.322819:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.26@tcp, seq: 7 00000100:00100000:3.0:1789049501.322829:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8df4d2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e823b53a-3591-475c-8624-c682227e5c13+57:10533:x1875954089644288:12345-192.168.206.26@tcp:103:lfs.0 00010000:00010000:3.0:1789049501.322890:0:5837:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789049501.322925:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb7c4c38c00/0xf4f48ce5e1bbf4d8 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a34c5 expref: 57 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049501.322944:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8cb8ce751200) 00010000:00010000:3.0:1789049501.322948:0:5837:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789049501.322996:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8df4d2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e823b53a-3591-475c-8624-c682227e5c13+56:10533:x1875954089644288:12345-192.168.206.26@tcp:103:lfs.0 Request processed in 169us (351us total) trans 0 rc 0/0 00000100:00100000:3.0:1789049501.323003:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.26@tcp, seq: 7 00000100:00100000:2.0:1789049501.327190:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.26@tcp (source: 12345-192.168.206.26@tcp) 00000100:00100000:1.0:1789049501.327269:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954089644416 00000100:00100000:1.0:1789049501.327278:0:5852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954089644416 00000100:00100000:1.0:1789049501.327335:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.26@tcp, seq: 110 00000100:00100000:1.0:1789049501.327345:0:5852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8df262300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e823b53a-3591-475c-8624-c682227e5c13+56:10533:x1875954089644416:12345-192.168.206.26@tcp:58:lfs.0 00010000:00010000:1.0:1789049501.327461:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c2200/0xf4f48ce5e1bbf587 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049501.327477:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c2200/0xf4f48ce5e1bbf587 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049501.327489:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c2200/0xf4f48ce5e1bbf587 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1789049501.327683:0:5852:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].2, 136 off8464 00000100:00100000:1.0:1789049501.327767:0:5852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8df262300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e823b53a-3591-475c-8624-c682227e5c13+56:10533:x1875954089644416:12345-192.168.206.26@tcp:58:lfs.0 Request processed in 423us (586us total) trans 0 rc 0/0 00000100:00100000:1.0:1789049501.327776:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.26@tcp, seq: 110 00000100:00100000:0.0:1789049501.331344:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.26@tcp (source: 12345-192.168.206.26@tcp) 00000100:00100000:2.0:1789049501.331446:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954089644544 00000100:00100000:2.0:1789049501.331456:0:5851:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954089644544 00000100:00100000:2.0:1789049501.331504:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.26@tcp, seq: 111 00000100:00100000:2.0:1789049501.331513:0:5851:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8df4d2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e823b53a-3591-475c-8624-c682227e5c13+56:10533:x1875954089644544:12345-192.168.206.26@tcp:101:lfs.0 00010000:00010000:2.0:1789049501.331532:0:5851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789049501.331566:0:5851:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6715800/0xf4f48ce5e1bbf58e lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7fc5e358805a34f6 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049501.331635:0:5851:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c2200/0xf4f48ce5e1bbf587 lrc: 2/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049501.331647:0:5851:0:(ldlm_resource.c:1751:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6715800/0xf4f48ce5e1bbf58e lrc: 4/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a34f6 expref: 57 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049501.331666:0:5851:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c2200/0xf4f48ce5e1bbf587 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049501.331680:0:5851:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6715800/0xf4f48ce5e1bbf58e lrc: 3/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a34f6 expref: 57 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049501.331693:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8cb8ce751200) 00010000:00010000:2.0:1789049501.331697:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1789049501.331701:0:5851:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6715800/0xf4f48ce5e1bbf58e lrc: 3/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a34f6 expref: 57 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049501.331709:0:5851:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cb8d6715800, rc 0) 00000100:00100000:2.0:1789049501.331766:0:5851:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8df4d2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e823b53a-3591-475c-8624-c682227e5c13+57:10533:x1875954089644544:12345-192.168.206.26@tcp:101:lfs.0 Request processed in 253us (431us total) trans 0 rc 0/0 00000100:00100000:2.0:1789049501.331773:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.26@tcp, seq: 111 00010000:00010000:2.0:1789049501.403622:0:6719:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1789049501.660454:0:11704:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1789049501.660464:0:11704:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1789049501.660506:0:11704:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 3 count 3 00000040:00080000:0.0:1789049501.660514:0:11704:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1789049501.660657:0:11704:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb8df4d3480 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11704:1875954110628096:192.168.206.26@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1789049501.660772:0:11704:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cb8c6b2ac00 going to sleep for 11 seconds 00000100:00100000:0.0:1789049501.670726:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.26@tcp (source: 12345-192.168.206.26@tcp) 00000100:00100000:1.0:1789049501.670823:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954089644672 00000100:00100000:1.0:1789049501.670833:0:5852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954089644672 00000100:00100000:1.0:1789049501.670945:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.26@tcp, seq: 112 00000100:00100000:1.0:1789049501.670956:0:5852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8df4d1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e823b53a-3591-475c-8624-c682227e5c13+58:10534:x1875954089644672:12345-192.168.206.26@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1789049501.671025:0:5852:0:(mdt_handler.c:7990:mdt_fid2path()) path get [0x200000401:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1789049501.671119:0:5852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8df4d1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e823b53a-3591-475c-8624-c682227e5c13+58:10534:x1875954089644672:12345-192.168.206.26@tcp:53:lhsmtool_posix.0 Request processed in 163us (402us total) trans 0 rc 0/0 00000100:00100000:1.0:1789049501.671126:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.26@tcp, seq: 112 00000100:00100000:3.0:1789049501.675980:0:11704:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb8df4d3480 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11704:1875954110628096:192.168.206.26@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1789049501.683281:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.26@tcp (source: 12345-192.168.206.26@tcp) 00000100:00100000:0.0:1789049501.683917:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954089644800 00000100:00100000:0.0:1789049501.684070:0:5851:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954089644800 00000100:00100000:0.0:1789049501.684142:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.26@tcp, seq: 113 00000100:00100000:0.0:1789049501.684216:0:5851:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8df262a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e823b53a-3591-475c-8624-c682227e5c13+57:10534:x1875954089644800:12345-192.168.206.26@tcp:34:lhsmtool_posix.0 00010000:00010000:0.0:1789049501.684353:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb7c4c38c00/0xf4f48ce5e1bbf595 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049501.684507:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cb7c4c38c00/0xf4f48ce5e1bbf595 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049501.684521:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb7c4c38c00/0xf4f48ce5e1bbf595 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049501.684586:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb7c4c39a00/0xf4f48ce5e1bbf59c lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049501.684594:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cb7c4c39a00/0xf4f48ce5e1bbf59c lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049501.684601:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb7c4c39a00/0xf4f48ce5e1bbf59c lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049501.684623:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb7c4c38e00/0xf4f48ce5e1bbf5a3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049501.684632:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cb7c4c38e00/0xf4f48ce5e1bbf5a3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049501.684639:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb7c4c38e00/0xf4f48ce5e1bbf5a3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789049501.684703:0:5851:0:(mdt_handler.c:922:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:0.0:1789049501.684708:0:5851:0:(mdt_handler.c:1587:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1789049501.684721:0:5851:0:(mdt_handler.c:2522:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8cb7c4c38e00/0xf4f48ce5e1bbf5a3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049501.684731:0:5851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb7c4c38c00/0xf4f48ce5e1bbf595 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049501.684738:0:5851:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cb7c4c38c00/0xf4f48ce5e1bbf595 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049501.684744:0:5851:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cb7c4c38c00/0xf4f48ce5e1bbf595 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049501.684751:0:5851:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cb7c4c38c00 already unused, calling callback (ffffffffc20ca4f0) 00010000:00010000:0.0:1789049501.684755:0:5851:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb7c4c38c00/0xf4f48ce5e1bbf595 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049501.684762:0:5851:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb7c4c38c00/0xf4f48ce5e1bbf595 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049501.684773:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8cb8e0130a00) 00010000:00010000:0.0:1789049501.684776:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789049501.684781:0:5851:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cb7c4c38c00/0xf4f48ce5e1bbf595 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049501.684786:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb7c4c38c00/0xf4f48ce5e1bbf595 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049501.684798:0:5851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb7c4c39a00/0xf4f48ce5e1bbf59c lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049501.684815:0:5851:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cb7c4c39a00/0xf4f48ce5e1bbf59c lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049501.684821:0:5851:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cb7c4c39a00/0xf4f48ce5e1bbf59c lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049501.684826:0:5851:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cb7c4c39a00 already unused, calling callback (ffffffffc20ca4f0) 00010000:00010000:0.0:1789049501.684829:0:5851:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb7c4c39a00/0xf4f48ce5e1bbf59c lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049501.684835:0:5851:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb7c4c39a00/0xf4f48ce5e1bbf59c lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049501.686755:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x77a79f1b (ffff8cb8ce751e00) 00010000:00010000:0.0:1789049501.686765:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789049501.686773:0:5851:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cb7c4c39a00/0xf4f48ce5e1bbf59c lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049501.686783:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb7c4c39a00/0xf4f48ce5e1bbf59c lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049501.686813:0:5851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb7c4c38e00/0xf4f48ce5e1bbf5a3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049501.686820:0:5851:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cb7c4c38e00/0xf4f48ce5e1bbf5a3 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049501.686826:0:5851:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cb7c4c38e00/0xf4f48ce5e1bbf5a3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049501.686833:0:5851:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cb7c4c38e00 already unused, calling callback (ffffffffc20ca4f0) 00010000:00010000:0.0:1789049501.686869:0:5851:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb7c4c38e00/0xf4f48ce5e1bbf5a3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049501.686886:0:5851:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb7c4c38e00/0xf4f48ce5e1bbf5a3 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049501.686908:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8cb8ce751200) 00010000:00010000:0.0:1789049501.686910:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789049501.686913:0:5851:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cb7c4c38e00/0xf4f48ce5e1bbf5a3 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049501.686919:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb7c4c38e00/0xf4f48ce5e1bbf5a3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789049501.687026:0:5851:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8df262a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e823b53a-3591-475c-8624-c682227e5c13+57:10534:x1875954089644800:12345-192.168.206.26@tcp:34:lhsmtool_posix.0 Request processed in 2871us (3750us total) trans 0 rc 0/0 00000100:00100000:0.0:1789049501.687036:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.26@tcp, seq: 113 00000100:00100000:0.0:1789049501.706903:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.26@tcp (source: 12345-192.168.206.26@tcp) 00000100:00100000:1.0:1789049501.707019:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954089645056 00000100:00100000:1.0:1789049501.707029:0:5852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954089645056 00000100:00100000:1.0:1789049501.707099:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.26@tcp, seq: 114 00000100:00100000:1.0:1789049501.707109:0:5852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8df4d0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e823b53a-3591-475c-8624-c682227e5c13+57:10534:x1875954089645056:12345-192.168.206.26@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1789049501.707131:0:5852:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789049501.707151:0:5852:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c3a00/0xf4f48ce5e1bbf5aa lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7fc5e358805a34fd expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049501.707243:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c3e00/0xf4f48ce5e1bbf5b1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049501.707259:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c3e00/0xf4f48ce5e1bbf5b1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049501.707277:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c3e00/0xf4f48ce5e1bbf5b1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789049501.707289:0:5852:0:(mdt_handler.c:922:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:1.0:1789049501.707385:0:5852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c3e00/0xf4f48ce5e1bbf5b1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049501.707398:0:5852:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c3e00/0xf4f48ce5e1bbf5b1 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049501.707405:0:5852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c3e00/0xf4f48ce5e1bbf5b1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049501.707425:0:5852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cb8c28c3e00 already unused, calling callback (ffffffffc20ca4f0) 00010000:00010000:1.0:1789049501.707429:0:5852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c3e00/0xf4f48ce5e1bbf5b1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049501.707437:0:5852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c3e00/0xf4f48ce5e1bbf5b1 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049501.707448:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8cb8ce751200) 00010000:00010000:1.0:1789049501.707451:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1789049501.707456:0:5852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c3e00/0xf4f48ce5e1bbf5b1 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049501.707462:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c3e00/0xf4f48ce5e1bbf5b1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049501.707637:0:5852:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c3a00/0xf4f48ce5e1bbf5aa lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a34fd expref: 59 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049501.707647:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8cb8e0130a00) 00010000:00010000:1.0:1789049501.707650:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1789049501.707654:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c3a00/0xf4f48ce5e1bbf5aa lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a34fd expref: 59 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049501.707663:0:5852:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cb8c28c3a00, rc 0) 00000100:00100000:1.0:1789049501.707778:0:5852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8df4d0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e823b53a-3591-475c-8624-c682227e5c13+58:10534:x1875954089645056:12345-192.168.206.26@tcp:101:lhsmtool_posix.0 Request processed in 670us (893us total) trans 4294967401 rc 301/301 00000100:00100000:1.0:1789049501.707787:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.26@tcp, seq: 114 00000100:00100000:2.0:1789049501.714980:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.26@tcp (source: 12345-192.168.206.26@tcp) 00000100:00100000:1.0:1789049501.715113:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954089645184 00000100:00100000:1.0:1789049501.715138:0:5850:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954089645184 00000100:00100000:1.0:1789049501.715199:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.26@tcp, seq: 115 00000100:00100000:1.0:1789049501.715210:0:5850:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8df263480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e823b53a-3591-475c-8624-c682227e5c13+58:10534:x1875954089645184:12345-192.168.206.26@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1789049501.715244:0:5850:0:(mdt_handler.c:7990:mdt_fid2path()) path get [0x200000401:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1789049501.715543:0:5850:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8df263480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e823b53a-3591-475c-8624-c682227e5c13+58:10534:x1875954089645184:12345-192.168.206.26@tcp:53:lhsmtool_posix.0 Request processed in 334us (573us total) trans 0 rc 0/0 00000100:00100000:1.0:1789049501.715552:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.26@tcp, seq: 115 00000100:00100000:1.0:1789049501.723016:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.26@tcp (source: 12345-192.168.206.26@tcp) 00000100:00100000:2.0:1789049501.723805:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954089645440 00000100:00100000:2.0:1789049501.723816:0:5852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954089645440 00000100:00100000:2.0:1789049501.724026:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.26@tcp, seq: 116 00000100:00100000:2.0:1789049501.724038:0:5852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8df208380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e823b53a-3591-475c-8624-c682227e5c13+58:10534:x1875954089645440:12345-192.168.206.26@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789049501.724061:0:5852:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789049501.724064:0:5852:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1789049501.724100:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c2000/0xf4f48ce5e1bbf54f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a34e1 expref: 58 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049501.724119:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8cb8c396df00) 00010000:00010000:2.0:1789049501.724124:0:5852:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789049501.724136:0:5852:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6715a00/0xf4f48ce5e1bbf5bf lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7fc5e358805a3504 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1789049501.725226:0:5852:0:(osp_object.c:1667:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x4:0x0], index 0: 0 00010000:00010000:2.0:1789049501.725445:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6714c00/0xf4f48ce5e1bbf5c6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049501.725460:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6714c00/0xf4f48ce5e1bbf5c6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049501.725471:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6714c00/0xf4f48ce5e1bbf5c6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049501.725730:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6715a00/0xf4f48ce5e1bbf5bf lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a3504 expref: 60 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049501.725748:0:5852:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6714c00/0xf4f48ce5e1bbf5c6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a3504 expref: 59 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049501.725756:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff8cb8e0130400) 00010000:00010000:2.0:1789049501.725771:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789049501.725774:0:5852:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cb8d6714c00, rc 0) 00000100:00100000:2.0:1789049501.725937:0:5852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8df208380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e823b53a-3591-475c-8624-c682227e5c13+59:10534:x1875954089645440:12345-192.168.206.26@tcp:101:lhsmtool_posix.0 Request processed in 1901us (2930us total) trans 4294967402 rc 0/0 00000100:00100000:2.0:1789049501.725946:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.26@tcp, seq: 116 00000100:00100000:1.0:1789049501.731607:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.26@tcp (source: 12345-192.168.206.26@tcp) 00000100:00100000:0.0:1789049501.731936:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954089645696 00000100:00100000:0.0:1789049501.731946:0:5851:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954089645696 00000100:00100000:0.0:1789049501.732001:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.26@tcp, seq: 117 00000100:00100000:0.0:1789049501.732020:0:5851:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8df20bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e823b53a-3591-475c-8624-c682227e5c13+59:10534:x1875954089645696:12345-192.168.206.26@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1789049501.732073:0:5851:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789049501.732110:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6714c00/0xf4f48ce5e1bbf5c6 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a3504 expref: 59 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049501.732130:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff8cb8e0130400) 00010000:00010000:0.0:1789049501.732140:0:5851:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789049501.733051:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb7c4c38e00/0xf4f48ce5e1bbf5d4 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049501.733087:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cb7c4c38e00/0xf4f48ce5e1bbf5d4 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049501.733332:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb7c4c38e00/0xf4f48ce5e1bbf5d4 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049501.733554:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c3e00/0xf4f48ce5e1bbf5db lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x90a01913 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049501.733564:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c3e00/0xf4f48ce5e1bbf5db lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x90a01913 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049501.733572:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c3e00/0xf4f48ce5e1bbf5db lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x90a01913 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049501.733638:0:5851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb7c4c38e00/0xf4f48ce5e1bbf5d4 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049501.733646:0:5851:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cb7c4c38e00/0xf4f48ce5e1bbf5d4 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049501.733652:0:5851:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cb7c4c38e00/0xf4f48ce5e1bbf5d4 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049501.733658:0:5851:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cb7c4c38e00 already unused, calling callback (ffffffffc20ca4f0) 00010000:00010000:1.0:1789049501.733662:0:5851:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb7c4c38e00/0xf4f48ce5e1bbf5d4 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049501.733680:0:5851:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb7c4c38e00/0xf4f48ce5e1bbf5d4 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049501.733690:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8cb8c396df00) 00010000:00010000:1.0:1789049501.733692:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789049501.733696:0:5851:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cb7c4c38e00/0xf4f48ce5e1bbf5d4 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049501.733702:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb7c4c38e00/0xf4f48ce5e1bbf5d4 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049501.733714:0:5851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c3e00/0xf4f48ce5e1bbf5db lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x90a01913 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049501.733720:0:5851:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c3e00/0xf4f48ce5e1bbf5db lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x90a01913 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049501.733726:0:5851:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c3e00/0xf4f48ce5e1bbf5db lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x90a01913 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049501.733730:0:5851:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cb8c28c3e00 already unused, calling callback (ffffffffc20ca4f0) 00010000:00010000:1.0:1789049501.733733:0:5851:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c3e00/0xf4f48ce5e1bbf5db lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x90a01913 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049501.733738:0:5851:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c3e00/0xf4f48ce5e1bbf5db lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x90a01913 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049501.733744:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x90a01913 (ffff8cb8c396dc00) 00010000:00010000:1.0:1789049501.733747:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789049501.733750:0:5851:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c3e00/0xf4f48ce5e1bbf5db lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x90a01913 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049501.733764:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c3e00/0xf4f48ce5e1bbf5db lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x90a01913 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789049501.733904:0:5851:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8df20bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e823b53a-3591-475c-8624-c682227e5c13+58:10534:x1875954089645696:12345-192.168.206.26@tcp:36:lhsmtool_posix.0 Request processed in 1879us (2291us total) trans 0 rc -2/-2 00000100:00100000:1.0:1789049501.733913:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.26@tcp, seq: 117 00000100:00100000:1.0:1789049501.741272:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.26@tcp (source: 12345-192.168.206.26@tcp) 00000100:00100000:2.0:1789049501.741711:0:6841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954089645824 00000100:00100000:2.0:1789049501.741721:0:6841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954089645824 00000100:00100000:2.0:1789049501.741780:0:6841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.26@tcp, seq: 118 00000100:00100000:2.0:1789049501.741791:0:6841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8df20a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e823b53a-3591-475c-8624-c682227e5c13+58:10534:x1875954089645824:12345-192.168.206.26@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789049501.741811:0:6841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789049501.742038:0:6841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6715a00/0xf4f48ce5e1bbf5e2 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7fc5e358805a350b expref: -99 pid: 6841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049501.742076:0:6841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6715200/0xf4f48ce5e1bbf5e9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049501.742090:0:6841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6715200/0xf4f48ce5e1bbf5e9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049501.742101:0:6841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6715200/0xf4f48ce5e1bbf5e9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049501.742192:0:6841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6715a00/0xf4f48ce5e1bbf5e2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a350b expref: 60 pid: 6841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049501.742210:0:6841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6715200/0xf4f48ce5e1bbf5e9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a350b expref: 59 pid: 6841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049501.742218:0:6841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff8cb8e0130b00) 00010000:00010000:2.0:1789049501.742226:0:6841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1789049501.742230:0:6841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cb8d6715200, rc 0) 00000100:00100000:2.0:1789049501.742324:0:6841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8df20a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e823b53a-3591-475c-8624-c682227e5c13+59:10534:x1875954089645824:12345-192.168.206.26@tcp:101:lhsmtool_posix.0 Request processed in 533us (1059us total) trans 0 rc 0/0 00000100:00100000:2.0:1789049501.742331:0:6841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.26@tcp, seq: 118 00000100:00100000:2.0:1789049501.757330:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.26@tcp (source: 12345-192.168.206.26@tcp) 00000100:00100000:1.0:1789049501.757426:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954089646080 00000100:00100000:1.0:1789049501.757436:0:5850:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954089646080 00000100:00100000:1.0:1789049501.757493:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.26@tcp, seq: 119 00000100:00100000:1.0:1789049501.757503:0:5850:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8df261c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e823b53a-3591-475c-8624-c682227e5c13+59:10534:x1875954089646080:12345-192.168.206.26@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1789049501.757578:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c3e00/0xf4f48ce5e1bbf5f0 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049501.757593:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c3e00/0xf4f48ce5e1bbf5f0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049501.757605:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c3e00/0xf4f48ce5e1bbf5f0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1789049501.757831:0:5850:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].5, 88 off8560 00000004:00080000:1.0:1789049501.757890:0:5850:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 327810045664ns, next at 328810042655ns, rc = 0 00000004:00010000:1.0:1789049501.757981:0:5850:0:(mdt_handler.c:4507:mdt_save_lock()) ### save lock request 00000000f48988d3 reply state 00000000e355656d transno 4294967403 ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c3e00/0xf4f48ce5e1bbf5f0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789049501.757991:0:5850:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1789049501.758090:0:5850:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8df261c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e823b53a-3591-475c-8624-c682227e5c13+61:10534:x1875954089646080:12345-192.168.206.26@tcp:36:lhsmtool_posix.0 Request processed in 587us (768us total) trans 4294967403 rc 0/0 00000100:00100000:1.0:1789049501.758114:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.26@tcp, seq: 119 00010000:00010000:0.0:1789049501.760742:0:3295:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c3e00/0xf4f48ce5e1bbf5f0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049501.760757:0:3295:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c3e00/0xf4f48ce5e1bbf5f0 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049501.760764:0:3295:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c3e00/0xf4f48ce5e1bbf5f0 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049501.760770:0:3295:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cb8c28c3e00 already unused, calling callback (ffffffffc20ca4f0) 00010000:00010000:0.0:1789049501.760774:0:3295:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c3e00/0xf4f48ce5e1bbf5f0 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049501.760781:0:3295:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c3e00/0xf4f48ce5e1bbf5f0 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049501.760796:0:3295:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff8cb8e0130b00) 00010000:00010000:0.0:1789049501.760799:0:3295:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1789049501.760802:0:3295:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c3e00/0xf4f48ce5e1bbf5f0 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049501.760808:0:3295:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c3e00/0xf4f48ce5e1bbf5f0 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789049501.761813:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.26@tcp (source: 12345-192.168.206.26@tcp) 00000100:00100000:1.0:1789049501.761973:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954089646208 00000100:00100000:1.0:1789049501.761982:0:5852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954089646208 00000100:00100000:1.0:1789049501.762040:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.26@tcp, seq: 120 00000100:00100000:1.0:1789049501.762050:0:5852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8df262680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e823b53a-3591-475c-8624-c682227e5c13+60:10534:x1875954089646208:12345-192.168.206.26@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1789049501.762074:0:5852:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789049501.762091:0:5852:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c3a00/0xf4f48ce5e1bbf5f7 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7fc5e358805a3512 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049501.762155:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c3a00/0xf4f48ce5e1bbf5f7 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a3512 expref: 61 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049501.762170:0:5852:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c3a00/0xf4f48ce5e1bbf5f7 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a3512 expref: 61 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049501.762189:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff8cb8e0130b00) 00010000:00010000:1.0:1789049501.762192:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1789049501.762195:0:5852:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cb8c28c3a00, rc 0) 00000100:00100000:1.0:1789049501.762257:0:5852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8df262680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e823b53a-3591-475c-8624-c682227e5c13+61:10534:x1875954089646208:12345-192.168.206.26@tcp:101:lhsmtool_posix.0 Request processed in 209us (452us total) trans 0 rc 0/0 00000100:00100000:1.0:1789049501.762265:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.26@tcp, seq: 120 00000100:00100000:1.0:1789049501.766729:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.26@tcp (source: 12345-192.168.206.26@tcp) 00000100:00100000:0.0:1789049501.766814:0:10560:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954089646336 00000100:00100000:0.0:1789049501.766872:0:10560:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954089646336 00000100:00100000:0.0:1789049501.766949:0:10560:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.26@tcp, seq: 37 00000100:00100000:0.0:1789049501.766960:0:10560:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8df20aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e823b53a-3591-475c-8624-c682227e5c13+8:2358:x1875954089646336:12345-192.168.206.26@tcp:2:lhsmtool_posix.0 00000100:00100000:0.0:1789049501.767269:0:10560:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8df20aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e823b53a-3591-475c-8624-c682227e5c13+9:2358:x1875954089646336:12345-192.168.206.26@tcp:2:lhsmtool_posix.0 Request processed in 309us (546us total) trans 4294967307 rc 0/0 00000100:00100000:0.0:1789049501.767277:0:10560:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.26@tcp, seq: 37 00000100:00080000:2.0:1789049501.767499:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789049501.769910:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.26@tcp (source: 12345-192.168.206.26@tcp) 00000100:00100000:1.0:1789049501.770037:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954089646592 00000100:00100000:1.0:1789049501.770046:0:5853:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954089646592 00000100:00100000:1.0:1789049501.770104:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.26@tcp, seq: 30 00000100:00100000:1.0:1789049501.770113:0:5853:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8d0aadc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e823b53a-3591-475c-8624-c682227e5c13+61:10534:x1875954089646592:12345-192.168.206.26@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1789049501.770408:0:5853:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8d0aadc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e823b53a-3591-475c-8624-c682227e5c13+62:10534:x1875954089646592:12345-192.168.206.26@tcp:35:lhsmtool_posix.0 Request processed in 296us (515us total) trans 4294967404 rc 0/0 00000100:00100000:1.0:1789049501.770415:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.26@tcp, seq: 30 00000100:00100000:1.0:1789049501.772560:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.26@tcp (source: 12345-192.168.206.26@tcp) 00000100:00100000:2.0:1789049501.772663:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954089646848 00000100:00100000:2.0:1789049501.772672:0:5850:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954089646848 00000100:00100000:2.0:1789049501.772729:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.26@tcp, seq: 121 00000100:00100000:2.0:1789049501.772738:0:5850:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8df20b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e823b53a-3591-475c-8624-c682227e5c13+62:10534:x1875954089646848:12345-192.168.206.26@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1789049501.772889:0:5850:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8df20b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e823b53a-3591-475c-8624-c682227e5c13+62:10534:x1875954089646848:12345-192.168.206.26@tcp:57:lhsmtool_posix.0 Request processed in 151us (338us total) trans 0 rc 0/0 00000100:00100000:2.0:1789049501.772907:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.26@tcp, seq: 121 00000100:00100000:3.0:1789049501.776078:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.26@tcp (source: 12345-192.168.206.26@tcp) 00000100:00100000:1.0:1789049501.776268:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954089646976 00000100:00100000:1.0:1789049501.776278:0:5852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954089646976 00000100:00100000:1.0:1789049501.776340:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.26@tcp, seq: 122 00000100:00100000:1.0:1789049501.776350:0:5852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8d0aaf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e823b53a-3591-475c-8624-c682227e5c13+62:10534:x1875954089646976:12345-192.168.206.26@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1789049501.776368:0:5852:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789049501.776386:0:5852:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c3000/0xf4f48ce5e1bbf5fe lrc: 2/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7fc5e358805a3519 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049501.776451:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c2400/0xf4f48ce5e1bbf605 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049501.776465:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c2400/0xf4f48ce5e1bbf605 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049501.776477:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c2400/0xf4f48ce5e1bbf605 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789049501.776512:0:5852:0:(mdt_handler.c:1587:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1789049501.776530:0:5852:0:(mdt_handler.c:2522:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c2400/0xf4f48ce5e1bbf605 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049501.776558:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c3000/0xf4f48ce5e1bbf5fe lrc: 0/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a3519 expref: 64 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049501.776574:0:5852:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c2400/0xf4f48ce5e1bbf605 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a3519 expref: 63 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049501.776596:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff8cb8e0130b00) 00010000:00010000:1.0:1789049501.776599:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1789049501.776603:0:5852:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cb8c28c2400, rc 0) 00000100:00100000:1.0:1789049501.776663:0:5852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8d0aaf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e823b53a-3591-475c-8624-c682227e5c13+63:10534:x1875954089646976:12345-192.168.206.26@tcp:101:lhsmtool_posix.0 Request processed in 315us (593us total) trans 0 rc 0/0 00000100:00100000:1.0:1789049501.776670:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.26@tcp, seq: 122 00000100:00100000:3.0:1789049501.780392:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.26@tcp (source: 12345-192.168.206.26@tcp) 00000100:00100000:1.0:1789049501.780534:0:6703:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954089647104 00000100:00100000:1.0:1789049501.780544:0:6703:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954089647104 00000100:00100000:1.0:1789049501.780601:0:6703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.26@tcp, seq: 38 00000100:00100000:1.0:1789049501.780613:0:6703:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8d0aad500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e823b53a-3591-475c-8624-c682227e5c13+9:2357:x1875954089647104:12345-192.168.206.26@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1789049501.780634:0:6703:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789049501.780658:0:6703:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004f91907a/0xf4f48ce5e1bbf60c lrc: 2/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x7fc5e358805a3520 expref: -99 pid: 6703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1789049501.780687:0:6703:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x18d3fb0adc91b440, blocks: 0x1 00010000:00010000:1.0:1789049501.780709:0:6703:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=327s v=(0 0) 00010000:00010000:1.0:1789049501.780714:0:6703:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789049501.780722:0:6703:0:(ldlm_resource.c:1751:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004f91907a/0xf4f48ce5e1bbf60c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a3520 expref: 10 pid: 6703 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049501.780739:0:6703:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000004f91907a/0xf4f48ce5e1bbf60c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a3520 expref: 10 pid: 6703 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049501.780752:0:6703:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cb8c28c2e00, rc 0) 00000100:00100000:1.0:1789049501.780824:0:6703:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8d0aad500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e823b53a-3591-475c-8624-c682227e5c13+10:2357:x1875954089647104:12345-192.168.206.26@tcp:101:lhsmtool_posix.0 Request processed in 213us (439us total) trans 0 rc 0/0 00000100:00100000:1.0:1789049501.780831:0:6703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.26@tcp, seq: 38 00000100:00100000:3.0:1789049501.785909:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.26@tcp (source: 12345-192.168.206.26@tcp) 00000100:00100000:2.0:1789049501.786222:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954089647360 00000100:00100000:2.0:1789049501.786231:0:5850:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954089647360 00000100:00100000:2.0:1789049501.786298:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.26@tcp, seq: 123 00000100:00100000:2.0:1789049501.786307:0:5850:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8d0aad180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e823b53a-3591-475c-8624-c682227e5c13+63:10534:x1875954089647360:12345-192.168.206.26@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1789049501.786416:0:5850:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8d0aad180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e823b53a-3591-475c-8624-c682227e5c13+63:10534:x1875954089647360:12345-192.168.206.26@tcp:57:lhsmtool_posix.0 Request processed in 109us (524us total) trans 0 rc 0/0 00000100:00100000:2.0:1789049501.786424:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.26@tcp, seq: 123 00000100:00100000:3.0:1789049501.789594:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.26@tcp (source: 12345-192.168.206.26@tcp) 00000100:00100000:0.0:1789049501.789872:0:10560:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954089647488 00000100:00100000:0.0:1789049501.789882:0:10560:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954089647488 00000100:00100000:0.0:1789049501.789944:0:10560:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.26@tcp, seq: 39 00000100:00100000:0.0:1789049501.789954:0:10560:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8d0aaf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e823b53a-3591-475c-8624-c682227e5c13+10:10534:x1875954089647488:12345-192.168.206.26@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789049501.789972:0:10560:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789049501.789989:0:10560:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f535ea4e/0xf4f48ce5e1bbf613 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x7fc5e358805a3527 expref: -99 pid: 10560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049501.790019:0:10560:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000004f91907a/0xf4f48ce5e1bbf60c lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a3520 expref: 11 pid: 6703 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049501.790028:0:10560:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789049501.790032:0:10560:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789049501.790037:0:10560:0:(ldlm_resource.c:1751:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f535ea4e/0xf4f48ce5e1bbf613 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a3527 expref: 11 pid: 10560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049501.790070:0:10560:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000004f91907a/0xf4f48ce5e1bbf60c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a3520 expref: 11 pid: 6703 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049501.790083:0:10560:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000004f91907a/0xf4f48ce5e1bbf60c lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a3520 expref: 11 pid: 6703 timeout: 427 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789049501.790107:0:10560:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb8df4d3480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10560:1875954110628224:192.168.206.26@tcp:104: 00000100:00100000:0.0:1789049501.790208:0:10560:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cb8c6b2aa80 going to sleep for 11 seconds 00000100:00100000:3.0:1789049501.794217:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.26@tcp (source: 12345-192.168.206.26@tcp) 00000100:00100000:2.0:1789049501.794356:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954089647616 00000100:00100000:2.0:1789049501.794366:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954089647616 00010000:00010000:2.0:1789049501.794405:0:5835:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000004f91907a/0xf4f48ce5e1bbf60c lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a3520 expref: 12 pid: 6703 timeout: 427 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789049501.794475:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.26@tcp, seq: 54 00000100:00100000:2.0:1789049501.794485:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8c7dee450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e823b53a-3591-475c-8624-c682227e5c13+12:2357:x1875954089647616:12345-192.168.206.26@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789049501.794500:0:5835:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789049501.794522:0:5835:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000004f91907a/0xf4f48ce5e1bbf60c lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a3520 expref: 12 pid: 6703 timeout: 427 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049501.794536:0:5835:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000004f91907a/0xf4f48ce5e1bbf60c lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a3520 expref: 12 pid: 6703 timeout: 427 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049501.794561:0:5835:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789049501.794566:0:5835:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789049501.794575:0:5835:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000f535ea4e/0xf4f48ce5e1bbf613 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a3527 expref: 12 pid: 10560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049501.794586:0:5835:0:(ldlm_resource.c:1751:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f535ea4e/0xf4f48ce5e1bbf613 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a3527 expref: 12 pid: 10560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049501.794620:0:5835:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000f535ea4e/0xf4f48ce5e1bbf613 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a3527 expref: 12 pid: 10560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789049501.794634:0:5835:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb8df261880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:5835:1875954110628352:192.168.206.26@tcp:105: 00000100:00100000:2.0:1789049501.794707:0:5835:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cb8d0aaa000 going to sleep for 11 seconds 00010000:00010000:0.0:1789049501.795579:0:10560:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004f91907a/0xf4f48ce5e1bbf60c lrc: 0/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a3520 expref: 12 pid: 6703 timeout: 427 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789049501.795599:0:10560:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb8df4d3480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10560:1875954110628224:192.168.206.26@tcp:104: 00010000:00010000:0.0:1789049501.795625:0:10560:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000f535ea4e/0xf4f48ce5e1bbf613 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a3527 expref: 11 pid: 10560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049501.795637:0:10560:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cb7c4c39a00, rc 0) 00000100:00100000:0.0:1789049501.795686:0:10560:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8d0aaf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e823b53a-3591-475c-8624-c682227e5c13+11:10534:x1875954089647488:12345-192.168.206.26@tcp:101:lhsmtool_posix.0 Request processed in 5733us (6100us total) trans 0 rc 0/0 00000100:00100000:0.0:1789049501.795694:0:10560:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.26@tcp, seq: 39 00000100:00100000:3.0:1789049501.803497:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.26@tcp (source: 12345-192.168.206.26@tcp) 00000100:00100000:0.0:1789049501.803601:0:6709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954089647744 00000100:00100000:0.0:1789049501.803611:0:6709:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954089647744 00002000:00100000:0.0:1789049501.803660:0:6709:0:(ofd_dev.c:2725:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x4:0x0] (0->12) req@ffff8cb8d0aaf480 x1875954089647744/t0(0) o4->e823b53a-3591-475c-8624-c682227e5c13@192.168.206.26@tcp:2/0 lens 504/0 e 0 to 0 dl 1789049512 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789049501.803671:0:6709:0:(ofd_dev.c:2581:ofd_prolong_extent_locks()) Prolong locks for req ffff8cb8d0aaf480 with x1875954089647744 ext(0->12) 00002000:00010000:0.0:1789049501.803676:0:6709:0:(ofd_dev.c:2730:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8cb8d0aaf480 00000100:00100000:0.0:1789049501.803710:0:6709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.26@tcp, seq: 2 00000100:00100000:0.0:1789049501.803720:0:6709:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8d0aaf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:e823b53a-3591-475c-8624-c682227e5c13+11:2357:x1875954089647744:12345-192.168.206.26@tcp:4:lhsmtool_posix.0 00000100:00100000:0.0:1789049501.804200:0:6709:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8d0aaf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:e823b53a-3591-475c-8624-c682227e5c13+13:2357:x1875954089647744:12345-192.168.206.26@tcp:4:lhsmtool_posix.0 Request processed in 479us (709us total) trans 4294967308 rc 0/0 00000100:00100000:0.0:1789049501.804214:0:6709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.26@tcp, seq: 2 00002000:00100000:0.0:1789049501.804221:0:6709:0:(ofd_dev.c:2725:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x4:0x0] (0->12) req@ffff8cb8d0aaf480 x1875954089647744/t4294967308(0) o4->e823b53a-3591-475c-8624-c682227e5c13@192.168.206.26@tcp:2/0 lens 504/448 e 0 to 0 dl 1789049512 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789049501.804230:0:6709:0:(ofd_dev.c:2581:ofd_prolong_extent_locks()) Prolong locks for req ffff8cb8d0aaf480 with x1875954089647744 ext(0->12) 00002000:00010000:0.0:1789049501.804234:0:6709:0:(ofd_dev.c:2730:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8cb8d0aaf480 00000100:00100000:2.0:1789049501.804963:0:5835:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb8df261880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:5835:1875954110628352:192.168.206.26@tcp:105: 00010000:00010000:2.0:1789049501.804996:0:5835:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789049501.805039:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8c7dee450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e823b53a-3591-475c-8624-c682227e5c13+12:2357:x1875954089647616:12345-192.168.206.26@tcp:103:ldlm_bl.0 Request processed in 10554us (10831us total) trans 0 rc 0/0 00000100:00100000:2.0:1789049501.805048:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.26@tcp, seq: 54 00000100:00100000:3.0:1789049501.808185:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.26@tcp (source: 12345-192.168.206.26@tcp) 00000100:00100000:1.0:1789049501.808432:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954089647872 00000100:00100000:1.0:1789049501.808442:0:5852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954089647872 00000100:00100000:1.0:1789049501.808546:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.26@tcp, seq: 124 00000100:00100000:1.0:1789049501.808557:0:5852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8d0aaea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e823b53a-3591-475c-8624-c682227e5c13+63:10534:x1875954089647872:12345-192.168.206.26@tcp:44:lhsmtool_posix.0 00000001:00080000:3.0:1789049501.855037:0:5872:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967374 is committed 00000001:00080000:3.0:1789049501.855059:0:5872:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967404 is committed 00000004:00080000:3.0:1789049501.855066:0:5872:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 6 committed 00000020:00080000:3.0:1789049501.855089:0:5872:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8cb8c79e03c0 refcount 2 committed 0 result 0 batchid 3 00000020:00080000:3.0:1789049501.855094:0:5872:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8cb8fc9b9d00 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8cb8c79e09c0 00000020:00080000:3.0:1789049501.855097:0:5872:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8cb8fc9b9700 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8cb900d71400 00000004:00080000:3.0:1789049501.855170:0:5872:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 5 committed 00000020:00080000:3.0:1789049501.855180:0:5872:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8cb8d0aaa780 refcount 2 committed 0 result 0 batchid 2 00000020:00080000:3.0:1789049501.855183:0:5872:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8cb8c5a48f00 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8cb8d0aaacc0 00000020:00080000:3.0:1789049501.855186:0:5872:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8cb8c5a48100 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8cb8fcecf800 00000004:00080000:3.0:1789049501.855201:0:5872:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 3 committed 00000100:00100000:3.0:1789049501.855331:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb8d0aafb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3309:1875954110628480:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1789049501.855385:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789049501.855431:0:6703:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954110628480 00000100:00100000:3.0:1789049501.855438:0:6703:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954110628480 00000100:00100000:3.0:1789049501.855480:0:6703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1789049501.855489:0:6703:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8d0aad880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+8:3309:x1875954110628480:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:3.0:1789049501.855511:0:6703:0:(ofd_dev.c:1868:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:3 count 1 00002000:00010000:3.0:1789049501.855542:0:6703:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x3:0x0] initial LVB size: 9, mtime: 0x18d3fb0a99d55bb8, atime: 0x18d3fb0aa60e1619, ctime: 0x18d3fb0a99d55bb8, blocks: 0x1 00010000:00010000:3.0:1789049501.855551:0:6703:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000047f650da/0xf4f48ce5e1bbf61a lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049501.855567:0:6703:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=327s v=(0 0) 00010000:00010000:3.0:1789049501.855571:0:6703:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789049501.855577:0:6703:0:(ldlm_resource.c:1751:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000047f650da/0xf4f48ce5e1bbf61a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049501.855593:0:6703:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000047f650da/0xf4f48ce5e1bbf61a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049501.855603:0:6703:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000047f650da/0xf4f48ce5e1bbf61a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049501.855622:0:6703:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000047f650da/0xf4f48ce5e1bbf61a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049501.855637:0:6703:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1789049501.856133:0:6703:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8d0aad880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+9:3309:x1875954110628480:12345-0@lo:6:osp-syn-1-0.0 Request processed in 644us (747us total) trans 4294967304 rc 0/0 00000100:00100000:3.0:1789049501.856141:0:6703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000004:00080000:3.0:1789049501.856184:0:3309:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8cb8d0aafb80/2, rc 0, transno 4294967304 00000100:00100000:3.0:1789049501.856189:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb8d0aafb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3309:1875954110628480:0@lo:6:osp-syn-1-0.0 00000020:00080000:0.0:1789049501.856320:0:5883:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 3 committed batchid 1 00000020:00080000:0.0:1789049501.856445:0:5883:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 1 00010000:00010000:0.0:1789049501.856456:0:5839:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789049501.856463:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000047f650da/0xf4f48ce5e1bbf61a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049501.856473:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cb8c6b35a00 already unused, calling callback (ffffffffc166a8f0) 00010000:00010000:0.0:1789049501.856477:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000047f650da/0xf4f48ce5e1bbf61a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049501.856485:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000047f650da/0xf4f48ce5e1bbf61a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049501.856501:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000047f650da/0xf4f48ce5e1bbf61a lrc: 1/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049501.856508:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000047f650da/0xf4f48ce5e1bbf61a lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049501.856526:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789049501.856534:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789049501.856536:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789049501.856719:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb8df261880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3311:1875954110628736:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1789049501.856759:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789049501.856792:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1789049501.856798:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb8df260380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3311:1875954110628608:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1789049501.856819:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789049501.856877:0:10560:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954110628736 00000100:00100000:0.0:1789049501.856883:0:10560:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954110628736 00000100:00100000:0.0:1789049501.856924:0:10560:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954110628608 00000100:00100000:0.0:1789049501.856927:0:10560:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954110628608 00000100:00100000:0.0:1789049501.856947:0:10560:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1789049501.856954:0:10560:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8df4d3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3311:x1875954110628736:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1789049501.857063:0:10560:0:(ofd_lvb.c:321:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:0.0:1789049501.857067:0:10560:0:(ofd_lvb.c:328:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb mtime from disk: 0 -> 1789049501118495627 00002000:00010000:0.0:1789049501.857070:0:10560:0:(ofd_lvb.c:334:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1789049501.857072:0:10560:0:(ofd_lvb.c:340:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb ctime from disk: 1789049501065000000 -> 1789049501118495627 00002000:00010000:0.0:1789049501.857074:0:10560:0:(ofd_lvb.c:346:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:0.0:1789049501.857106:0:10560:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8df4d3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+8:3311:x1875954110628736:12345-0@lo:2:osp-syn-0-0.0 Request processed in 152us (347us total) trans 4294967309 rc 0/0 00000100:00100000:0.0:1789049501.857114:0:10560:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1789049501.857127:0:10560:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1789049501.857134:0:10560:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8df4d0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3311:x1875954110628608:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:0.0:1789049501.857146:0:10560:0:(ofd_dev.c:1868:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:3 count 1 00010000:00010000:0.0:1789049501.857159:0:10560:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c0c746f5/0xf4f48ce5e1bbf621 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 10560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049501.857176:0:10560:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000081773780/0xf4f48ce5e1bbf3dc lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a3486 expref: 11 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049501.857191:0:10560:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x3:0x0].0x0 since=1s v=(0 0) 00010000:00010000:0.0:1789049501.857195:0:10560:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1789049501.857199:0:10560:0:(ldlm_resource.c:1751:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c0c746f5/0xf4f48ce5e1bbf621 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 10560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049501.857224:0:10560:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000081773780/0xf4f48ce5e1bbf3dc lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a3486 expref: 11 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049501.857396:0:10560:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000081773780/0xf4f48ce5e1bbf3dc lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a3486 expref: 11 pid: 6704 timeout: 427 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789049501.857413:0:10560:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb8df4d2300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10560:1875954110628864:192.168.206.26@tcp:104: 00000100:00100000:0.0:1789049501.857474:0:10560:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cb8c6b2a300 going to sleep for 11 seconds 00000004:00080000:0.0:1789049501.857502:0:3311:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8cb8df261880/2, rc 0, transno 4294967309 00000100:00100000:0.0:1789049501.857507:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb8df261880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3311:1875954110628736:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1789049501.857639:0:5852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8d0aaea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e823b53a-3591-475c-8624-c682227e5c13+15:10534:x1875954089647872:12345-192.168.206.26@tcp:44:lhsmtool_posix.0 Request processed in 49083us (49461us total) trans 0 rc 0/0 00000100:00100000:1.0:1789049501.857648:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.26@tcp, seq: 124 00000100:00100000:1.0:1789049501.860201:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.26@tcp (source: 12345-192.168.206.26@tcp) 00000100:00100000:2.0:1789049501.860352:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954089648000 00000100:00100000:2.0:1789049501.860424:0:6704:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954089648000 00000100:00100000:2.0:1789049501.860478:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.26@tcp, seq: 43 00000100:00100000:2.0:1789049501.860488:0:6704:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8d6a24450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e823b53a-3591-475c-8624-c682227e5c13+12:2358:x1875954089648000:12345-192.168.206.26@tcp:16:lhsmtool_posix.0 00000100:00100000:3.0:1789049501.865840:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.26@tcp (source: 12345-192.168.206.26@tcp) 00000100:00100000:3.0:1789049501.865889:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954089648128 00000100:00100000:3.0:1789049501.865908:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954089648128 00010000:00010000:3.0:1789049501.865946:0:5837:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000081773780/0xf4f48ce5e1bbf3dc lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a3486 expref: 13 pid: 6704 timeout: 427 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789049501.865984:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.26@tcp, seq: 55 00000100:00100000:3.0:1789049501.865993:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8d0aaed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e823b53a-3591-475c-8624-c682227e5c13+13:2357:x1875954089648128:12345-192.168.206.26@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789049501.866006:0:5837:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789049501.866012:0:5837:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000081773780/0xf4f48ce5e1bbf3dc lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a3486 expref: 13 pid: 6704 timeout: 427 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789049501.866023:0:10560:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb8df4d2300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10560:1875954110628864:192.168.206.26@tcp:104: 00010000:00010000:3.0:1789049501.866024:0:5837:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000081773780/0xf4f48ce5e1bbf3dc lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a3486 expref: 13 pid: 6704 timeout: 427 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049501.870576:0:10560:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000c0c746f5/0xf4f48ce5e1bbf621 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 10560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049501.871490:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000081773780/0xf4f48ce5e1bbf3dc lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a3486 expref: 13 pid: 6704 timeout: 427 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049501.871512:0:5837:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1789049501.871516:0:5837:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1789049501.871522:0:5837:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000c0c746f5/0xf4f48ce5e1bbf621 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 10560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049501.871532:0:5837:0:(ldlm_resource.c:1751:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c0c746f5/0xf4f48ce5e1bbf621 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 10560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049501.871562:0:5837:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789049501.871618:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8d0aaed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e823b53a-3591-475c-8624-c682227e5c13+12:2357:x1875954089648128:12345-192.168.206.26@tcp:103:ldlm_bl.0 Request processed in 5624us (5788us total) trans 0 rc 0/0 00000100:00100000:3.0:1789049501.871628:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.26@tcp, seq: 55 00010000:00010000:3.0:1789049501.871671:0:10560:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000c0c746f5/0xf4f48ce5e1bbf621 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 10560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049501.871681:0:10560:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c0c746f5/0xf4f48ce5e1bbf621 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 10560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049501.871691:0:10560:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c0c746f5/0xf4f48ce5e1bbf621 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 10560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049501.871698:0:10560:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c0c746f5/0xf4f48ce5e1bbf621 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 10560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049501.871722:0:10560:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1789049501.872271:0:10560:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8df4d0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+8:3311:x1875954110628608:12345-0@lo:6:osp-syn-0-0.0 Request processed in 15136us (15449us total) trans 4294967310 rc 0/0 00000100:00100000:3.0:1789049501.872279:0:10560:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00010000:00010000:0.0:1789049501.873235:0:5838:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789049501.873297:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c0c746f5/0xf4f48ce5e1bbf621 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 10560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049501.873322:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cb7c4c38c00 already unused, calling callback (ffffffffc166a8f0) 00010000:00010000:0.0:1789049501.873327:0:5838:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c0c746f5/0xf4f48ce5e1bbf621 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 10560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049501.873339:0:5838:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c0c746f5/0xf4f48ce5e1bbf621 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 10560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049501.873356:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c0c746f5/0xf4f48ce5e1bbf621 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 10560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049501.873429:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c0c746f5/0xf4f48ce5e1bbf621 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 10560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049501.873449:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789049501.873451:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789049501.873452:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:0.0:1789049501.874588:0:3311:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8cb8df260380/2, rc 0, transno 4294967310 00000100:00100000:0.0:1789049501.874606:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb8df260380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3311:1875954110628608:0@lo:6:osp-syn-0-0.0 00000001:00080000:0.0:1789049501.894468:0:6731:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967309 is committed 00000001:00080000:0.0:1789049501.894484:0:6731:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967308 is committed 00000100:00100000:2.0:1789049501.894729:0:6704:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8d6a24450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e823b53a-3591-475c-8624-c682227e5c13+6:2358:x1875954089648000:12345-192.168.206.26@tcp:16:lhsmtool_posix.0 Request processed in 34236us (34530us total) trans 0 rc 0/0 00000100:00100000:2.0:1789049501.894740:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.26@tcp, seq: 43 00000100:00100000:3.0:1789049501.898403:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.26@tcp (source: 12345-192.168.206.26@tcp) 00000100:00100000:2.0:1789049501.898490:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954089648384 00000100:00100000:2.0:1789049501.898499:0:5850:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954089648384 00000100:00100000:2.0:1789049501.898557:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.26@tcp, seq: 125 00000100:00100000:2.0:1789049501.898567:0:5850:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8d0aad500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e823b53a-3591-475c-8624-c682227e5c13+15:10534:x1875954089648384:12345-192.168.206.26@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1789049501.898620:0:5850:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789049501.898648:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c2400/0xf4f48ce5e1bbf605 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a3519 expref: 15 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049501.898667:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff8cb8e0130b00) 00010000:00010000:2.0:1789049501.898672:0:5850:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789049501.898700:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6715a00/0xf4f48ce5e1bbf628 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049501.898715:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6715a00/0xf4f48ce5e1bbf628 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049501.898742:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6715a00/0xf4f48ce5e1bbf628 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789049501.899039:0:5850:0:(mdt_handler.c:4507:mdt_save_lock()) ### save lock request 00000000faed23ca reply state 0000000028215748 transno 4294967405 ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6715a00/0xf4f48ce5e1bbf628 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789049501.899050:0:5850:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1789049501.899243:0:5850:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8d0aad500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e823b53a-3591-475c-8624-c682227e5c13+16:10534:x1875954089648384:12345-192.168.206.26@tcp:36:lhsmtool_posix.0 Request processed in 676us (847us total) trans 4294967405 rc 0/0 00000100:00100000:2.0:1789049501.899251:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.26@tcp, seq: 125 00010000:00010000:2.0:1789049501.901268:0:3294:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6715a00/0xf4f48ce5e1bbf628 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049501.901284:0:3294:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6715a00/0xf4f48ce5e1bbf628 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049501.901291:0:3294:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6715a00/0xf4f48ce5e1bbf628 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049501.901297:0:3294:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cb8d6715a00 already unused, calling callback (ffffffffc20ca4f0) 00010000:00010000:2.0:1789049501.901302:0:3294:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6715a00/0xf4f48ce5e1bbf628 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049501.901309:0:3294:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6715a00/0xf4f48ce5e1bbf628 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049501.901324:0:3294:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff8cb8e0130b00) 00010000:00010000:2.0:1789049501.901326:0:3294:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789049501.901330:0:3294:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6715a00/0xf4f48ce5e1bbf628 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049501.901356:0:3294:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6715a00/0xf4f48ce5e1bbf628 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789049501.903602:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.26@tcp (source: 12345-192.168.206.26@tcp) 00000100:00100000:0.0:1789049501.903689:0:6705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954089648512 00000100:00100000:0.0:1789049501.903699:0:6705:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954089648512 00000100:00100000:0.0:1789049501.903758:0:6705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.26@tcp, seq: 44 00000100:00100000:0.0:1789049501.903768:0:6705:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8d0aaf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e823b53a-3591-475c-8624-c682227e5c13+6:2355:x1875954089648512:12345-192.168.206.26@tcp:2:lhsmtool_posix.0 00002000:00010000:0.0:1789049501.903992:0:6705:0:(ofd_lvb.c:321:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb size from disk: 13 -> 13 00002000:00010000:0.0:1789049501.904007:0:6705:0:(ofd_lvb.c:328:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb mtime from disk: 1789049501118495627 -> 1789049500514000000 00002000:00010000:0.0:1789049501.904009:0:6705:0:(ofd_lvb.c:334:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb atime from disk: 0 -> 1789049500150000000 00002000:00010000:0.0:1789049501.904012:0:6705:0:(ofd_lvb.c:340:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb ctime from disk: 1789049501118495627 -> 1789049500514000000 00002000:00010000:0.0:1789049501.904015:0:6705:0:(ofd_lvb.c:346:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:0.0:1789049501.904070:0:6705:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8d0aaf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e823b53a-3591-475c-8624-c682227e5c13+7:2355:x1875954089648512:12345-192.168.206.26@tcp:2:lhsmtool_posix.0 Request processed in 303us (481us total) trans 4294967311 rc 0/0 00000100:00100000:0.0:1789049501.904077:0:6705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.26@tcp, seq: 44 00000100:00100000:0.0:1789049501.907050:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.26@tcp (source: 12345-192.168.206.26@tcp) 00000100:00100000:2.0:1789049501.907123:0:6841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954089648768 00000100:00100000:2.0:1789049501.907133:0:6841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954089648768 00000100:00100000:2.0:1789049501.907188:0:6841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.26@tcp, seq: 126 00000100:00100000:2.0:1789049501.907198:0:6841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8df4d2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e823b53a-3591-475c-8624-c682227e5c13+15:10534:x1875954089648768:12345-192.168.206.26@tcp:55:lhsmtool_posix.0 00010000:00010000:2.0:1789049501.907273:0:6841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6714a00/0xf4f48ce5e1bbf62f lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049501.907292:0:6841:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6715200/0xf4f48ce5e1bbf5e9 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a350b expref: 15 pid: 6841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049501.907302:0:6841:0:(ldlm_resource.c:1751:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6714a00/0xf4f48ce5e1bbf62f lrc: 4/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049501.907336:0:6841:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6715200/0xf4f48ce5e1bbf5e9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a350b expref: 15 pid: 6841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049501.907351:0:6841:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6715200/0xf4f48ce5e1bbf5e9 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a350b expref: 15 pid: 6841 timeout: 427 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789049501.907377:0:6841:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb8df260e00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6841:1875954110628992:192.168.206.26@tcp:104: 00000100:00100000:2.0:1789049501.907456:0:6841:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cb8d1a2b9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789049501.910495:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.26@tcp (source: 12345-192.168.206.26@tcp) 00000100:00100000:0.0:1789049501.910624:0:6720:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954089648896 00000100:00100000:0.0:1789049501.910633:0:6720:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954089648896 00010000:00010000:0.0:1789049501.910671:0:6720:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6715200/0xf4f48ce5e1bbf5e9 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a350b expref: 16 pid: 6841 timeout: 427 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789049501.910714:0:6720:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.26@tcp, seq: 56 00000100:00100000:0.0:1789049501.910723:0:6720:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8d0aad880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e823b53a-3591-475c-8624-c682227e5c13+16:2357:x1875954089648896:12345-192.168.206.26@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789049501.910738:0:6720:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789049501.910745:0:6720:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6715200/0xf4f48ce5e1bbf5e9 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a350b expref: 16 pid: 6841 timeout: 427 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049501.910757:0:6720:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6715200/0xf4f48ce5e1bbf5e9 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a350b expref: 16 pid: 6841 timeout: 427 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049501.910778:0:6720:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff8cb8e0130b00) 00010000:00010000:0.0:1789049501.910783:0:6720:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6714a00/0xf4f48ce5e1bbf62f lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049501.910792:0:6720:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6714a00/0xf4f48ce5e1bbf62f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049501.910812:0:6720:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6714a00/0xf4f48ce5e1bbf62f lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049501.910829:0:6720:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789049501.910919:0:6720:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8d0aad880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e823b53a-3591-475c-8624-c682227e5c13+16:2357:x1875954089648896:12345-192.168.206.26@tcp:103:ldlm_bl.0 Request processed in 196us (432us total) trans 0 rc 0/0 00000100:00100000:0.0:1789049501.910927:0:6720:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.26@tcp, seq: 56 00010000:00010000:2.0:1789049501.911032:0:6841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6715200/0xf4f48ce5e1bbf5e9 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a350b expref: 15 pid: 6841 timeout: 427 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789049501.911062:0:6841:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb8df260e00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6841:1875954110628992:192.168.206.26@tcp:104: 00010000:00010000:2.0:1789049501.911081:0:6841:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6714a00/0xf4f48ce5e1bbf62f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049501.911090:0:6841:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6714a00/0xf4f48ce5e1bbf62f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049501.911096:0:6841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6714a00/0xf4f48ce5e1bbf62f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049501.911123:0:6841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6714a00/0xf4f48ce5e1bbf62f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049501.911129:0:6841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6714a00/0xf4f48ce5e1bbf62f lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049501.911135:0:6841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6714a00/0xf4f48ce5e1bbf62f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049501.911140:0:6841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cb8d6714a00 already unused, calling callback (ffffffffc20ca4f0) 00010000:00010000:2.0:1789049501.911145:0:6841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6714a00/0xf4f48ce5e1bbf62f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049501.911151:0:6841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6714a00/0xf4f48ce5e1bbf62f lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049501.911162:0:6841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff8cb8e0130b00) 00010000:00010000:2.0:1789049501.911164:0:6841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:2.0:1789049501.911168:0:6841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6714a00/0xf4f48ce5e1bbf62f lrc: 2/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049501.911180:0:6841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6714a00/0xf4f48ce5e1bbf62f lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6841 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789049501.911219:0:6841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8df4d2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e823b53a-3591-475c-8624-c682227e5c13+14:10534:x1875954089648768:12345-192.168.206.26@tcp:55:lhsmtool_posix.0 Request processed in 4023us (4177us total) trans 0 rc -22/-22 00000100:00100000:2.0:1789049501.911226:0:6841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.26@tcp, seq: 126 00000100:00100000:3.0:1789049501.914174:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.26@tcp (source: 12345-192.168.206.26@tcp) 00000100:00100000:0.0:1789049501.914276:0:10560:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954089649024 00000100:00100000:0.0:1789049501.914285:0:10560:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954089649024 00000100:00100000:0.0:1789049501.914332:0:10560:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.26@tcp, seq: 45 00000100:00100000:0.0:1789049501.914341:0:10560:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8fce95c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e823b53a-3591-475c-8624-c682227e5c13+7:2357:x1875954089649024:12345-192.168.206.26@tcp:1:lhsmtool_posix.0 00010000:00010000:0.0:1789049501.914391:0:10560:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000001ed3566f/0xf4f48ce5e1bbf636 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 10560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049501.914411:0:10560:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000f535ea4e/0xf4f48ce5e1bbf613 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a3527 expref: 7 pid: 10560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049501.914419:0:10560:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789049501.914423:0:10560:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1789049501.914427:0:10560:0:(ldlm_resource.c:1751:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001ed3566f/0xf4f48ce5e1bbf636 lrc: 4/1,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 10560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049501.914461:0:10560:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000f535ea4e/0xf4f48ce5e1bbf613 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a3527 expref: 7 pid: 10560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049501.914475:0:10560:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000f535ea4e/0xf4f48ce5e1bbf613 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a3527 expref: 7 pid: 10560 timeout: 427 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789049501.914506:0:10560:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb8df4d3480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10560:1875954110629120:192.168.206.26@tcp:104: 00000100:00100000:0.0:1789049501.914592:0:10560:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cb8c6b2a600 going to sleep for 11 seconds 00000100:00100000:0.0:1789049501.917635:0:10560:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb8df4d3480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10560:1875954110629120:192.168.206.26@tcp:104: 00010000:00010000:0.0:1789049501.917661:0:10560:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000001ed3566f/0xf4f48ce5e1bbf636 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 10560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789049501.919306:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.26@tcp (source: 12345-192.168.206.26@tcp) 00000100:00100000:0.0:1789049501.919569:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954089649152 00000100:00100000:0.0:1789049501.919578:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954089649152 00010000:00010000:0.0:1789049501.919618:0:5837:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000f535ea4e/0xf4f48ce5e1bbf613 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a3527 expref: 8 pid: 10560 timeout: 427 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789049501.919655:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.26@tcp, seq: 57 00000100:00100000:0.0:1789049501.919665:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8fce96680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e823b53a-3591-475c-8624-c682227e5c13+8:2358:x1875954089649152:12345-192.168.206.26@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789049501.919679:0:5837:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789049501.919701:0:5837:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000f535ea4e/0xf4f48ce5e1bbf613 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a3527 expref: 8 pid: 10560 timeout: 427 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049501.919713:0:5837:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000f535ea4e/0xf4f48ce5e1bbf613 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a3527 expref: 8 pid: 10560 timeout: 427 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049501.919735:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f535ea4e/0xf4f48ce5e1bbf613 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a3527 expref: 8 pid: 10560 timeout: 427 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049501.919751:0:5837:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1789049501.919768:0:5837:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1789049501.919774:0:5837:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000001ed3566f/0xf4f48ce5e1bbf636 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 10560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049501.919782:0:5837:0:(ldlm_resource.c:1751:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001ed3566f/0xf4f48ce5e1bbf636 lrc: 4/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 10560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049501.919822:0:5837:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789049501.919941:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8fce96680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e823b53a-3591-475c-8624-c682227e5c13+7:2358:x1875954089649152:12345-192.168.206.26@tcp:103:ldlm_bl.0 Request processed in 276us (641us total) trans 0 rc 0/0 00000100:00100000:0.0:1789049501.919948:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.26@tcp, seq: 57 00010000:00010000:1.0:1789049501.920371:0:10560:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000001ed3566f/0xf4f48ce5e1bbf636 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 10560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049501.920381:0:10560:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001ed3566f/0xf4f48ce5e1bbf636 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 10560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049501.920410:0:10560:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000001ed3566f/0xf4f48ce5e1bbf636 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 10560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049501.920419:0:10560:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001ed3566f/0xf4f48ce5e1bbf636 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 10560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049501.920427:0:10560:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001ed3566f/0xf4f48ce5e1bbf636 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 10560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049501.920448:0:10560:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cb7c4c39400 already unused, calling callback (ffffffffc166a8f0) 00010000:00010000:1.0:1789049501.920452:0:10560:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001ed3566f/0xf4f48ce5e1bbf636 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 10560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049501.920462:0:10560:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001ed3566f/0xf4f48ce5e1bbf636 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 10560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049501.920476:0:10560:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001ed3566f/0xf4f48ce5e1bbf636 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 10560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049501.920483:0:10560:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001ed3566f/0xf4f48ce5e1bbf636 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 10560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789049501.920547:0:10560:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8fce95c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e823b53a-3591-475c-8624-c682227e5c13+6:2357:x1875954089649024:12345-192.168.206.26@tcp:1:lhsmtool_posix.0 Request processed in 6205us (6380us total) trans 0 rc 0/0 00000100:00100000:1.0:1789049501.920555:0:10560:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.26@tcp, seq: 45 00000100:00100000:3.0:1789049501.925224:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.26@tcp (source: 12345-192.168.206.26@tcp) 00000100:00100000:2.0:1789049501.925356:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954089649408 00000100:00100000:2.0:1789049501.925365:0:5850:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954089649408 00000100:00100000:2.0:1789049501.925423:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.26@tcp, seq: 127 00000100:00100000:2.0:1789049501.925432:0:5850:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8fce94700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e823b53a-3591-475c-8624-c682227e5c13+14:10534:x1875954089649408:12345-192.168.206.26@tcp:57:lhsmtool_posix.0 00010000:00010000:2.0:1789049501.925503:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6714a00/0xf4f48ce5e1bbf63d lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049501.925524:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6714a00/0xf4f48ce5e1bbf63d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049501.925536:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6714a00/0xf4f48ce5e1bbf63d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049501.925730:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6715200/0xf4f48ce5e1bbf644 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049501.925742:0:5850:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c3a00/0xf4f48ce5e1bbf5f7 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a3512 expref: 15 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049501.925750:0:5850:0:(ldlm_resource.c:1751:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6715200/0xf4f48ce5e1bbf644 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049501.925783:0:5850:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c3a00/0xf4f48ce5e1bbf5f7 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a3512 expref: 15 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049501.925810:0:5850:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c3a00/0xf4f48ce5e1bbf5f7 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a3512 expref: 15 pid: 5852 timeout: 427 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789049501.925825:0:5850:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb8df260e00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5850:1875954110629248:192.168.206.26@tcp:104: 00000100:00100000:2.0:1789049501.925953:0:5850:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cb8d1a2b9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789049501.929108:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.26@tcp (source: 12345-192.168.206.26@tcp) 00000100:00100000:3.0:1789049501.929181:0:6720:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954089649536 00000100:00100000:3.0:1789049501.929190:0:6720:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954089649536 00010000:00010000:3.0:1789049501.929227:0:6720:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c3a00/0xf4f48ce5e1bbf5f7 lrc: 5/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a3512 expref: 16 pid: 5852 timeout: 427 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789049501.929271:0:6720:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.26@tcp, seq: 58 00000100:00100000:3.0:1789049501.929281:0:6720:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8df4d3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e823b53a-3591-475c-8624-c682227e5c13+16:2357:x1875954089649536:12345-192.168.206.26@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789049501.929295:0:6720:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789049501.929302:0:6720:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c3a00/0xf4f48ce5e1bbf5f7 lrc: 5/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a3512 expref: 16 pid: 5852 timeout: 427 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049501.929315:0:6720:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c3a00/0xf4f48ce5e1bbf5f7 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a3512 expref: 16 pid: 5852 timeout: 427 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049501.929336:0:6720:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff8cb8e0130b00) 00010000:00010000:3.0:1789049501.929354:0:6720:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6715200/0xf4f48ce5e1bbf644 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049501.929365:0:6720:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6715200/0xf4f48ce5e1bbf644 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049501.929373:0:6720:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6715200/0xf4f48ce5e1bbf644 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049501.929390:0:6720:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789049501.929437:0:6720:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8df4d3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e823b53a-3591-475c-8624-c682227e5c13+16:2357:x1875954089649536:12345-192.168.206.26@tcp:103:ldlm_bl.0 Request processed in 158us (345us total) trans 0 rc 0/0 00000100:00100000:3.0:1789049501.929444:0:6720:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.26@tcp, seq: 58 00010000:00010000:2.0:1789049501.929883:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c3a00/0xf4f48ce5e1bbf5f7 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a3512 expref: 15 pid: 5852 timeout: 427 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789049501.929912:0:5850:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb8df260e00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5850:1875954110629248:192.168.206.26@tcp:104: 00010000:00010000:2.0:1789049501.929931:0:5850:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6715200/0xf4f48ce5e1bbf644 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049501.929940:0:5850:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6715200/0xf4f48ce5e1bbf644 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049501.929946:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6715200/0xf4f48ce5e1bbf644 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789049501.930121:0:5850:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967406 00000001:00080000:2.0:1789049501.930349:0:5850:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967407 00000001:00080000:2.0:1789049501.930396:0:5850:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967408 00000100:00100000:2.0:1789049501.930477:0:5850:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb8df260e00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5850:1875954110629376:0@lo:1000:mdt00_000.0 00000100:00100000:2.0:1789049501.930526:0:5850:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789049501.930559:0:5850:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cb8d1a2b6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789049501.930807:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954110629376 00000100:00100000:1.0:1789049501.930813:0:5855:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954110629376 00000100:00100000:1.0:1789049501.930883:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1789049501.930902:0:5855:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb9009d6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5850:x1875954110629376:12345-0@lo:1000:mdt00_000.0 00000100:00100000:1.0:1789049501.930986:0:5855:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb9009d6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5850:x1875954110629376:12345-0@lo:1000:mdt00_000.0 Request processed in 95us (460us total) trans 0 rc 0/0 00000100:00100000:1.0:1789049501.930993:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1789049501.931075:0:5850:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967309 gen 2 00000004:00080000:3.0:1789049501.931081:0:5850:0:(osp_trans.c:1063:osp_request_commit_cb()) trans no 4294967305 committed transno 4294967309 00000004:00080000:3.0:1789049501.931109:0:5850:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8cb8df261880, transno 4294967309 00000100:00100000:3.0:1789049501.931130:0:5850:0:(client.c:3170:ptlrpc_free_committed()) @@@ stopping search req@ffff8cb8df260380 x1875954110628608/t4294967310(4294967310) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1789049517 ref 1 fl Complete:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789049501.931141:0:5850:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb8df260e00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5850:1875954110629376:0@lo:1000:mdt00_000.0 00000001:00080000:3.0:1789049501.931973:0:5850:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967409 00000100:00100000:3.0:1789049501.932041:0:5850:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb8fce97b80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5850:1875954110629504:0@lo:1000:mdt00_000.0 00000100:00100000:3.0:1789049501.932084:0:5850:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789049501.932124:0:5850:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cb8c63ea780 going to sleep for 11 seconds 00000100:00100000:1.0:1789049501.932502:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954110629504 00000100:00100000:1.0:1789049501.932509:0:5855:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954110629504 00000100:00100000:1.0:1789049501.932551:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1789049501.932560:0:5855:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8df261880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5850:x1875954110629504:12345-0@lo:1000:mdt00_000.0 00000100:00100000:1.0:1789049501.932746:0:5855:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8df261880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:5850:x1875954110629504:12345-0@lo:1000:mdt00_000.0 Request processed in 186us (660us total) trans 4294967312 rc 0/0 00000100:00100000:1.0:1789049501.932753:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1789049501.933362:0:5850:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb8fce97b80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5850:1875954110629504:0@lo:1000:mdt00_000.0 00010000:00010000:3.0:1789049501.933409:0:5850:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6715200/0xf4f48ce5e1bbf644 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049501.933420:0:5850:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6715200/0xf4f48ce5e1bbf644 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049501.933442:0:5850:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6715200/0xf4f48ce5e1bbf644 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049501.933447:0:5850:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cb8d6715200 already unused, calling callback (ffffffffc20ca4f0) 00010000:00010000:3.0:1789049501.933452:0:5850:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6715200/0xf4f48ce5e1bbf644 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049501.933460:0:5850:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6715200/0xf4f48ce5e1bbf644 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049501.933476:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff8cb8e0130b00) 00010000:00010000:3.0:1789049501.933479:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1789049501.933484:0:5850:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6715200/0xf4f48ce5e1bbf644 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049501.933490:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6715200/0xf4f48ce5e1bbf644 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049501.933521:0:5850:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c2200/0xf4f48ce5e1bbf587 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049501.933528:0:5850:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c2200/0xf4f48ce5e1bbf587 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049501.933533:0:5850:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c2200/0xf4f48ce5e1bbf587 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049501.933537:0:5850:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cb8c28c2200 already unused, calling callback (ffffffffc20ca4f0) 00010000:00010000:3.0:1789049501.933539:0:5850:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c2200/0xf4f48ce5e1bbf587 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049501.933555:0:5850:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c2200/0xf4f48ce5e1bbf587 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049501.933564:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8cb8ce751200) 00010000:00010000:3.0:1789049501.933566:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1789049501.933573:0:5850:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6715800/0xf4f48ce5e1bbf58e lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a34f6 expref: 18 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049501.933584:0:5850:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6715800/0xf4f48ce5e1bbf58e lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a34f6 expref: 18 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049501.933592:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6715800/0xf4f48ce5e1bbf58e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a34f6 expref: 18 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049501.933621:0:5850:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6715800/0xf4f48ce5e1bbf58e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a34f6 expref: 18 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789049501.933633:0:5850:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb8df260e00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5850:1875954110629632:192.168.206.26@tcp:105: 00000100:00100000:3.0:1789049501.933710:0:5850:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cb8c63ea780 going to sleep for 11 seconds 00000100:00100000:0.0:1789049501.937831:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.26@tcp (source: 12345-192.168.206.26@tcp) 00000100:00100000:3.0:1789049501.937987:0:5850:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb8df260e00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5850:1875954110629632:192.168.206.26@tcp:105: 00010000:00010000:3.0:1789049501.938018:0:5850:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c2200/0xf4f48ce5e1bbf587 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049501.938028:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c2200/0xf4f48ce5e1bbf587 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049501.938059:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c6b35c00/0xf4f48ce5e1bbf64b lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049501.938084:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c6b35c00/0xf4f48ce5e1bbf64b lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049501.938095:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c6b35c00/0xf4f48ce5e1bbf64b lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049501.938107:0:5850:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c6b35c00/0xf4f48ce5e1bbf64b lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049501.938113:0:5850:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c6b35c00/0xf4f48ce5e1bbf64b lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049501.938120:0:5850:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c6b35c00/0xf4f48ce5e1bbf64b lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049501.938126:0:5850:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cb8c6b35c00 already unused, calling callback (ffffffffc20ca4f0) 00010000:00010000:3.0:1789049501.938130:0:5850:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c6b35c00/0xf4f48ce5e1bbf64b lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049501.938137:0:5850:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c6b35c00/0xf4f48ce5e1bbf64b lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049501.938148:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8cb8ce751200) 00010000:00010000:3.0:1789049501.938151:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789049501.938155:0:5850:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c6b35c00/0xf4f48ce5e1bbf64b lrc: 2/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049501.938162:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c6b35c00/0xf4f48ce5e1bbf64b lrc: 0/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049501.938172:0:5850:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6714a00/0xf4f48ce5e1bbf63d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049501.938184:0:5850:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6714a00/0xf4f48ce5e1bbf63d lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049501.938190:0:5850:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6714a00/0xf4f48ce5e1bbf63d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049501.938194:0:5850:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cb8d6714a00 already unused, calling callback (ffffffffc20ca4f0) 00010000:00010000:3.0:1789049501.938197:0:5850:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6714a00/0xf4f48ce5e1bbf63d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049501.938204:0:5850:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6714a00/0xf4f48ce5e1bbf63d lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049501.938213:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8cb8ce751200) 00010000:00010000:3.0:1789049501.938215:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1789049501.938218:0:5850:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6714a00/0xf4f48ce5e1bbf63d lrc: 2/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049501.938223:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6714a00/0xf4f48ce5e1bbf63d lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789049501.938482:0:5850:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8fce94700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e823b53a-3591-475c-8624-c682227e5c13+18:10534:x1875954089649408:12345-192.168.206.26@tcp:57:lhsmtool_posix.0 Request processed in 13049us (13265us total) trans 4294967410 rc 0/0 00000100:00100000:3.0:1789049501.938492:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.26@tcp, seq: 127 00000020:00080000:3.0:1789049501.938498:0:5850:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:0.0:1789049501.939044:0:11704:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1789049501.939051:0:11704:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1789049501.939488:0:11704:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 3 00000040:00080000:0.0:1789049501.939497:0:11704:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1789049501.939663:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954089649664 00000100:00100000:1.0:1789049501.939671:0:5853:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954089649664 00000100:00100000:1.0:1789049501.939727:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.26@tcp, seq: 31 00000100:00100000:1.0:1789049501.939737:0:5853:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8df4d0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e823b53a-3591-475c-8624-c682227e5c13+18:10533:x1875954089649664:12345-192.168.206.26@tcp:49:lfs.0 00000100:00100000:1.0:1789049501.939901:0:5853:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8df4d0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e823b53a-3591-475c-8624-c682227e5c13+18:10533:x1875954089649664:12345-192.168.206.26@tcp:49:lfs.0 Request processed in 155us (2068us total) trans 0 rc 0/0 00000100:00100000:1.0:1789049501.939909:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.26@tcp, seq: 31 00000100:00100000:0.0:1789049501.944426:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.26@tcp (source: 12345-192.168.206.26@tcp) 00000100:00100000:0.0:1789049501.944564:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.26@tcp (source: 12345-192.168.206.26@tcp) 00000100:00100000:3.0:1789049501.944627:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954089650176 00000100:00100000:3.0:1789049501.944636:0:5853:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954089650176 00000100:00100000:3.0:1789049501.944692:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.26@tcp, seq: 32 00000100:00100000:3.0:1789049501.944702:0:5853:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8d1d2b450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e823b53a-3591-475c-8624-c682227e5c13+18:10534:x1875954089650176:12345-192.168.206.26@tcp:35:lhsmtool_posix.0 00000004:00080000:3.0:1789049501.945413:0:5853:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0x9:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:3.0:1789049501.945524:0:5853:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967411 00010000:00010000:3.0:1789049501.945572:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c6b34200/0xf4f48ce5e1bbf652 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049501.945588:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c6b34200/0xf4f48ce5e1bbf652 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049501.945599:0:5853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c6b34200/0xf4f48ce5e1bbf652 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049501.945608:0:5853:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c6b34200/0xf4f48ce5e1bbf652 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049501.945613:0:5853:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c6b34200/0xf4f48ce5e1bbf652 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049501.945619:0:5853:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c6b34200/0xf4f48ce5e1bbf652 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049501.945646:0:5853:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1789049501.945747:0:5853:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8d1d2b450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e823b53a-3591-475c-8624-c682227e5c13+20:10534:x1875954089650176:12345-192.168.206.26@tcp:35:lhsmtool_posix.0 Request processed in 1043us (1179us total) trans 4294967412 rc 0/0 00000100:00100000:3.0:1789049501.945756:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.26@tcp, seq: 32 00000020:00080000:3.0:1789049501.945762:0:5853:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1789049501.946078:0:6719:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789049501.946086:0:6719:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c6b34200/0xf4f48ce5e1bbf652 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049501.946093:0:6719:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cb8c6b34200 already unused, calling callback (ffffffffc166a8f0) 00010000:00010000:0.0:1789049501.946108:0:6719:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c6b34200/0xf4f48ce5e1bbf652 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049501.946118:0:6719:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c6b34200/0xf4f48ce5e1bbf652 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049501.946144:0:6719:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff8cb8c687da00) 00010000:00010000:0.0:1789049501.946147:0:6719:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1789049501.946152:0:6719:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c6b34200/0xf4f48ce5e1bbf652 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049501.946159:0:6719:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c6b34200/0xf4f48ce5e1bbf652 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049501.946176:0:6719:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789049501.946178:0:6719:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789049501.946179:0:6719:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789049501.949818:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954089649920 00000100:00100000:1.0:1789049501.949832:0:5852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954089649920 00000100:00100000:0.0:1789049501.950051:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.26@tcp, seq: 128 00000100:00100000:0.0:1789049501.950062:0:5852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8df480e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e823b53a-3591-475c-8624-c682227e5c13+20:10533:x1875954089649920:12345-192.168.206.26@tcp:58:lfs.0 00000040:00080000:0.0:1789049501.950489:0:5852:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].3, 136 off8600 00000100:00100000:0.0:1789049501.950582:0:5852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8df480e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e823b53a-3591-475c-8624-c682227e5c13+20:10533:x1875954089649920:12345-192.168.206.26@tcp:58:lfs.0 Request processed in 520us (6229us total) trans 0 rc 0/0 00000100:00100000:0.0:1789049501.950590:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.26@tcp, seq: 128 00000100:00100000:0.0:1789049501.981967:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.26@tcp (source: 12345-192.168.206.26@tcp) 00000100:00100000:1.0:1789049501.982059:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954089650304 00000100:00100000:1.0:1789049501.982070:0:5851:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954089650304 00000100:00100000:1.0:1789049501.982140:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.26@tcp, seq: 129 00000100:00100000:1.0:1789049501.982149:0:5851:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8df483100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e823b53a-3591-475c-8624-c682227e5c13+20:10536:x1875954089650304:12345-192.168.206.26@tcp:101:lfs.0 00010000:00010000:1.0:1789049501.982176:0:5851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789049501.982196:0:5851:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c3400/0xf4f48ce5e1bbf659 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7fc5e358805a352e expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049501.982276:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c3200/0xf4f48ce5e1bbf660 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049501.982291:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c3200/0xf4f48ce5e1bbf660 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049501.982333:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c3200/0xf4f48ce5e1bbf660 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049501.982350:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c2200/0xf4f48ce5e1bbf667 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049501.982357:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c2200/0xf4f48ce5e1bbf667 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049501.982693:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c2200/0xf4f48ce5e1bbf667 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049501.982959:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c3a00/0xf4f48ce5e1bbf66e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049501.982971:0:5851:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c3600/0xf4f48ce5e1bbf579 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a34ef expref: 21 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049501.982979:0:5851:0:(ldlm_resource.c:1751:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c3a00/0xf4f48ce5e1bbf66e lrc: 4/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049501.983012:0:5851:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c3600/0xf4f48ce5e1bbf579 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a34ef expref: 21 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049501.983027:0:5851:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c3600/0xf4f48ce5e1bbf579 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a34ef expref: 21 pid: 5850 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789049501.983039:0:5851:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb8df209180 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5851:1875954110629760:192.168.206.26@tcp:104: 00000100:00100000:2.0:1789049501.983606:0:5851:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cb8fc9b60c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789049501.989657:0:5851:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb8df209180 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5851:1875954110629760:192.168.206.26@tcp:104: 00010000:00010000:2.0:1789049501.989689:0:5851:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c3a00/0xf4f48ce5e1bbf66e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789049501.990831:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.26@tcp (source: 12345-192.168.206.26@tcp) 00000100:00100000:3.0:1789049501.991015:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954089650560 00000100:00100000:3.0:1789049501.991025:0:5853:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954089650560 00000100:00100000:3.0:1789049501.991294:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.26@tcp, seq: 33 00000100:00100000:3.0:1789049501.991308:0:5853:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb900a1ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e823b53a-3591-475c-8624-c682227e5c13+22:5594:x1875954089650560:12345-192.168.206.26@tcp:35:ldlm_bl.0 00000100:00100000:3.0:1789049501.991688:0:5853:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb900a1ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e823b53a-3591-475c-8624-c682227e5c13+23:5594:x1875954089650560:12345-192.168.206.26@tcp:35:ldlm_bl.0 Request processed in 382us (863us total) trans 4294967413 rc 0/0 00000100:00100000:3.0:1789049501.991705:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.26@tcp, seq: 33 00000100:00100000:2.0:1789049501.994515:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.26@tcp (source: 12345-192.168.206.26@tcp) 00000100:00100000:0.0:1789049501.994608:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954089650688 00000100:00100000:0.0:1789049501.994618:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954089650688 00010000:00010000:0.0:1789049501.994656:0:5837:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c3600/0xf4f48ce5e1bbf579 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a34ef expref: 23 pid: 5850 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789049501.994695:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.26@tcp, seq: 59 00000100:00100000:0.0:1789049501.994705:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb9009d5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e823b53a-3591-475c-8624-c682227e5c13+23:2357:x1875954089650688:12345-192.168.206.26@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789049501.994718:0:5837:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789049501.994737:0:5837:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c3600/0xf4f48ce5e1bbf579 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a34ef expref: 23 pid: 5850 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049501.994750:0:5837:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c3600/0xf4f48ce5e1bbf579 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a34ef expref: 23 pid: 5850 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049501.994772:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c3600/0xf4f48ce5e1bbf579 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a34ef expref: 23 pid: 5850 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049501.994787:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8cb8ce751200) 00010000:00010000:0.0:1789049501.994792:0:5837:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c3a00/0xf4f48ce5e1bbf66e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049501.994802:0:5837:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c3a00/0xf4f48ce5e1bbf66e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049501.994809:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c3a00/0xf4f48ce5e1bbf66e lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049501.994971:0:5837:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789049501.995020:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb9009d5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e823b53a-3591-475c-8624-c682227e5c13+22:2357:x1875954089650688:12345-192.168.206.26@tcp:103:ldlm_bl.0 Request processed in 316us (513us total) trans 0 rc 0/0 00000100:00100000:0.0:1789049501.995028:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.26@tcp, seq: 59 00010000:00010000:2.0:1789049501.996756:0:5851:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c3a00/0xf4f48ce5e1bbf66e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049501.996771:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c3a00/0xf4f48ce5e1bbf66e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789049501.996818:0:5851:0:(mdt_handler.c:922:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:2.0:1789049501.996822:0:5851:0:(mdt_handler.c:1587:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1789049501.996907:0:5851:0:(mdt_handler.c:2522:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c3a00/0xf4f48ce5e1bbf66e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049501.996924:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c3a00/0xf4f48ce5e1bbf66e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049501.996933:0:5851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c3200/0xf4f48ce5e1bbf660 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049501.996939:0:5851:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c3200/0xf4f48ce5e1bbf660 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049501.996946:0:5851:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c3200/0xf4f48ce5e1bbf660 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049501.996952:0:5851:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cb8c28c3200 already unused, calling callback (ffffffffc20ca4f0) 00010000:00010000:2.0:1789049501.996955:0:5851:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c3200/0xf4f48ce5e1bbf660 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049501.996962:0:5851:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c3200/0xf4f48ce5e1bbf660 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049501.996975:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8cb8c396df00) 00010000:00010000:2.0:1789049501.996994:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789049501.996999:0:5851:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c3200/0xf4f48ce5e1bbf660 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049501.997005:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c3200/0xf4f48ce5e1bbf660 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049501.997021:0:5851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c2200/0xf4f48ce5e1bbf667 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049501.997027:0:5851:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c2200/0xf4f48ce5e1bbf667 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049501.997032:0:5851:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c2200/0xf4f48ce5e1bbf667 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049501.997037:0:5851:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cb8c28c2200 already unused, calling callback (ffffffffc20ca4f0) 00010000:00010000:2.0:1789049501.997040:0:5851:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c2200/0xf4f48ce5e1bbf667 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049501.997046:0:5851:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c2200/0xf4f48ce5e1bbf667 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049501.997054:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8cb8c396dc00) 00010000:00010000:2.0:1789049501.997057:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789049501.997059:0:5851:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c2200/0xf4f48ce5e1bbf667 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049501.997065:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c2200/0xf4f48ce5e1bbf667 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049501.997182:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c3400/0xf4f48ce5e1bbf659 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a352e expref: 22 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049501.997209:0:5851:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c3a00/0xf4f48ce5e1bbf66e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a352e expref: 21 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049501.997216:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8cb8ce751200) 00010000:00010000:2.0:1789049501.997219:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789049501.997221:0:5851:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cb8c28c3a00, rc 0) 00000100:00100000:2.0:1789049501.997387:0:5851:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8df483100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e823b53a-3591-475c-8624-c682227e5c13+21:10536:x1875954089650304:12345-192.168.206.26@tcp:101:lfs.0 Request processed in 15238us (15429us total) trans 0 rc 0/0 00000100:00100000:2.0:1789049501.997395:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.26@tcp, seq: 129 00000100:00100000:0.0:1789049502.107625:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb900a1ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3309:1875954110630016:0@lo:400:kworker.0 00000100:00100000:0.0:1789049502.107902:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789049502.107949:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb8f73c5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3309:1875954110630528:0@lo:400:kworker.0 00000100:00100000:0.0:1789049502.107978:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789049502.108008:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:0.0:1789049502.108014:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb900a1dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:7ef694ec-1ea0-4f02-800c-d1279b4fdf12:3309:1875954110629888:0@lo:400:kworker.0 00000100:00100000:0.0:1789049502.108049:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789049502.108076:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb8c6320a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3309:1875954110630400:0@lo:400:kworker.0 00000100:00100000:0.0:1789049502.108099:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789049502.108186:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb8fc99a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3310:1875954110630144:0@lo:400:kworker.0 00000100:00100000:0.0:1789049502.108211:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789049502.110569:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb8fc999500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3311:1875954110630272:0@lo:400:kworker.0 00000100:00100000:2.0:1789049502.110699:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789049502.111499:0:6703:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954110630528 00000100:00100000:1.0:1789049502.111514:0:6703:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954110630528 00000100:00100000:1.0:1789049502.111562:0:6703:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954110630272 00000100:00100000:1.0:1789049502.111566:0:6703:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954110630272 00000100:00100000:1.0:1789049502.111587:0:6703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1789049502.111595:0:6703:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8c633fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+9:3309:x1875954110630528:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789049502.112129:0:6703:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8c633fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+9:3309:x1875954110630528:12345-0@lo:400:kworker.0 Request processed in 533us (4153us total) trans 0 rc 0/0 00000100:00100000:1.0:1789049502.112137:0:6703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1789049502.112154:0:6703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1789049502.112161:0:6703:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb9009d4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3311:x1875954110630272:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789049502.112201:0:6703:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb9009d4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3311:x1875954110630272:12345-0@lo:400:kworker.0 Request processed in 42us (1503us total) trans 0 rc 0/0 00000100:00100000:1.0:1789049502.112206:0:6703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00080000:1.0:1789049502.112221:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789049502.112602:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954110629888 00000100:00100000:0.0:1789049502.112609:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954110629888 00000100:00100000:0.0:1789049502.112643:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 286 00000100:00100000:0.0:1789049502.112649:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8c6294850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7ef694ec-1ea0-4f02-800c-d1279b4fdf12+19:3309:x1875954110629888:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789049502.112707:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8c6294850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7ef694ec-1ea0-4f02-800c-d1279b4fdf12+19:3309:x1875954110629888:12345-0@lo:400:kworker.0 Request processed in 58us (4657us total) trans 0 rc 0/0 00000100:00100000:0.0:1789049502.112714:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 286 00000100:00100000:0.0:1789049502.112752:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb8df260e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1875954110630656:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789049502.112779:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789049502.112860:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb900a1dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:7ef694ec-1ea0-4f02-800c-d1279b4fdf12:3309:1875954110629888:0@lo:400:kworker.0 00000100:00100000:0.0:1789049502.112874:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb8f73c5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3309:1875954110630528:0@lo:400:kworker.0 00000100:00100000:1.0:1789049502.117167:0:6707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954110630656 00000100:00100000:1.0:1789049502.117182:0:6707:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954110630656 00000100:00100000:1.0:1789049502.117236:0:6707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1789049502.117245:0:6707:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8df29aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+9:3310:x1875954110630656:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789049502.117275:0:6707:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 51052544 pending 3407872 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789049502.117352:0:6707:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8df29aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+9:3310:x1875954110630656:12345-0@lo:13:osp-pre-1-0.0 Request processed in 108us (4572us total) trans 0 rc 0/0 00000100:00100000:1.0:1789049502.117359:0:6707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1789049502.117413:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb8fc999500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3311:1875954110630272:0@lo:400:kworker.0 00000100:00100000:1.0:1789049502.117456:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb8df260e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1875954110630656:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789049502.120427:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954110630016 00000100:00100000:3.0:1789049502.120443:0:5852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954110630016 00000100:00100000:3.0:1789049502.120546:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954110630400 00000100:00100000:3.0:1789049502.120550:0:5851:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954110630400 00000100:00100000:3.0:1789049502.120580:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954110630144 00000100:00100000:3.0:1789049502.120583:0:5851:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954110630144 00000100:00100000:3.0:1789049502.120604:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:3.0:1789049502.120613:0:5851:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8d0ab4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1875954110630016:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789049502.121963:0:5851:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8d0ab4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1875954110630016:12345-0@lo:400:kworker.0 Request processed in 1344us (14065us total) trans 0 rc 0/0 00000100:00100000:3.0:1789049502.121973:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00000100:00100000:3.0:1789049502.122001:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:3.0:1789049502.122011:0:5851:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8c633ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1875954110630400:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789049502.122038:0:5851:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8c633ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1875954110630400:12345-0@lo:400:kworker.0 Request processed in 31us (13938us total) trans 0 rc 0/0 00000100:00100000:3.0:1789049502.122044:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00100000:3.0:1789049502.122053:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:3.0:1789049502.122059:0:5851:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8c59cb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1875954110630144:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789049502.122087:0:5851:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8c59cb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1875954110630144:12345-0@lo:400:kworker.0 Request processed in 28us (13875us total) trans 0 rc 0/0 00000100:00100000:3.0:1789049502.122093:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00080000:3.0:1789049502.122110:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789049502.122142:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb8fc99a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3310:1875954110630144:0@lo:400:kworker.0 00000100:00100000:0.0:1789049502.122959:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb8c6320a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3309:1875954110630400:0@lo:400:kworker.0 00000100:00100000:0.0:1789049502.122973:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb900a1ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3309:1875954110630016:0@lo:400:kworker.0 00000001:00080000:3.0:1789049502.245554:0:7663:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967300 is committed 00000001:00080000:3.0:1789049502.245579:0:7663:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967302 is committed 00000001:00080000:3.0:1789049502.245609:0:7663:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967301 is committed 00000001:00080000:3.0:1789049502.245618:0:7663:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967303 is committed 00000001:00080000:3.0:1789049502.245625:0:7663:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967304 is committed 00010000:00010000:0.0:1789049502.434896:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1789049502.760271:0:12069:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1789049502.760282:0:12069:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1789049502.760332:0:12069:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:3.0:1789049502.760337:0:12069:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000040:00080000:0.0:1789049503.003182:0:11704:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1789049503.003192:0:11704:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1789049503.003230:0:11704:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:0.0:1789049503.003238:0:11704:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1789049503.004155:0:11704:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb8df29a680 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11704:1875954110630784:192.168.206.26@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1789049503.004327:0:11704:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cb8c6b2a240 going to sleep for 11 seconds 00000100:00100000:3.0:1789049503.014656:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.26@tcp (source: 12345-192.168.206.26@tcp) 00000100:00100000:2.0:1789049503.015065:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954089650816 00000100:00100000:2.0:1789049503.015074:0:5851:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954089650816 00000100:00100000:2.0:1789049503.015149:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.26@tcp, seq: 130 00000100:00100000:2.0:1789049503.015159:0:5851:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8df261500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e823b53a-3591-475c-8624-c682227e5c13+22:10548:x1875954089650816:12345-192.168.206.26@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1789049503.015191:0:5851:0:(mdt_handler.c:7990:mdt_fid2path()) path get [0x200000401:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1789049503.015289:0:5851:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8df261500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e823b53a-3591-475c-8624-c682227e5c13+22:10548:x1875954089650816:12345-192.168.206.26@tcp:53:lhsmtool_posix.0 Request processed in 131us (641us total) trans 0 rc 0/0 00000100:00100000:2.0:1789049503.015297:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.26@tcp, seq: 130 00000100:00080000:3.0:1789049503.015722:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789049503.015969:0:11704:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb8df29a680 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11704:1875954110630784:192.168.206.26@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1789049503.020571:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.26@tcp (source: 12345-192.168.206.26@tcp) 00000100:00100000:2.0:1789049503.020725:0:6841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954089651072 00000100:00100000:2.0:1789049503.020735:0:6841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954089651072 00000100:00100000:2.0:1789049503.020793:0:6841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.26@tcp, seq: 131 00000100:00100000:2.0:1789049503.020803:0:6841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8df20ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e823b53a-3591-475c-8624-c682227e5c13+21:10548:x1875954089651072:12345-192.168.206.26@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789049503.020824:0:6841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789049503.020994:0:6841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6714a00/0xf4f48ce5e1bbf675 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7fc5e358805a3535 expref: -99 pid: 6841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049503.021084:0:6841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6715200/0xf4f48ce5e1bbf67c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049503.021099:0:6841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6715200/0xf4f48ce5e1bbf67c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049503.021113:0:6841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6715200/0xf4f48ce5e1bbf67c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6841 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789049503.021125:0:6841:0:(mdt_handler.c:922:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:2.0:1789049503.021348:0:6841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6714a00/0xf4f48ce5e1bbf675 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a3535 expref: 24 pid: 6841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049503.021368:0:6841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6715200/0xf4f48ce5e1bbf67c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a3535 expref: 23 pid: 6841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049503.021377:0:6841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8cb8ce751200) 00010000:00010000:2.0:1789049503.021380:0:6841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789049503.021384:0:6841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cb8d6715200, rc 0) 00000100:00100000:2.0:1789049503.021486:0:6841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8df20ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e823b53a-3591-475c-8624-c682227e5c13+23:10548:x1875954089651072:12345-192.168.206.26@tcp:101:lhsmtool_posix.0 Request processed in 683us (923us total) trans 4294967414 rc 0/0 00000100:00100000:2.0:1789049503.021495:0:6841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.26@tcp, seq: 131 00000100:00100000:2.0:1789049503.027907:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.26@tcp (source: 12345-192.168.206.26@tcp) 00000100:00100000:3.0:1789049503.027971:0:6720:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954089651200 00000100:00100000:3.0:1789049503.027980:0:6720:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954089651200 00000100:00100000:3.0:1789049503.028033:0:6720:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.26@tcp, seq: 8 00000100:00100000:3.0:1789049503.028042:0:6720:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8f7747480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e823b53a-3591-475c-8624-c682227e5c13+23:2357:x1875954089651200:12345-192.168.206.26@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789049503.028056:0:6720:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789049503.028078:0:6720:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6715200/0xf4f48ce5e1bbf67c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a3535 expref: 23 pid: 6841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049503.028110:0:6720:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8cb8ce751200) 00010000:00010000:3.0:1789049503.028116:0:6720:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789049503.028169:0:6720:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8f7747480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e823b53a-3591-475c-8624-c682227e5c13+22:2357:x1875954089651200:12345-192.168.206.26@tcp:103:ldlm_bl.0 Request processed in 127us (270us total) trans 0 rc 0/0 00000100:00100000:3.0:1789049503.028176:0:6720:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.26@tcp, seq: 8 00000100:00100000:2.0:1789049503.030746:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.26@tcp (source: 12345-192.168.206.26@tcp) 00000100:00100000:3.0:1789049503.030828:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954089651456 00000100:00100000:3.0:1789049503.030838:0:5851:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954089651456 00000100:00100000:3.0:1789049503.030942:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.26@tcp, seq: 132 00000100:00100000:3.0:1789049503.030952:0:5851:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8f7746300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e823b53a-3591-475c-8624-c682227e5c13+22:10548:x1875954089651456:12345-192.168.206.26@tcp:57:lhsmtool_posix.0 00010000:00010000:3.0:1789049503.031025:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c6b35400/0xf4f48ce5e1bbf68a lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049503.031053:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c6b35400/0xf4f48ce5e1bbf68a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049503.031065:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c6b35400/0xf4f48ce5e1bbf68a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049503.031253:0:5851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c6b35400/0xf4f48ce5e1bbf68a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049503.031261:0:5851:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c6b35400/0xf4f48ce5e1bbf68a lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049503.031267:0:5851:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c6b35400/0xf4f48ce5e1bbf68a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049503.031273:0:5851:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cb8c6b35400 already unused, calling callback (ffffffffc20ca4f0) 00010000:00010000:3.0:1789049503.031277:0:5851:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c6b35400/0xf4f48ce5e1bbf68a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049503.031285:0:5851:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c6b35400/0xf4f48ce5e1bbf68a lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049503.031296:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8cb8ce751200) 00010000:00010000:3.0:1789049503.031298:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1789049503.031303:0:5851:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c6b35400/0xf4f48ce5e1bbf68a lrc: 2/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049503.031309:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c6b35400/0xf4f48ce5e1bbf68a lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789049503.031448:0:5851:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8f7746300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e823b53a-3591-475c-8624-c682227e5c13+23:10548:x1875954089651456:12345-192.168.206.26@tcp:57:lhsmtool_posix.0 Request processed in 497us (711us total) trans 4294967415 rc 0/0 00000100:00100000:3.0:1789049503.031463:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.26@tcp, seq: 132 00000040:00080000:0.0:1789049503.031785:0:11704:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1789049503.031789:0:11704:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1789049503.032243:0:11704:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:0.0:1789049503.032252:0:11704:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1789049503.035806:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.26@tcp (source: 12345-192.168.206.26@tcp) 00000100:00100000:2.0:1789049503.036005:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954089651712 00000100:00100000:2.0:1789049503.036015:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954089651712 00000100:00100000:2.0:1789049503.036063:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.26@tcp, seq: 34 00000100:00100000:2.0:1789049503.036079:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8df20aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e823b53a-3591-475c-8624-c682227e5c13+23:10548:x1875954089651712:12345-192.168.206.26@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1789049503.036323:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8df20aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e823b53a-3591-475c-8624-c682227e5c13+24:10548:x1875954089651712:12345-192.168.206.26@tcp:35:lhsmtool_posix.0 Request processed in 244us (525us total) trans 4294967416 rc 0/0 00000100:00100000:2.0:1789049503.036330:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.26@tcp, seq: 34 00000100:00100000:2.0:1789049503.042723:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.26@tcp (source: 12345-192.168.206.26@tcp) 00000100:00100000:2.0:1789049503.042764:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.26@tcp (source: 12345-192.168.206.26@tcp) 00000100:00100000:2.0:1789049503.042803:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.26@tcp (source: 12345-192.168.206.26@tcp) 00000100:00100000:1.0:1789049503.042926:0:6703:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954089651968 00000100:00100000:1.0:1789049503.042936:0:6703:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954089651968 00000100:00100000:1.0:1789049503.042998:0:6703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.26@tcp, seq: 61 00000100:00100000:1.0:1789049503.043008:0:6703:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8ff3ece00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e823b53a-3591-475c-8624-c682227e5c13+6:2355:x1875954089651968:12345-192.168.206.26@tcp:400:kworker.0 00000100:00100000:1.0:1789049503.043080:0:6703:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8ff3ece00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e823b53a-3591-475c-8624-c682227e5c13+6:2355:x1875954089651968:12345-192.168.206.26@tcp:400:kworker.0 Request processed in 74us (366us total) trans 0 rc 0/0 00000100:00100000:1.0:1789049503.043088:0:6703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.26@tcp, seq: 61 00000100:00080000:1.0:1789049503.043126:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789049503.043309:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.26@tcp (source: 12345-192.168.206.26@tcp) 00000100:00100000:1.0:1789049503.043385:0:10560:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954089652096 00000100:00100000:1.0:1789049503.043390:0:10560:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954089652096 00000100:00100000:1.0:1789049503.043433:0:10560:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.26@tcp, seq: 62 00000100:00100000:1.0:1789049503.043441:0:10560:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8ff3ee300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e823b53a-3591-475c-8624-c682227e5c13+5:2355:x1875954089652096:12345-192.168.206.26@tcp:400:kworker.0 00000100:00100000:1.0:1789049503.043476:0:10560:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8ff3ee300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e823b53a-3591-475c-8624-c682227e5c13+5:2355:x1875954089652096:12345-192.168.206.26@tcp:400:kworker.0 Request processed in 36us (168us total) trans 0 rc 0/0 00000100:00100000:1.0:1789049503.043483:0:10560:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.26@tcp, seq: 62 00000100:00100000:3.0:1789049503.043563:0:6841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954089652224 00000100:00100000:3.0:1789049503.043568:0:6841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954089652224 00000100:00100000:3.0:1789049503.043609:0:6841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.26@tcp, seq: 136 00000100:00100000:3.0:1789049503.043617:0:6841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8ff3ee680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:59d63492-f1ee-4aa5-bf8c-853a603b0252+5:2355:x1875954089652224:12345-192.168.206.26@tcp:400:kworker.0 00000100:00100000:3.0:1789049503.043652:0:6841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8ff3ee680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:59d63492-f1ee-4aa5-bf8c-853a603b0252+5:2355:x1875954089652224:12345-192.168.206.26@tcp:400:kworker.0 Request processed in 36us (887us total) trans 0 rc 0/0 00000100:00100000:3.0:1789049503.043659:0:6841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.26@tcp, seq: 136 00000100:00080000:2.0:1789049503.043718:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789049503.043722:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789049503.049287:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954089651840 00000100:00100000:0.0:1789049503.049302:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954089651840 00000100:00100000:0.0:1789049503.049376:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.26@tcp, seq: 287 00000100:00100000:0.0:1789049503.049387:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8c6295c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:de93d576-ed8d-4d27-ab00-9189a62cea33+13:2355:x1875954089651840:12345-192.168.206.26@tcp:400:kworker.0 00000100:00100000:0.0:1789049503.049476:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8c6295c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:de93d576-ed8d-4d27-ab00-9189a62cea33+13:2355:x1875954089651840:12345-192.168.206.26@tcp:400:kworker.0 Request processed in 91us (6672us total) trans 0 rc 0/0 00000100:00100000:0.0:1789049503.049484:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.26@tcp, seq: 287 00010000:00010000:0.0:1789049503.451085:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789049504.476694:0:6719:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1789049504.558323:0:12121:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1789049504.558332:0:12121:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1789049504.558376:0:12121:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:1.0:1789049504.558384:0:12121:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1789049504.722494:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.26@tcp (source: 12345-192.168.206.26@tcp) 00000100:00100000:3.0:1789049504.722554:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954089652480 00000100:00100000:3.0:1789049504.722564:0:5851:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954089652480 00000100:00100000:3.0:1789049504.722630:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.26@tcp, seq: 133 00000100:00100000:3.0:1789049504.722640:0:5851:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8ff3edc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e823b53a-3591-475c-8624-c682227e5c13+24:10569:x1875954089652480:12345-192.168.206.26@tcp:101:lfs.0 00010000:00010000:3.0:1789049504.722662:0:5851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789049504.722681:0:5851:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c6b35400/0xf4f48ce5e1bbf691 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7fc5e358805a353c expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049504.722773:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c6b35c00/0xf4f48ce5e1bbf698 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049504.722788:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c6b35c00/0xf4f48ce5e1bbf698 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049504.722800:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c6b35c00/0xf4f48ce5e1bbf698 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789049504.722812:0:5851:0:(mdt_handler.c:922:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:3.0:1789049504.722961:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c6b35400/0xf4f48ce5e1bbf691 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a353c expref: 27 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049504.722999:0:5851:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c6b35c00/0xf4f48ce5e1bbf698 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a353c expref: 26 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049504.723008:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8cb8ce751200) 00010000:00010000:3.0:1789049504.723011:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:3.0:1789049504.723014:0:5851:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cb8c6b35c00, rc 0) 00000100:00100000:3.0:1789049504.723085:0:5851:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8ff3edc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e823b53a-3591-475c-8624-c682227e5c13+26:10569:x1875954089652480:12345-192.168.206.26@tcp:101:lfs.0 Request processed in 445us (597us total) trans 4294967417 rc 0/0 00000100:00100000:3.0:1789049504.723322:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.26@tcp, seq: 133 00000100:00100000:3.0:1789049504.726755:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.26@tcp (source: 12345-192.168.206.26@tcp) 00000100:00100000:0.0:1789049504.726922:0:6841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954089652608 00000100:00100000:0.0:1789049504.726931:0:6841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954089652608 00000100:00100000:0.0:1789049504.727020:0:6841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.26@tcp, seq: 134 00000100:00100000:0.0:1789049504.727032:0:6841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8df260e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e823b53a-3591-475c-8624-c682227e5c13+26:10569:x1875954089652608:12345-192.168.206.26@tcp:54:lfs.0 00010000:00010000:0.0:1789049504.727119:0:6841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb7c4c39a00/0xf4f48ce5e1bbf6a6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049504.727136:0:6841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cb7c4c39a00/0xf4f48ce5e1bbf6a6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049504.727148:0:6841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb7c4c39a00/0xf4f48ce5e1bbf6a6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049504.727176:0:6841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb7c4c39a00/0xf4f48ce5e1bbf6a6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049504.727192:0:6841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cb7c4c39a00/0xf4f48ce5e1bbf6a6 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049504.727198:0:6841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cb7c4c39a00/0xf4f48ce5e1bbf6a6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049504.727205:0:6841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cb7c4c39a00 already unused, calling callback (ffffffffc20ca4f0) 00010000:00010000:0.0:1789049504.727209:0:6841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb7c4c39a00/0xf4f48ce5e1bbf6a6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049504.727216:0:6841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb7c4c39a00/0xf4f48ce5e1bbf6a6 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049504.727226:0:6841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8cb8ce751200) 00010000:00010000:0.0:1789049504.727229:0:6841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1789049504.727234:0:6841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cb7c4c39a00/0xf4f48ce5e1bbf6a6 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049504.727240:0:6841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb7c4c39a00/0xf4f48ce5e1bbf6a6 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6841 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789049504.727307:0:6841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8df260e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e823b53a-3591-475c-8624-c682227e5c13+26:10569:x1875954089652608:12345-192.168.206.26@tcp:54:lfs.0 Request processed in 278us (560us total) trans 0 rc 0/0 00000100:00100000:0.0:1789049504.727315:0:6841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.26@tcp, seq: 134 00000100:00100000:2.0:1789049504.845370:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.26@tcp (source: 12345-192.168.206.26@tcp) 00000100:00100000:1.0:1789049504.845543:0:6703:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954089652736 00000100:00100000:1.0:1789049504.845553:0:6703:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954089652736 00000100:00100000:1.0:1789049504.845605:0:6703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.26@tcp, seq: 46 00000100:00100000:1.0:1789049504.845614:0:6703:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8ff3ef800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e823b53a-3591-475c-8624-c682227e5c13+6:2358:x1875954089652736:12345-192.168.206.26@tcp:101:cat.0 00010000:00010000:1.0:1789049504.845630:0:6703:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789049504.845650:0:6703:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000059a1f1e5/0xf4f48ce5e1bbf6ad lrc: 2/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x7fc5e358805a3543 expref: -99 pid: 6703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1789049504.845693:0:6703:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x4:0x0] initial LVB size: 13, mtime: 0x18d3fb0abbba1c80, atime: 0x18d3fb0aa607e980, ctime: 0x18d3fb0abbba1c80, blocks: 0xb 00010000:00010000:1.0:1789049504.845711:0:6703:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=330s v=(0 0) 00010000:00010000:1.0:1789049504.845716:0:6703:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789049504.845725:0:6703:0:(ldlm_resource.c:1751:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000059a1f1e5/0xf4f48ce5e1bbf6ad lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a3543 expref: 7 pid: 6703 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049504.845743:0:6703:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000059a1f1e5/0xf4f48ce5e1bbf6ad lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a3543 expref: 7 pid: 6703 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049504.845755:0:6703:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cb8c28c3e00, rc 0) 00000100:00100000:1.0:1789049504.845804:0:6703:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8ff3ef800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e823b53a-3591-475c-8624-c682227e5c13+7:2358:x1875954089652736:12345-192.168.206.26@tcp:101:cat.0 Request processed in 191us (445us total) trans 0 rc 0/0 00000100:00100000:1.0:1789049504.845810:0:6703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.26@tcp, seq: 46 00000100:00100000:2.0:1789049504.855770:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.26@tcp (source: 12345-192.168.206.26@tcp) 00000100:00100000:3.0:1789049504.855964:0:6708:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954089652864 00000100:00100000:3.0:1789049504.855974:0:6708:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954089652864 00002000:00100000:3.0:1789049504.856029:0:6708:0:(ofd_dev.c:2725:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x4:0x0] (0->4095) req@ffff8cb8ff3eca80 x1875954089652864/t0(0) o3->e823b53a-3591-475c-8624-c682227e5c13@192.168.206.26@tcp:5/0 lens 488/0 e 0 to 0 dl 1789049515 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789049504.856039:0:6708:0:(ofd_dev.c:2581:ofd_prolong_extent_locks()) Prolong locks for req ffff8cb8ff3eca80 with x1875954089652864 ext(0->4095) 00002000:00010000:3.0:1789049504.856045:0:6708:0:(ofd_dev.c:2730:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8cb8ff3eca80 00000100:00100000:3.0:1789049504.856083:0:6708:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.26@tcp, seq: 3 00000100:00100000:3.0:1789049504.856092:0:6708:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8ff3eca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:e823b53a-3591-475c-8624-c682227e5c13+7:2355:x1875954089652864:12345-192.168.206.26@tcp:3:cat.0 00000100:00100000:3.0:1789049504.856305:0:6708:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8ff3eca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:e823b53a-3591-475c-8624-c682227e5c13+7:2355:x1875954089652864:12345-192.168.206.26@tcp:3:cat.0 Request processed in 213us (544us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1789049504.856320:0:6708:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.26@tcp, seq: 3 00002000:00100000:3.0:1789049504.856328:0:6708:0:(ofd_dev.c:2725:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x4:0x0] (0->4095) req@ffff8cb8ff3eca80 x1875954089652864/t0(0) o3->e823b53a-3591-475c-8624-c682227e5c13@192.168.206.26@tcp:5/0 lens 488/4536 e 0 to 0 dl 1789049515 ref 1 fl Complete:/600/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789049504.856337:0:6708:0:(ofd_dev.c:2581:ofd_prolong_extent_locks()) Prolong locks for req ffff8cb8ff3eca80 with x1875954089652864 ext(0->4095) 00002000:00010000:3.0:1789049504.856347:0:6708:0:(ofd_dev.c:2730:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8cb8ff3eca80 00010000:00010000:0.0:1789049505.500684:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789049506.204180:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb8ff3ed180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3311:1875954110630912:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789049506.204249:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789049506.207917:0:6707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954110630912 00000100:00100000:0.0:1789049506.207930:0:6707:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954110630912 00000100:00080000:2.0:1789049506.207967:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789049506.208128:0:6707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1789049506.208139:0:6707:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8df208000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3311:x1875954110630912:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789049506.208186:0:6707:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789049506.212161:0:6707:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8df208000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3311:x1875954110630912:12345-0@lo:13:osp-pre-0-0.0 Request processed in 4015us (7902us total) trans 0 rc 0/0 00000100:00100000:0.0:1789049506.212233:0:6707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1789049506.215932:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb8ff3ed180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3311:1875954110630912:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1789049506.523076:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789049507.227152:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1789049507.227184:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb8d0aadc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3309:1875954110631040:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789049507.227287:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789049507.227464:0:6706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954110631040 00000100:00100000:3.0:1789049507.227475:0:6706:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954110631040 00000100:00100000:3.0:1789049507.227559:0:6706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1789049507.227572:0:6706:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8df209f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1875954110631040:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789049507.227619:0:6706:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789049507.227674:0:6706:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8df209f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1875954110631040:12345-0@lo:13:osp-pre-1-0.0 Request processed in 105us (387us total) trans 0 rc 0/0 00000100:00100000:3.0:1789049507.227682:0:6706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1789049507.227731:0:3309:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967304 gen 2 00000004:00080000:3.0:1789049507.227739:0:3309:0:(osp_trans.c:1063:osp_request_commit_cb()) trans no 4294967300 committed transno 4294967304 00000004:00080000:3.0:1789049507.227764:0:3309:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8cb8ff3c8000, transno 4294967301 00000004:00080000:3.0:1789049507.227775:0:3309:0:(osp_trans.c:1063:osp_request_commit_cb()) trans no 4294967303 committed transno 4294967304 00000004:00080000:3.0:1789049507.227786:0:3309:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8cb8d0aafb80, transno 4294967304 00000100:00100000:3.0:1789049507.227799:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb8d0aadc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3309:1875954110631040:0@lo:13:osp-pre-1-0.0 00000100:00080000:1.0:1789049507.230903:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789049507.236801:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb900a55500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1875954110631552:0@lo:400:kworker.0 00000100:00100000:2.0:1789049507.236928:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789049507.236987:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1789049507.236995:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb8ff3ec000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7ef694ec-1ea0-4f02-800c-d1279b4fdf12:3308:1875954110631168:0@lo:400:kworker.0 00000100:00100000:2.0:1789049507.237030:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789049507.237052:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb900a55180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3308:1875954110631680:0@lo:400:kworker.0 00000100:00100000:2.0:1789049507.237078:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789049507.237109:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb8ff3ed180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3310:1875954110631296:0@lo:400:kworker.0 00000100:00100000:2.0:1789049507.237134:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789049507.237154:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789049507.237160:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb900a54e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3310:1875954110631424:0@lo:400:kworker.0 00000100:00100000:3.0:1789049507.238453:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954110631680 00000100:00100000:3.0:1789049507.238469:0:5851:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954110631680 00000100:00100000:3.0:1789049507.238540:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954110631296 00000100:00100000:3.0:1789049507.238545:0:5851:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954110631296 00000100:00100000:3.0:1789049507.238572:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:3.0:1789049507.238583:0:5851:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb900a54000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1875954110631680:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789049507.240012:0:5851:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb900a54000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1875954110631680:12345-0@lo:400:kworker.0 Request processed in 1423us (2925us total) trans 0 rc 0/0 00000100:00100000:3.0:1789049507.240027:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00100000:3.0:1789049507.240062:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:3.0:1789049507.240074:0:5851:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8ff3c8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1875954110631296:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789049507.240124:0:5851:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8ff3c8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1875954110631296:12345-0@lo:400:kworker.0 Request processed in 54us (2989us total) trans 0 rc 0/0 00000100:00100000:3.0:1789049507.240142:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00080000:3.0:1789049507.245312:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789049507.245394:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb900a55180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3308:1875954110631680:0@lo:400:kworker.0 00000100:00100000:2.0:1789049507.247759:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789049507.247897:0:10560:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954110631552 00000100:00100000:2.0:1789049507.247908:0:10560:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954110631552 00000100:00100000:2.0:1789049507.247983:0:10560:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1789049507.247994:0:10560:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb900a56680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3308:x1875954110631552:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789049507.248103:0:10560:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb900a56680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3308:x1875954110631552:12345-0@lo:400:kworker.0 Request processed in 110us (11175us total) trans 0 rc 0/0 00000100:00100000:2.0:1789049507.248111:0:10560:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1789049507.248141:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954110631168 00000100:00100000:2.0:1789049507.248145:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954110631168 00000100:00100000:2.0:1789049507.248173:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 288 00000100:00100000:2.0:1789049507.248180:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8c6296c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7ef694ec-1ea0-4f02-800c-d1279b4fdf12+19:3308:x1875954110631168:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789049507.248215:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8c6296c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7ef694ec-1ea0-4f02-800c-d1279b4fdf12+19:3308:x1875954110631168:12345-0@lo:400:kworker.0 Request processed in 36us (11185us total) trans 0 rc 0/0 00000100:00100000:2.0:1789049507.248222:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 288 00000100:00100000:2.0:1789049507.248256:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954110631424 00000100:00100000:2.0:1789049507.248260:0:5852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954110631424 00000100:00100000:2.0:1789049507.248302:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:2.0:1789049507.248322:0:5852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8ff3c9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1875954110631424:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789049507.248357:0:5852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8ff3c9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1875954110631424:12345-0@lo:400:kworker.0 Request processed in 48us (608us total) trans 0 rc 0/0 00000100:00100000:2.0:1789049507.248363:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00080000:2.0:1789049507.249217:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789049507.249264:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb8ff3ec000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7ef694ec-1ea0-4f02-800c-d1279b4fdf12:3308:1875954110631168:0@lo:400:kworker.0 00000100:00100000:2.0:1789049507.249286:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb900a55500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1875954110631552:0@lo:400:kworker.0 00000100:00100000:2.0:1789049507.249344:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb900a54e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3310:1875954110631424:0@lo:400:kworker.0 00000100:00100000:2.0:1789049507.249358:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb8ff3ed180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3310:1875954110631296:0@lo:400:kworker.0 00000001:00080000:0.0:1789049507.301775:0:6731:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967311 is committed 00000001:00080000:0.0:1789049507.301794:0:6731:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967312 is committed 00000020:00080000:1.0:1789049507.318911:0:5872:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 3 batchid updated 00000001:00080000:1.0:1789049507.318939:0:5872:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967416 is committed 00000001:00080000:1.0:1789049507.318964:0:5872:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967417 is committed 00000020:00080000:1.0:1789049507.318990:0:5872:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8cb8c63eacc0 refcount 2 committed 0 result 0 batchid 4 00000020:00080000:1.0:1789049507.319003:0:5872:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8cb8c801d000 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8cb8c63eac00 00000020:00080000:1.0:1789049507.319007:0:5872:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8cb8c801d200 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8cb8f7b20400 00000020:00080000:3.0:1789049507.319060:0:5883:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 4 committed batchid 3 00000020:00080000:3.0:1789049507.319465:0:5883:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 3 00010000:00010000:1.0:1789049507.548933:0:6719:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789049508.167997:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.26@tcp (source: 12345-192.168.206.26@tcp) 00000100:00100000:2.0:1789049508.168054:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.26@tcp (source: 12345-192.168.206.26@tcp) 00000100:00100000:2.0:1789049508.168107:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.26@tcp (source: 12345-192.168.206.26@tcp) 00000100:00100000:2.0:1789049508.168134:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.26@tcp (source: 12345-192.168.206.26@tcp) 00000100:00100000:2.0:1789049508.168169:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.26@tcp (source: 12345-192.168.206.26@tcp) 00000100:00100000:2.0:1789049508.168216:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954089653504 00000100:00100000:2.0:1789049508.168228:0:5852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954089653504 00000100:00100000:2.0:1789049508.168303:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954089653120 00000100:00100000:2.0:1789049508.168307:0:5852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954089653120 00000100:00100000:2.0:1789049508.168549:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.26@tcp, seq: 140 00000100:00100000:2.0:1789049508.168564:0:5852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8ff3ca300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:59d63492-f1ee-4aa5-bf8c-853a603b0252+5:2357:x1875954089653504:12345-192.168.206.26@tcp:400:kworker.0 00000100:00100000:2.0:1789049508.168662:0:5852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8ff3ca300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:59d63492-f1ee-4aa5-bf8c-853a603b0252+5:2357:x1875954089653504:12345-192.168.206.26@tcp:400:kworker.0 Request processed in 102us (565us total) trans 0 rc 0/0 00000100:00100000:2.0:1789049508.168670:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.26@tcp, seq: 140 00000100:00100000:2.0:1789049508.168689:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.26@tcp, seq: 141 00000100:00100000:2.0:1789049508.168695:0:5852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8ff3cb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e823b53a-3591-475c-8624-c682227e5c13+13:2357:x1875954089653120:12345-192.168.206.26@tcp:400:kworker.0 00000100:00100000:2.0:1789049508.168720:0:5852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8ff3cb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e823b53a-3591-475c-8624-c682227e5c13+13:2357:x1875954089653120:12345-192.168.206.26@tcp:400:kworker.0 Request processed in 26us (587us total) trans 0 rc 0/0 00000100:00100000:2.0:1789049508.168726:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.26@tcp, seq: 141 00000100:00100000:2.0:1789049508.168749:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954089653248 00000100:00100000:2.0:1789049508.168752:0:6704:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954089653248 00000100:00100000:2.0:1789049508.168783:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954089653376 00000100:00100000:2.0:1789049508.168787:0:6704:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954089653376 00000100:00100000:2.0:1789049508.168810:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.26@tcp, seq: 64 00000100:00100000:2.0:1789049508.168817:0:6704:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8ff3cbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e823b53a-3591-475c-8624-c682227e5c13+6:2357:x1875954089653248:12345-192.168.206.26@tcp:400:kworker.0 00000100:00100000:0.0:1789049508.168900:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954089652992 00000100:00100000:2.0:1789049508.168907:0:6704:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8ff3cbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e823b53a-3591-475c-8624-c682227e5c13+6:2357:x1875954089653248:12345-192.168.206.26@tcp:400:kworker.0 Request processed in 27us (789us total) trans 0 rc 0/0 00000100:00100000:0.0:1789049508.168907:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954089652992 00000100:00100000:2.0:1789049508.168933:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.26@tcp, seq: 64 00000100:00100000:2.0:1789049508.168951:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.26@tcp, seq: 65 00000100:00100000:2.0:1789049508.168962:0:6704:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8ff3c8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e823b53a-3591-475c-8624-c682227e5c13+5:2357:x1875954089653376:12345-192.168.206.26@tcp:400:kworker.0 00000100:00100000:0.0:1789049508.168962:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.26@tcp, seq: 289 00000100:00100000:0.0:1789049508.168976:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8c6294450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:de93d576-ed8d-4d27-ab00-9189a62cea33+13:2357:x1875954089652992:12345-192.168.206.26@tcp:400:kworker.0 00000100:00100000:2.0:1789049508.168997:0:6704:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8ff3c8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e823b53a-3591-475c-8624-c682227e5c13+5:2357:x1875954089653376:12345-192.168.206.26@tcp:400:kworker.0 Request processed in 38us (827us total) trans 0 rc 0/0 00000100:00100000:2.0:1789049508.169004:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.26@tcp, seq: 65 00000100:00100000:0.0:1789049508.169018:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8c6294450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:de93d576-ed8d-4d27-ab00-9189a62cea33+13:2357:x1875954089652992:12345-192.168.206.26@tcp:400:kworker.0 Request processed in 44us (1035us total) trans 0 rc 0/0 00000100:00080000:2.0:1789049508.169025:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789049508.169026:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.26@tcp, seq: 289 00000100:00080000:2.0:1789049508.169033:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1789049508.169038:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1789049508.571092:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789049509.521197:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.26@tcp (source: 12345-192.168.206.26@tcp) 00000100:00100000:0.0:1789049509.521291:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954089653632 00000100:00100000:0.0:1789049509.521304:0:5852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954089653632 00000100:00100000:0.0:1789049509.521392:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.26@tcp, seq: 135 00000100:00100000:0.0:1789049509.521404:0:5852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8ff3ed180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e823b53a-3591-475c-8624-c682227e5c13+13:10222:x1875954089653632:12345-192.168.206.26@tcp:60:lhsmtool_posix.0 00000100:00100000:0.0:1789049509.521542:0:5852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8ff3ed180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e823b53a-3591-475c-8624-c682227e5c13+13:10222:x1875954089653632:12345-192.168.206.26@tcp:60:lhsmtool_posix.0 Request processed in 140us (359us total) trans 0 rc 0/0 00000100:00100000:0.0:1789049509.521550:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.26@tcp, seq: 135 00000100:00100000:1.0:1789049509.529700:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.26@tcp (source: 12345-192.168.206.26@tcp) 00000100:00100000:3.0:1789049509.529910:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954089653888 00000100:00100000:3.0:1789049509.529924:0:5853:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954089653888 00000100:00100000:3.0:1789049509.530002:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.26@tcp, seq: 35 00000100:00100000:3.0:1789049509.530015:0:5853:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8df208a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e823b53a-3591-475c-8624-c682227e5c13+13:10222:x1875954089653888:12345-192.168.206.26@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1789049509.530487:0:5853:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8df208a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e823b53a-3591-475c-8624-c682227e5c13+14:10222:x1875954089653888:12345-192.168.206.26@tcp:35:lhsmtool_posix.0 Request processed in 473us (801us total) trans 4294967418 rc 0/0 00000100:00100000:3.0:1789049509.530497:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.26@tcp, seq: 35 00010000:00010000:0.0:1789049509.595200:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1789049510.236142:0:11704:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1789049510.236156:0:11704:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1789049510.236513:0:11704:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 3 00000040:00080000:3.0:1789049510.237599:0:11704:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:1.0:1789049510.623570:0:6719:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789049511.325957:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789049511.325981:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb8ff3ec000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3311:1875954110631808:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789049511.326056:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789049511.326177:0:6706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954110631808 00000100:00100000:3.0:1789049511.326186:0:6706:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954110631808 00000100:00100000:3.0:1789049511.326253:0:6706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1789049511.326264:0:6706:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8df209880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1875954110631808:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789049511.326297:0:6706:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789049511.326346:0:6706:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8df209880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1875954110631808:12345-0@lo:13:osp-pre-0-0.0 Request processed in 86us (291us total) trans 0 rc 0/0 00000100:00100000:3.0:1789049511.326354:0:6706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1789049511.326407:0:3311:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967312 gen 2 00000004:00080000:3.0:1789049511.326413:0:3311:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8cb8df260380, transno 4294967310 00000004:00080000:3.0:1789049511.326442:0:3311:0:(osp_trans.c:1063:osp_request_commit_cb()) trans no 4294967312 committed transno 4294967312 00000100:00100000:3.0:1789049511.326488:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb8ff3ec000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3311:1875954110631808:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1789049511.326690:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:02000400:3.0:1789049511.469805:0:12319:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1b: Test manual lfs pcc attach with restore on remote access ========================================================== 10:11:49 (1789049509) 00010000:00010000:1.0:1789049511.645792:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789049512.347110:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb8ff3ec000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:7ef694ec-1ea0-4f02-800c-d1279b4fdf12:3311:1875954110631936:0@lo:400:kworker.0 00000100:00100000:2.0:1789049512.347185:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb8c581b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3309:1875954110632192:0@lo:400:kworker.0 00000100:00100000:2.0:1789049512.347222:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789049512.347264:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:2.0:1789049512.347269:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb8c5819f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3309:1875954110632064:0@lo:400:kworker.0 00000100:00100000:2.0:1789049512.347286:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789049512.347298:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb8c12a8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3309:1875954110632576:0@lo:400:kworker.0 00000100:00100000:3.0:1789049512.347308:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789049512.347319:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789049512.347353:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb8c12a8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3311:1875954110632448:0@lo:400:kworker.0 00000100:00100000:2.0:1789049512.347379:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954110632192 00000100:00100000:2.0:1789049512.347386:0:5851:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954110632192 00000100:00100000:3.0:1789049512.347387:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789049512.347412:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789049512.347419:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb8c12a9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3311:1875954110632320:0@lo:400:kworker.0 00000100:00100000:3.0:1789049512.347443:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789049512.347449:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954110632064 00000100:00100000:2.0:1789049512.347452:0:5851:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954110632064 00000100:00100000:2.0:1789049512.347469:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954110632448 00000100:00100000:2.0:1789049512.347471:0:5851:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954110632448 00000100:00100000:2.0:1789049512.347487:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:2.0:1789049512.347495:0:5851:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8c12a8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1875954110632192:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789049512.347521:0:6841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:3.0:1789049512.347532:0:6841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8c12a9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1875954110632064:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789049512.347548:0:5851:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8c12a8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1875954110632192:12345-0@lo:400:kworker.0 Request processed in 53us (325us total) trans 0 rc 0/0 00000100:00100000:2.0:1789049512.347556:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00100000:2.0:1789049512.347579:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:3.0:1789049512.347580:0:6841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8c12a9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1875954110632064:12345-0@lo:400:kworker.0 Request processed in 47us (288us total) trans 0 rc 0/0 00000100:00100000:2.0:1789049512.347588:0:5851:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8d0aafb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1875954110632448:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789049512.347592:0:6841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:3.0:1789049512.347620:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954110631936 00000100:00100000:3.0:1789049512.347624:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954110631936 00000100:00100000:2.0:1789049512.347626:0:5851:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8d0aafb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1875954110632448:12345-0@lo:400:kworker.0 Request processed in 41us (239us total) trans 0 rc 0/0 00000100:00100000:2.0:1789049512.347633:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:2.0:1789049512.347656:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954110632576 00000100:00100000:2.0:1789049512.347660:0:6704:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954110632576 00000100:00100000:3.0:1789049512.347664:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 290 00000100:00100000:3.0:1789049512.347673:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8c6295450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7ef694ec-1ea0-4f02-800c-d1279b4fdf12+19:3311:x1875954110631936:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789049512.347689:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954110632320 00000100:00100000:2.0:1789049512.347693:0:6704:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954110632320 00000100:00100000:3.0:1789049512.347713:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8c6295450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7ef694ec-1ea0-4f02-800c-d1279b4fdf12+19:3311:x1875954110631936:12345-0@lo:400:kworker.0 Request processed in 41us (524us total) trans 0 rc 0/0 00000100:00100000:2.0:1789049512.347715:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1789049512.347727:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 290 00000100:00100000:2.0:1789049512.347728:0:6704:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8c12a9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3309:x1875954110632576:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789049512.347765:0:6704:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8c12a9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3309:x1875954110632576:12345-0@lo:400:kworker.0 Request processed in 40us (445us total) trans 0 rc 0/0 00000100:00100000:3.0:1789049512.347770:0:10560:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1789049512.347780:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1789049512.347784:0:10560:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8d0aadc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3311:x1875954110632320:12345-0@lo:400:kworker.0 00000100:00080000:2.0:1789049512.347799:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789049512.347804:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789049512.347832:0:10560:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8d0aadc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3311:x1875954110632320:12345-0@lo:400:kworker.0 Request processed in 52us (388us total) trans 0 rc 0/0 00000100:00100000:3.0:1789049512.348564:0:10560:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1789049512.348603:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb8fce97b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3309:1875954110632704:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789049512.348644:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789049512.348688:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb8c5819f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3309:1875954110632064:0@lo:400:kworker.0 00000100:00100000:3.0:1789049512.348704:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb8c12a8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3309:1875954110632576:0@lo:400:kworker.0 00000100:00100000:3.0:1789049512.348715:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb8c581b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3309:1875954110632192:0@lo:400:kworker.0 00000100:00100000:3.0:1789049512.348747:0:6706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954110632704 00000100:00100000:3.0:1789049512.348751:0:6706:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954110632704 00000100:00100000:3.0:1789049512.348786:0:6706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1789049512.348796:0:6706:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb900a54e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1875954110632704:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789049512.350177:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb8c12a9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3311:1875954110632320:0@lo:400:kworker.0 00000100:00100000:0.0:1789049512.350192:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb8ff3ec000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:7ef694ec-1ea0-4f02-800c-d1279b4fdf12:3311:1875954110631936:0@lo:400:kworker.0 00000100:00100000:0.0:1789049512.350204:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb8c12a8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3311:1875954110632448:0@lo:400:kworker.0 00002000:00000024:1.0:1789049512.351217:0:6706:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789049512.351291:0:6706:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb900a54e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1875954110632704:12345-0@lo:13:osp-pre-1-0.0 Request processed in 2496us (2644us total) trans 0 rc 0/0 00000100:00100000:1.0:1789049512.351301:0:6706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1789049512.351859:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb8fce97b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3309:1875954110632704:0@lo:13:osp-pre-1-0.0 00000001:00080000:1.0:1789049512.399759:0:5872:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967418 is committed 00000020:00080000:1.0:1789049512.399771:0:5872:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 4 batchid updated 00000020:00080000:3.0:1789049512.399871:0:5883:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00000020:00080000:3.0:1789049512.399881:0:5883:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00010000:00010000:0.0:1789049512.667053:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789049513.263929:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.26@tcp (source: 12345-192.168.206.26@tcp) 00000100:00100000:3.0:1789049513.264006:0:6841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954089654144 00000100:00100000:3.0:1789049513.264015:0:6841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954089654144 00000100:00100000:3.0:1789049513.264096:0:6841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.26@tcp, seq: 136 00000100:00100000:3.0:1789049513.264107:0:6841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8df209180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e823b53a-3591-475c-8624-c682227e5c13+13:11280:x1875954089654144:12345-192.168.206.26@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789049513.264131:0:6841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789049513.264168:0:6841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c6b34e00/0xf4f48ce5e1bbf6b4 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7fc5e358805a354a expref: -99 pid: 6841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049513.264487:0:6841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c6b35400/0xf4f48ce5e1bbf6bb lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049513.264514:0:6841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c6b35400/0xf4f48ce5e1bbf6bb lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049513.264527:0:6841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c6b35400/0xf4f48ce5e1bbf6bb lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049513.264541:0:6841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c6b34000/0xf4f48ce5e1bbf6c2 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049513.264548:0:6841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c6b34000/0xf4f48ce5e1bbf6c2 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049513.264554:0:6841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c6b34000/0xf4f48ce5e1bbf6c2 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049513.264804:0:6841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c6b34200/0xf4f48ce5e1bbf6c9 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049513.264814:0:6841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c6b34200/0xf4f48ce5e1bbf6c9 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049513.264821:0:6841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c6b34200/0xf4f48ce5e1bbf6c9 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6841 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789049513.264868:0:6841:0:(mdt_handler.c:922:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 16384 00010000:00010000:3.0:1789049513.265002:0:6841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c6b35400/0xf4f48ce5e1bbf6bb lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049513.265010:0:6841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c6b35400/0xf4f48ce5e1bbf6bb lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049513.265016:0:6841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c6b35400/0xf4f48ce5e1bbf6bb lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049513.265027:0:6841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cb8c6b35400 already unused, calling callback (ffffffffc20ca4f0) 00010000:00010000:3.0:1789049513.265032:0:6841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c6b35400/0xf4f48ce5e1bbf6bb lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049513.265039:0:6841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c6b35400/0xf4f48ce5e1bbf6bb lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049513.265051:0:6841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff8cb8c396d700) 00010000:00010000:3.0:1789049513.265054:0:6841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789049513.265059:0:6841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c6b35400/0xf4f48ce5e1bbf6bb lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049513.265065:0:6841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c6b35400/0xf4f48ce5e1bbf6bb lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049513.265077:0:6841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c6b34000/0xf4f48ce5e1bbf6c2 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049513.265083:0:6841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c6b34000/0xf4f48ce5e1bbf6c2 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049513.265089:0:6841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c6b34000/0xf4f48ce5e1bbf6c2 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049513.265094:0:6841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cb8c6b34000 already unused, calling callback (ffffffffc20ca4f0) 00010000:00010000:3.0:1789049513.265096:0:6841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c6b34000/0xf4f48ce5e1bbf6c2 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049513.265102:0:6841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c6b34000/0xf4f48ce5e1bbf6c2 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049513.265120:0:6841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff8cb8c687dd00) 00010000:00010000:3.0:1789049513.265122:0:6841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789049513.265125:0:6841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c6b34000/0xf4f48ce5e1bbf6c2 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049513.265131:0:6841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c6b34000/0xf4f48ce5e1bbf6c2 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6841 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:2.0:1789049513.265409:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1789049513.266471:0:6841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c6b34e00/0xf4f48ce5e1bbf6b4 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a354a expref: 16 pid: 6841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049513.266490:0:6841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c6b34200/0xf4f48ce5e1bbf6c9 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a354a expref: 15 pid: 6841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049513.266497:0:6841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8cb8e0130a00) 00010000:00010000:3.0:1789049513.266500:0:6841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789049513.266502:0:6841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cb8c6b34200, rc 0) 00000100:00100000:3.0:1789049513.266571:0:6841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8df209180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e823b53a-3591-475c-8624-c682227e5c13+15:11280:x1875954089654144:12345-192.168.206.26@tcp:101:lhsmtool_posix.0 Request processed in 2466us (2650us total) trans 4294967419 rc 0/0 00000100:00100000:3.0:1789049513.266579:0:6841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.26@tcp, seq: 136 00000100:00100000:0.0:1789049513.273526:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.26@tcp (source: 12345-192.168.206.26@tcp) 00000100:00100000:0.0:1789049513.273572:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.26@tcp (source: 12345-192.168.206.26@tcp) 00000100:00100000:1.0:1789049513.274527:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954089654272 00000100:00100000:1.0:1789049513.274538:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954089654272 00000100:00100000:1.0:1789049513.274657:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.26@tcp, seq: 9 00000100:00100000:1.0:1789049513.274669:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8c7def450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e823b53a-3591-475c-8624-c682227e5c13+15:2355:x1875954089654272:12345-192.168.206.26@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789049513.274685:0:5837:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789049513.274708:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c6b34200/0xf4f48ce5e1bbf6c9 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a354a expref: 15 pid: 6841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049513.274728:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8cb8e0130a00) 00010000:00010000:1.0:1789049513.274733:0:5837:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789049513.274815:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8c7def450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e823b53a-3591-475c-8624-c682227e5c13+14:2355:x1875954089654272:12345-192.168.206.26@tcp:103:ldlm_bl.0 Request processed in 148us (1241us total) trans 0 rc 0/0 00000100:00100000:1.0:1789049513.274823:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.26@tcp, seq: 9 00000100:00100000:3.0:1789049513.275897:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954089654400 00000100:00100000:3.0:1789049513.275908:0:5852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954089654400 00000100:00100000:3.0:1789049513.275956:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.26@tcp, seq: 137 00000100:00100000:3.0:1789049513.275965:0:5852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8df29a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e823b53a-3591-475c-8624-c682227e5c13+14:11280:x1875954089654400:12345-192.168.206.26@tcp:59:lhsmtool_posix.0 00000100:00100000:3.0:1789049513.276059:0:5852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8df29a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e823b53a-3591-475c-8624-c682227e5c13+14:11280:x1875954089654400:12345-192.168.206.26@tcp:59:lhsmtool_posix.0 Request processed in 95us (2542us total) trans 0 rc 0/0 00000100:00100000:3.0:1789049513.276066:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.26@tcp, seq: 137 00000100:00100000:0.0:1789049513.290001:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.26@tcp (source: 12345-192.168.206.26@tcp) 00000100:00100000:0.0:1789049513.290057:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.26@tcp (source: 12345-192.168.206.26@tcp) 00000100:00100000:0.0:1789049513.290104:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.26@tcp (source: 12345-192.168.206.26@tcp) 00000100:00100000:0.0:1789049513.290142:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.26@tcp (source: 12345-192.168.206.26@tcp) 00000100:00100000:0.0:1789049513.290176:0:6705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954089654656 00000100:00100000:0.0:1789049513.290185:0:6705:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954089654656 00000100:00100000:3.0:1789049513.290190:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954089654528 00000100:00100000:3.0:1789049513.290198:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954089654528 00000100:00100000:3.0:1789049513.290251:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.26@tcp, seq: 291 00000100:00100000:0.0:1789049513.290257:0:6705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954089654784 00000100:00100000:3.0:1789049513.290263:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8c6296850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:de93d576-ed8d-4d27-ab00-9189a62cea33+13:2357:x1875954089654528:12345-192.168.206.26@tcp:400:kworker.0 00000100:00100000:0.0:1789049513.290263:0:6705:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954089654784 00000100:00100000:0.0:1789049513.290294:0:6705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.26@tcp, seq: 68 00000100:00100000:0.0:1789049513.290303:0:6705:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8df299c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e823b53a-3591-475c-8624-c682227e5c13+6:2357:x1875954089654656:12345-192.168.206.26@tcp:400:kworker.0 00000100:00100000:3.0:1789049513.290344:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8c6296850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:de93d576-ed8d-4d27-ab00-9189a62cea33+13:2357:x1875954089654528:12345-192.168.206.26@tcp:400:kworker.0 Request processed in 84us (238us total) trans 0 rc 0/0 00000100:00100000:3.0:1789049513.290352:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.26@tcp, seq: 291 00000100:00100000:3.0:1789049513.290407:0:6703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.26@tcp, seq: 69 00000100:00100000:3.0:1789049513.290415:0:6703:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8c6320a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e823b53a-3591-475c-8624-c682227e5c13+5:2357:x1875954089654784:12345-192.168.206.26@tcp:400:kworker.0 00000100:00100000:1.0:1789049513.290461:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954089654912 00000100:00100000:1.0:1789049513.290467:0:5851:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954089654912 00000100:00100000:1.0:1789049513.290508:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.26@tcp, seq: 145 00000100:00100000:1.0:1789049513.290516:0:5851:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8ff3ec000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:59d63492-f1ee-4aa5-bf8c-853a603b0252+5:2357:x1875954089654912:12345-192.168.206.26@tcp:400:kworker.0 00000100:00100000:0.0:1789049513.297617:0:6705:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8df299c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e823b53a-3591-475c-8624-c682227e5c13+6:2357:x1875954089654656:12345-192.168.206.26@tcp:400:kworker.0 Request processed in 7226us (7534us total) trans 0 rc 0/0 00000100:00100000:0.0:1789049513.297633:0:6705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.26@tcp, seq: 68 00000100:00080000:0.0:1789049513.297710:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789049513.297717:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789049513.297719:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789049513.297941:0:6703:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8c6320a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e823b53a-3591-475c-8624-c682227e5c13+5:2357:x1875954089654784:12345-192.168.206.26@tcp:400:kworker.0 Request processed in 7523us (7794us total) trans 0 rc 0/0 00000100:00100000:3.0:1789049513.297950:0:6703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.26@tcp, seq: 69 00000100:00100000:1.0:1789049513.300455:0:5851:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8ff3ec000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:59d63492-f1ee-4aa5-bf8c-853a603b0252+5:2357:x1875954089654912:12345-192.168.206.26@tcp:400:kworker.0 Request processed in 9930us (10387us total) trans 0 rc 0/0 00000100:00100000:1.0:1789049513.300469:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.26@tcp, seq: 145 00000040:00080000:0.0:1789049513.307065:0:11704:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1789049513.307073:0:11704:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1789049513.307351:0:11704:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 3 00000040:00080000:0.0:1789049513.307360:0:11704:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:0.0:1789049513.692116:0:6719:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789049514.714974:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789049515.536512:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.26@tcp (source: 12345-192.168.206.26@tcp) 00000100:00100000:1.0:1789049515.537367:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954089655040 00000100:00100000:1.0:1789049515.537379:0:5852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954089655040 00000100:00100000:1.0:1789049515.537449:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.26@tcp, seq: 138 00000100:00100000:1.0:1789049515.537460:0:5852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8f73c5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e823b53a-3591-475c-8624-c682227e5c13+14:11323:x1875954089655040:12345-192.168.206.26@tcp:101:lfs.0 00010000:00010000:1.0:1789049515.537481:0:5852:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789049515.537503:0:5852:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c3800/0xf4f48ce5e1bbf6d7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7fc5e358805a3551 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049515.537567:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c2e00/0xf4f48ce5e1bbf6de lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049515.537582:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c2e00/0xf4f48ce5e1bbf6de lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049515.537595:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c2e00/0xf4f48ce5e1bbf6de lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049515.537608:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c2800/0xf4f48ce5e1bbf6e5 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049515.537627:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c2800/0xf4f48ce5e1bbf6e5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049515.537647:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c2800/0xf4f48ce5e1bbf6e5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049515.537889:0:5852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c2e00/0xf4f48ce5e1bbf6de lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049515.537898:0:5852:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c2e00/0xf4f48ce5e1bbf6de lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049515.537904:0:5852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c2e00/0xf4f48ce5e1bbf6de lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049515.537922:0:5852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cb8c28c2e00 already unused, calling callback (ffffffffc20ca4f0) 00010000:00010000:1.0:1789049515.537926:0:5852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c2e00/0xf4f48ce5e1bbf6de lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049515.537934:0:5852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c2e00/0xf4f48ce5e1bbf6de lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049515.537953:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8cb8cab67d00) 00010000:00010000:1.0:1789049515.537956:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789049515.537961:0:5852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c2e00/0xf4f48ce5e1bbf6de lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049515.537967:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c2e00/0xf4f48ce5e1bbf6de lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049515.537981:0:5852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c2800/0xf4f48ce5e1bbf6e5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049515.537995:0:5852:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c2800/0xf4f48ce5e1bbf6e5 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049515.538002:0:5852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c2800/0xf4f48ce5e1bbf6e5 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049515.538008:0:5852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cb8c28c2800 already unused, calling callback (ffffffffc20ca4f0) 00010000:00010000:1.0:1789049515.538011:0:5852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c2800/0xf4f48ce5e1bbf6e5 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049515.538017:0:5852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c2800/0xf4f48ce5e1bbf6e5 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049515.538025:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff8cb8c396d900) 00010000:00010000:1.0:1789049515.538028:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789049515.538030:0:5852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c2800/0xf4f48ce5e1bbf6e5 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049515.538037:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c2800/0xf4f48ce5e1bbf6e5 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049515.538068:0:5852:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c3800/0xf4f48ce5e1bbf6d7 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a3551 expref: 15 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049515.538077:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8cb8cab67d00) 00010000:00010000:1.0:1789049515.538079:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789049515.538083:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c3800/0xf4f48ce5e1bbf6d7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a3551 expref: 15 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049515.538091:0:5852:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cb8c28c3800, rc 0) 00000100:00080000:0.0:1789049515.538605:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789049515.539322:0:5852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8f73c5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e823b53a-3591-475c-8624-c682227e5c13+14:11323:x1875954089655040:12345-192.168.206.26@tcp:101:lfs.0 Request processed in 1860us (2814us total) trans 0 rc 301/301 00000100:00100000:1.0:1789049515.539332:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.26@tcp, seq: 138 00000100:00100000:1.0:1789049515.566178:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.26@tcp (source: 12345-192.168.206.26@tcp) 00000100:00100000:3.0:1789049515.566292:0:6841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954089655296 00000100:00100000:3.0:1789049515.566302:0:6841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954089655296 00000100:00100000:3.0:1789049515.566359:0:6841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.26@tcp, seq: 139 00000100:00100000:3.0:1789049515.566370:0:6841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8d0aaed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e823b53a-3591-475c-8624-c682227e5c13+14:11323:x1875954089655296:12345-192.168.206.26@tcp:36:lfs.0 00010000:00010000:3.0:1789049515.566430:0:6841:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789049515.566457:0:6841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c6b35e00/0xf4f48ce5e1bbf063 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a3391 expref: 14 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049515.566476:0:6841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8cb8cab67d00) 00010000:00010000:3.0:1789049515.566485:0:6841:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789049515.566692:0:6841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c6b34000/0xf4f48ce5e1bbf6ec lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049515.566706:0:6841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c6b34000/0xf4f48ce5e1bbf6ec lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049515.566724:0:6841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c6b34000/0xf4f48ce5e1bbf6ec lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049515.566738:0:6841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c6b34e00/0xf4f48ce5e1bbf6f3 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049515.566746:0:6841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c6b34e00/0xf4f48ce5e1bbf6f3 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049515.566753:0:6841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c6b34e00/0xf4f48ce5e1bbf6f3 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6841 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789049515.567579:0:6841:0:(mdt_handler.c:922:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00010000:00010000:3.0:1789049515.567591:0:6841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c6b34000/0xf4f48ce5e1bbf6ec lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049515.567599:0:6841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c6b34000/0xf4f48ce5e1bbf6ec lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049515.567605:0:6841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c6b34000/0xf4f48ce5e1bbf6ec lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049515.567611:0:6841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cb8c6b34000 already unused, calling callback (ffffffffc20ca4f0) 00010000:00010000:3.0:1789049515.567615:0:6841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c6b34000/0xf4f48ce5e1bbf6ec lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049515.567622:0:6841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c6b34000/0xf4f48ce5e1bbf6ec lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049515.567633:0:6841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8cb8c687dd00) 00010000:00010000:3.0:1789049515.567636:0:6841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789049515.567646:0:6841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c6b34000/0xf4f48ce5e1bbf6ec lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049515.567652:0:6841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c6b34000/0xf4f48ce5e1bbf6ec lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6841 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789049515.567668:0:6841:0:(mdt_handler.c:4507:mdt_save_lock()) ### save lock request 00000000b403b8ae reply state 000000008844bcfc transno 4294967420 ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c6b34e00/0xf4f48ce5e1bbf6f3 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6841 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789049515.567676:0:6841:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1789049515.567766:0:6841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8d0aaed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e823b53a-3591-475c-8624-c682227e5c13+15:11323:x1875954089655296:12345-192.168.206.26@tcp:36:lfs.0 Request processed in 1397us (1598us total) trans 4294967420 rc 0/0 00000100:00100000:3.0:1789049515.567774:0:6841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.26@tcp, seq: 139 00010000:00010000:2.0:1789049515.573413:0:3295:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c6b34e00/0xf4f48ce5e1bbf6f3 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049515.573430:0:3295:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c6b34e00/0xf4f48ce5e1bbf6f3 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049515.573438:0:3295:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c6b34e00/0xf4f48ce5e1bbf6f3 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049515.573466:0:3295:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cb8c6b34e00 already unused, calling callback (ffffffffc20ca4f0) 00010000:00010000:2.0:1789049515.573471:0:3295:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c6b34e00/0xf4f48ce5e1bbf6f3 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049515.573479:0:3295:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c6b34e00/0xf4f48ce5e1bbf6f3 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049515.573494:0:3295:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff8cb8c687dc00) 00010000:00010000:2.0:1789049515.573497:0:3295:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789049515.573502:0:3295:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c6b34e00/0xf4f48ce5e1bbf6f3 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049515.573509:0:3295:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c6b34e00/0xf4f48ce5e1bbf6f3 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6841 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789049515.699395:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.26@tcp (source: 12345-192.168.206.26@tcp) 00000100:00100000:2.0:1789049515.699772:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954089655424 00000100:00100000:2.0:1789049515.699782:0:5850:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954089655424 00000100:00100000:2.0:1789049515.699880:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.26@tcp, seq: 140 00000100:00100000:2.0:1789049515.699891:0:5850:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8d0aad880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e823b53a-3591-475c-8624-c682227e5c13+14:11331:x1875954089655424:12345-192.168.206.26@tcp:101:lctl.0 00010000:00010000:2.0:1789049515.699914:0:5850:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789049515.699937:0:5850:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6714000/0xf4f48ce5e1bbf6fa lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7fc5e358805a3558 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049515.699997:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6714e00/0xf4f48ce5e1bbf701 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049515.700011:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6714e00/0xf4f48ce5e1bbf701 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049515.700039:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6714e00/0xf4f48ce5e1bbf701 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789049515.700074:0:5850:0:(mdt_handler.c:922:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:2.0:1789049515.700078:0:5850:0:(mdt_handler.c:1587:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1789049515.700287:0:5850:0:(mdt_handler.c:2522:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6714e00/0xf4f48ce5e1bbf701 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049515.700310:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6714000/0xf4f48ce5e1bbf6fa lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a3558 expref: 16 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049515.700328:0:5850:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6714e00/0xf4f48ce5e1bbf701 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a3558 expref: 15 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049515.700338:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8cb8e0130500) 00010000:00010000:2.0:1789049515.700341:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789049515.700345:0:5850:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cb8d6714e00, rc 0) 00000100:00100000:3.0:1789049515.701135:0:5850:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8d0aad880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e823b53a-3591-475c-8624-c682227e5c13+15:11331:x1875954089655424:12345-192.168.206.26@tcp:101:lctl.0 Request processed in 1240us (1741us total) trans 0 rc 0/0 00000100:00100000:3.0:1789049515.701146:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.26@tcp, seq: 140 00010000:00010000:0.0:1789049515.741552:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789049515.777112:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.26@tcp (source: 12345-192.168.206.26@tcp) 00000100:00100000:0.0:1789049515.777174:0:6841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954089655552 00000100:00100000:0.0:1789049515.777184:0:6841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954089655552 00000100:00100000:0.0:1789049515.777244:0:6841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.26@tcp, seq: 141 00000100:00100000:0.0:1789049515.777269:0:6841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb900a55500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e823b53a-3591-475c-8624-c682227e5c13+15:11337:x1875954089655552:12345-192.168.206.26@tcp:101:bash.0 00010000:00010000:0.0:1789049515.777290:0:6841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789049515.777311:0:6841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb7c4c38a00/0xf4f48ce5e1bbf708 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7fc5e358805a355f expref: -99 pid: 6841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049515.777458:0:6841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb7c4c39400/0xf4f48ce5e1bbf70f lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049515.777472:0:6841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cb7c4c39400/0xf4f48ce5e1bbf70f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049515.777484:0:6841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb7c4c39400/0xf4f48ce5e1bbf70f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049515.777499:0:6841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb7c4c39a00/0xf4f48ce5e1bbf716 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049515.777506:0:6841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cb7c4c39a00/0xf4f48ce5e1bbf716 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049515.777512:0:6841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb7c4c39a00/0xf4f48ce5e1bbf716 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049515.782557:0:6841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6714000/0xf4f48ce5e1bbf71d lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049515.782578:0:6841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6714000/0xf4f48ce5e1bbf71d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049515.782650:0:6841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6714000/0xf4f48ce5e1bbf71d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6841 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789049515.782693:0:6841:0:(mdt_handler.c:922:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00000004:00200000:2.0:1789049515.782696:0:6841:0:(mdt_handler.c:1587:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1789049515.782712:0:6841:0:(mdt_handler.c:2522:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6714000/0xf4f48ce5e1bbf71d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049515.782738:0:6841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb7c4c39400/0xf4f48ce5e1bbf70f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049515.782745:0:6841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cb7c4c39400/0xf4f48ce5e1bbf70f lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049515.782752:0:6841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cb7c4c39400/0xf4f48ce5e1bbf70f lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049515.782757:0:6841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cb7c4c39400 already unused, calling callback (ffffffffc20ca4f0) 00010000:00010000:2.0:1789049515.782761:0:6841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb7c4c39400/0xf4f48ce5e1bbf70f lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049515.782769:0:6841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb7c4c39400/0xf4f48ce5e1bbf70f lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049515.782780:0:6841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8cb8e0130500) 00010000:00010000:2.0:1789049515.782783:0:6841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789049515.782787:0:6841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cb7c4c39400/0xf4f48ce5e1bbf70f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049515.782793:0:6841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb7c4c39400/0xf4f48ce5e1bbf70f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049515.782898:0:6841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb7c4c39a00/0xf4f48ce5e1bbf716 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049515.782904:0:6841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cb7c4c39a00/0xf4f48ce5e1bbf716 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049515.782911:0:6841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cb7c4c39a00/0xf4f48ce5e1bbf716 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049515.782921:0:6841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cb7c4c39a00 already unused, calling callback (ffffffffc20ca4f0) 00010000:00010000:2.0:1789049515.782924:0:6841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb7c4c39a00/0xf4f48ce5e1bbf716 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049515.782930:0:6841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb7c4c39a00/0xf4f48ce5e1bbf716 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049515.782938:0:6841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff8cb8ce751100) 00010000:00010000:2.0:1789049515.782940:0:6841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789049515.782944:0:6841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cb7c4c39a00/0xf4f48ce5e1bbf716 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049515.782950:0:6841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb7c4c39a00/0xf4f48ce5e1bbf716 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049515.782985:0:6841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb7c4c38a00/0xf4f48ce5e1bbf708 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a355f expref: 17 pid: 6841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049515.782997:0:6841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6714000/0xf4f48ce5e1bbf71d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a355f expref: 16 pid: 6841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049515.783005:0:6841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8cb8e0130100) 00010000:00010000:2.0:1789049515.783007:0:6841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1789049515.783068:0:6841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cb8d6714000, rc 0) 00000100:00100000:2.0:1789049515.783182:0:6841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb900a55500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e823b53a-3591-475c-8624-c682227e5c13+16:11337:x1875954089655552:12345-192.168.206.26@tcp:101:bash.0 Request processed in 5914us (6077us total) trans 0 rc 0/0 00000100:00100000:2.0:1789049515.783190:0:6841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.26@tcp, seq: 141 00000100:00100000:0.0:1789049515.791690:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.26@tcp (source: 12345-192.168.206.26@tcp) 00000100:00100000:1.0:1789049515.793111:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954089655808 00000100:00100000:1.0:1789049515.793124:0:5852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954089655808 00000100:00100000:1.0:1789049515.793194:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.26@tcp, seq: 142 00000100:00100000:1.0:1789049515.793204:0:5852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb900a1ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e823b53a-3591-475c-8624-c682227e5c13+16:11337:x1875954089655808:12345-192.168.206.26@tcp:101:bash.0 00010000:00010000:1.0:1789049515.793223:0:5852:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789049515.793242:0:5852:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c2800/0xf4f48ce5e1bbf724 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7fc5e358805a3566 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049515.793351:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c2e00/0xf4f48ce5e1bbf72b lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049515.793366:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c2e00/0xf4f48ce5e1bbf72b lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049515.793377:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c2e00/0xf4f48ce5e1bbf72b lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049515.793433:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c3000/0xf4f48ce5e1bbf732 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049515.793441:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c3000/0xf4f48ce5e1bbf732 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049515.793447:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c3000/0xf4f48ce5e1bbf732 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1789049515.796795:0:5852:0:(osp_object.c:1667:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x4:0x0], index 1: 0 00010000:00010000:1.0:1789049515.797028:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c2000/0xf4f48ce5e1bbf739 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049515.797045:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c2000/0xf4f48ce5e1bbf739 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049515.797057:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c2000/0xf4f48ce5e1bbf739 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049515.797091:0:5852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c2e00/0xf4f48ce5e1bbf72b lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049515.797099:0:5852:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c2e00/0xf4f48ce5e1bbf72b lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049515.797106:0:5852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c2e00/0xf4f48ce5e1bbf72b lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049515.797113:0:5852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cb8c28c2e00 already unused, calling callback (ffffffffc20ca4f0) 00010000:00010000:1.0:1789049515.797117:0:5852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c2e00/0xf4f48ce5e1bbf72b lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049515.797125:0:5852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c2e00/0xf4f48ce5e1bbf72b lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049515.797136:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8cb8e0130100) 00010000:00010000:1.0:1789049515.797139:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789049515.797144:0:5852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c2e00/0xf4f48ce5e1bbf72b lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049515.802021:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c2e00/0xf4f48ce5e1bbf72b lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789049515.802049:0:5852:0:(mdt_handler.c:4507:mdt_save_lock()) ### save lock request 000000000678b1cf reply state 00000000345b2886 transno 4294967421 ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c3000/0xf4f48ce5e1bbf732 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789049515.802059:0:5852:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1789049515.802113:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c2800/0xf4f48ce5e1bbf724 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a3566 expref: 19 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049515.802128:0:5852:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c2000/0xf4f48ce5e1bbf739 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a3566 expref: 18 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049515.802136:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8cb8c396d200) 00010000:00010000:1.0:1789049515.802139:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789049515.802142:0:5852:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cb8c28c2000, rc 0) 00000100:00100000:1.0:1789049515.802445:0:5852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb900a1ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e823b53a-3591-475c-8624-c682227e5c13+19:11337:x1875954089655808:12345-192.168.206.26@tcp:101:bash.0 Request processed in 9240us (10760us total) trans 4294967421 rc 0/0 00000100:00100000:1.0:1789049515.802454:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.26@tcp, seq: 142 00000100:00100000:1.0:1789049515.808031:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.26@tcp (source: 12345-192.168.206.26@tcp) 00010000:00010000:2.0:1789049515.808120:0:3294:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c3000/0xf4f48ce5e1bbf732 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049515.808145:0:3294:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c3000/0xf4f48ce5e1bbf732 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049515.808154:0:3294:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c3000/0xf4f48ce5e1bbf732 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049515.808166:0:3294:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cb8c28c3000 already unused, calling callback (ffffffffc20ca4f0) 00010000:00010000:2.0:1789049515.808172:0:3294:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c3000/0xf4f48ce5e1bbf732 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049515.808180:0:3294:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c3000/0xf4f48ce5e1bbf732 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049515.808196:0:3294:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8cb8c396d900) 00010000:00010000:2.0:1789049515.808199:0:3294:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789049515.808204:0:3294:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c3000/0xf4f48ce5e1bbf732 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049515.808210:0:3294:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c3000/0xf4f48ce5e1bbf732 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789049515.808429:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954089655936 00000100:00100000:3.0:1789049515.808439:0:6704:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954089655936 00000100:00100000:3.0:1789049515.808500:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.26@tcp, seq: 47 00000100:00100000:3.0:1789049515.808511:0:6704:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb9009d5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e823b53a-3591-475c-8624-c682227e5c13+5:2355:x1875954089655936:12345-192.168.206.26@tcp:101:bash.0 00010000:00010000:3.0:1789049515.808528:0:6704:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789049515.808602:0:6704:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000cb6df1a7/0xf4f48ce5e1bbf747 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x7fc5e358805a356d expref: -99 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789049515.808627:0:6704:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1789049515.808645:0:6704:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=341s v=(0 0) 00010000:00010000:3.0:1789049515.808649:0:6704:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789049515.808658:0:6704:0:(ldlm_resource.c:1751:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000cb6df1a7/0xf4f48ce5e1bbf747 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a356d expref: 6 pid: 6704 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049515.808684:0:6704:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000cb6df1a7/0xf4f48ce5e1bbf747 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a356d expref: 6 pid: 6704 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049515.808695:0:6704:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cb8c6b34000, rc 0) 00000100:00100000:3.0:1789049515.808755:0:6704:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb9009d5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e823b53a-3591-475c-8624-c682227e5c13+6:2355:x1875954089655936:12345-192.168.206.26@tcp:101:bash.0 Request processed in 247us (732us total) trans 0 rc 0/0 00000100:00100000:3.0:1789049515.808763:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.26@tcp, seq: 47 00000100:00080000:0.0:1789049515.808878:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789049515.813301:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.26@tcp (source: 12345-192.168.206.26@tcp) 00000100:00100000:0.0:1789049515.813372:0:10560:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954089656064 00000100:00100000:0.0:1789049515.813382:0:10560:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954089656064 00000100:00100000:0.0:1789049515.813443:0:10560:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.26@tcp, seq: 48 00000100:00100000:0.0:1789049515.813453:0:10560:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8c12ab800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e823b53a-3591-475c-8624-c682227e5c13+6:11337:x1875954089656064:12345-192.168.206.26@tcp:101:bash.0 00010000:00010000:0.0:1789049515.813472:0:10560:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789049515.813499:0:10560:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d266eacc/0xf4f48ce5e1bbf74e lrc: 2/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x7fc5e358805a3574 expref: -99 pid: 10560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049515.813532:0:10560:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000cb6df1a7/0xf4f48ce5e1bbf747 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a356d expref: 7 pid: 6704 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049515.813542:0:10560:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789049515.813546:0:10560:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789049515.813551:0:10560:0:(ldlm_resource.c:1751:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d266eacc/0xf4f48ce5e1bbf74e lrc: 4/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a3574 expref: 7 pid: 10560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049515.813584:0:10560:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000cb6df1a7/0xf4f48ce5e1bbf747 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a356d expref: 7 pid: 6704 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049515.813597:0:10560:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000cb6df1a7/0xf4f48ce5e1bbf747 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a356d expref: 7 pid: 6704 timeout: 441 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789049515.813611:0:10560:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb900a1dc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10560:1875954110632832:192.168.206.26@tcp:104: 00000100:00100000:0.0:1789049515.813697:0:10560:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cb8c12ed240 going to sleep for 11 seconds 00000100:00100000:1.0:1789049515.827987:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.26@tcp (source: 12345-192.168.206.26@tcp) 00000100:00100000:3.0:1789049515.828056:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954089656192 00000100:00100000:3.0:1789049515.828066:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954089656192 00000100:00100000:0.0:1789049515.828110:0:10560:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb900a1dc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10560:1875954110632832:192.168.206.26@tcp:104: 00010000:00010000:0.0:1789049515.828139:0:10560:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000d266eacc/0xf4f48ce5e1bbf74e lrc: 3/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a3574 expref: 8 pid: 10560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049515.828159:0:10560:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cb7c4c39000, rc 0) 00000100:00100000:0.0:1789049515.828216:0:10560:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8c12ab800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e823b53a-3591-475c-8624-c682227e5c13+8:11337:x1875954089656064:12345-192.168.206.26@tcp:101:bash.0 Request processed in 14764us (14923us total) trans 0 rc 0/0 00000100:00100000:0.0:1789049515.828240:0:10560:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.26@tcp, seq: 48 00010000:00010000:3.0:1789049515.828292:0:5835:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000cb6df1a7/0xf4f48ce5e1bbf747 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a356d expref: 7 pid: 6704 timeout: 441 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789049515.828386:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.26@tcp, seq: 60 00000100:00100000:3.0:1789049515.828398:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8f7747480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e823b53a-3591-475c-8624-c682227e5c13+7:2358:x1875954089656192:12345-192.168.206.26@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789049515.828412:0:5835:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789049515.828434:0:5835:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000cb6df1a7/0xf4f48ce5e1bbf747 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a356d expref: 7 pid: 6704 timeout: 441 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049515.828448:0:5835:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000cb6df1a7/0xf4f48ce5e1bbf747 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a356d expref: 7 pid: 6704 timeout: 441 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049515.828470:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000cb6df1a7/0xf4f48ce5e1bbf747 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a356d expref: 7 pid: 6704 timeout: 441 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049515.828495:0:5835:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789049515.828500:0:5835:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789049515.828508:0:5835:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000d266eacc/0xf4f48ce5e1bbf74e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a3574 expref: 6 pid: 10560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049515.828569:0:5835:0:(ldlm_resource.c:1751:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d266eacc/0xf4f48ce5e1bbf74e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a3574 expref: 6 pid: 10560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049515.828606:0:5835:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000d266eacc/0xf4f48ce5e1bbf74e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a3574 expref: 6 pid: 10560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789049515.828620:0:5835:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb900a55180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5835:1875954110632960:192.168.206.26@tcp:105: 00000100:00100000:3.0:1789049515.828997:0:5835:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cb8c799f780 going to sleep for 11 seconds 00000100:00100000:3.0:1789049515.835342:0:5835:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb900a55180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5835:1875954110632960:192.168.206.26@tcp:105: 00010000:00010000:3.0:1789049515.835373:0:5835:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789049515.835438:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8f7747480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e823b53a-3591-475c-8624-c682227e5c13+6:2358:x1875954089656192:12345-192.168.206.26@tcp:103:ldlm_bl.0 Request processed in 7043us (7460us total) trans 0 rc 0/0 00000100:00100000:3.0:1789049515.835449:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.26@tcp, seq: 60 00000100:00100000:2.0:1789049515.845335:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.26@tcp (source: 12345-192.168.206.26@tcp) 00000100:00100000:3.0:1789049515.845471:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954089656448 00000100:00100000:3.0:1789049515.845480:0:5853:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954089656448 00000100:00100000:3.0:1789049515.845541:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.26@tcp, seq: 36 00000100:00100000:3.0:1789049515.845551:0:5853:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8c12a8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e823b53a-3591-475c-8624-c682227e5c13+18:11337:x1875954089656448:12345-192.168.206.26@tcp:35:bash.0 00000001:00080000:3.0:1789049515.845829:0:5853:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967422 00000100:00100000:3.0:1789049515.845971:0:5853:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8c12a8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e823b53a-3591-475c-8624-c682227e5c13+20:11337:x1875954089656448:12345-192.168.206.26@tcp:35:bash.0 Request processed in 420us (644us total) trans 4294967423 rc 0/0 00000100:00100000:3.0:1789049515.845991:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.26@tcp, seq: 36 00000020:00080000:3.0:1789049515.845996:0:5853:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1789049516.021109:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.26@tcp (source: 12345-192.168.206.26@tcp) 00000100:00100000:1.0:1789049516.021326:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954089656704 00000100:00100000:1.0:1789049516.021335:0:5851:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954089656704 00000100:00100000:1.0:1789049516.021397:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.26@tcp, seq: 143 00000100:00100000:1.0:1789049516.021407:0:5851:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8c12aad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e823b53a-3591-475c-8624-c682227e5c13+20:11347:x1875954089656704:12345-192.168.206.26@tcp:101:lfs.0 00010000:00010000:1.0:1789049516.021430:0:5851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789049516.021451:0:5851:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c2800/0xf4f48ce5e1bbf755 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7fc5e358805a357b expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789049516.023457:0:5851:0:(mdt_handler.c:922:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00010000:00010000:1.0:1789049516.023586:0:5851:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c2800/0xf4f48ce5e1bbf755 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a357b expref: 22 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049516.023601:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8cb8e0130500) 00010000:00010000:1.0:1789049516.023605:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1789049516.023610:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c2800/0xf4f48ce5e1bbf755 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a357b expref: 22 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049516.023625:0:5851:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cb8c28c2800, rc 0) 00000100:00100000:1.0:1789049516.023731:0:5851:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8c12aad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e823b53a-3591-475c-8624-c682227e5c13+21:11347:x1875954089656704:12345-192.168.206.26@tcp:101:lfs.0 Request processed in 2324us (2630us total) trans 4294967424 rc 301/301 00000100:00100000:1.0:1789049516.023740:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.26@tcp, seq: 143 00000100:00100000:0.0:1789049516.037537:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.26@tcp (source: 12345-192.168.206.26@tcp) 00000100:00100000:3.0:1789049516.037620:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954089656960 00000100:00100000:3.0:1789049516.037629:0:5853:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954089656960 00000100:00100000:3.0:1789049516.037684:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.26@tcp, seq: 37 00000100:00100000:3.0:1789049516.037694:0:5853:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb900a1dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e823b53a-3591-475c-8624-c682227e5c13+21:11347:x1875954089656960:12345-192.168.206.26@tcp:35:lfs.0 00000100:00100000:3.0:1789049516.037943:0:5853:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb900a1dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e823b53a-3591-475c-8624-c682227e5c13+22:11347:x1875954089656960:12345-192.168.206.26@tcp:35:lfs.0 Request processed in 250us (413us total) trans 4294967425 rc 0/0 00000100:00100000:3.0:1789049516.037952:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.26@tcp, seq: 37 00000100:00100000:2.0:1789049516.181063:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.26@tcp (source: 12345-192.168.206.26@tcp) 00000100:00100000:3.0:1789049516.181165:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954089657088 00000100:00100000:3.0:1789049516.181184:0:5850:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954089657088 00000100:00100000:3.0:1789049516.181249:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.26@tcp, seq: 144 00000100:00100000:3.0:1789049516.181260:0:5850:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8c12a9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e823b53a-3591-475c-8624-c682227e5c13+22:11353:x1875954089657088:12345-192.168.206.26@tcp:101:lfs.0 00010000:00010000:3.0:1789049516.181282:0:5850:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789049516.181301:0:5850:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c6b34000/0xf4f48ce5e1bbf763 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7fc5e358805a3582 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049516.181361:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c6b35e00/0xf4f48ce5e1bbf76a lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049516.181374:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c6b35e00/0xf4f48ce5e1bbf76a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049516.181387:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c6b35e00/0xf4f48ce5e1bbf76a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789049516.181417:0:5850:0:(mdt_handler.c:922:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00000004:00200000:3.0:1789049516.181421:0:5850:0:(mdt_handler.c:1587:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1789049516.181450:0:5850:0:(mdt_handler.c:2522:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c6b35e00/0xf4f48ce5e1bbf76a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049516.181474:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c6b34000/0xf4f48ce5e1bbf763 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a3582 expref: 24 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049516.181491:0:5850:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c6b35e00/0xf4f48ce5e1bbf76a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a3582 expref: 23 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049516.181500:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8cb8e0130100) 00010000:00010000:3.0:1789049516.181503:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1789049516.181507:0:5850:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cb8c6b35e00, rc 0) 00000100:00100000:3.0:1789049516.181565:0:5850:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8c12a9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e823b53a-3591-475c-8624-c682227e5c13+23:11353:x1875954089657088:12345-192.168.206.26@tcp:101:lfs.0 Request processed in 306us (510us total) trans 0 rc 0/0 00000100:00100000:3.0:1789049516.181572:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.26@tcp, seq: 144 00000100:00100000:2.0:1789049516.203503:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.26@tcp (source: 12345-192.168.206.26@tcp) 00000100:00100000:3.0:1789049516.203621:0:6841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954089657344 00000100:00100000:3.0:1789049516.203631:0:6841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954089657344 00000100:00100000:3.0:1789049516.203696:0:6841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.26@tcp, seq: 145 00000100:00100000:3.0:1789049516.203706:0:6841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8c12a9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e823b53a-3591-475c-8624-c682227e5c13+23:11353:x1875954089657344:12345-192.168.206.26@tcp:101:lfs.0 00010000:00010000:3.0:1789049516.203726:0:6841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789049516.203746:0:6841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c6b34000/0xf4f48ce5e1bbf771 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7fc5e358805a3589 expref: -99 pid: 6841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049516.203880:0:6841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c6b35400/0xf4f48ce5e1bbf778 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049516.203895:0:6841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c6b35400/0xf4f48ce5e1bbf778 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049516.203923:0:6841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c6b35400/0xf4f48ce5e1bbf778 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6841 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789049516.203936:0:6841:0:(mdt_handler.c:922:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:3.0:1789049516.204068:0:6841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c6b34000/0xf4f48ce5e1bbf771 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a3589 expref: 26 pid: 6841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049516.204087:0:6841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c6b35400/0xf4f48ce5e1bbf778 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a3589 expref: 25 pid: 6841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049516.204096:0:6841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8cb8c396d200) 00010000:00010000:3.0:1789049516.204099:0:6841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789049516.204103:0:6841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cb8c6b35400, rc 0) 00000100:00100000:3.0:1789049516.204168:0:6841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8c12a9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e823b53a-3591-475c-8624-c682227e5c13+25:11353:x1875954089657344:12345-192.168.206.26@tcp:101:lfs.0 Request processed in 463us (674us total) trans 4294967426 rc 0/0 00000100:00100000:3.0:1789049516.204175:0:6841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.26@tcp, seq: 145 00000100:00100000:0.0:1789049516.208736:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.26@tcp (source: 12345-192.168.206.26@tcp) 00000100:00100000:3.0:1789049516.209025:0:6720:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954089657728 00000100:00100000:3.0:1789049516.209035:0:6720:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954089657728 00000100:00100000:3.0:1789049516.209147:0:6720:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.26@tcp, seq: 10 00000100:00100000:3.0:1789049516.209158:0:6720:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb900a5a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e823b53a-3591-475c-8624-c682227e5c13+25:2356:x1875954089657728:12345-192.168.206.26@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789049516.210307:0:6720:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789049516.210335:0:6720:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c6b35400/0xf4f48ce5e1bbf778 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a3589 expref: 25 pid: 6841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049516.210353:0:6720:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8cb8c396d200) 00010000:00010000:3.0:1789049516.210358:0:6720:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789049516.210432:0:6720:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb900a5a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e823b53a-3591-475c-8624-c682227e5c13+24:2356:x1875954089657728:12345-192.168.206.26@tcp:103:ldlm_bl.0 Request processed in 1276us (1703us total) trans 0 rc 0/0 00000100:00100000:3.0:1789049516.210440:0:6720:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.26@tcp, seq: 10 00000100:00100000:2.0:1789049516.215863:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.26@tcp (source: 12345-192.168.206.26@tcp) 00000100:00100000:3.0:1789049516.216040:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954089657600 00000100:00100000:3.0:1789049516.216049:0:5850:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954089657600 00000100:00100000:3.0:1789049516.216115:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.26@tcp, seq: 146 00000100:00100000:3.0:1789049516.216126:0:5850:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8c12ab100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e823b53a-3591-475c-8624-c682227e5c13+24:11353:x1875954089657600:12345-192.168.206.26@tcp:101:lfs.0 00010000:00010000:3.0:1789049516.216148:0:5850:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789049516.216485:0:5850:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c6b34000/0xf4f48ce5e1bbf786 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7fc5e358805a3590 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049516.216574:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c6b35a00/0xf4f48ce5e1bbf78d lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049516.216600:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c6b35a00/0xf4f48ce5e1bbf78d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049516.216613:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c6b35a00/0xf4f48ce5e1bbf78d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789049516.216625:0:5850:0:(mdt_handler.c:922:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:3.0:1789049516.216738:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c6b34000/0xf4f48ce5e1bbf786 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a3590 expref: 27 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049516.216756:0:5850:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c6b35a00/0xf4f48ce5e1bbf78d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a3590 expref: 26 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049516.216765:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8cb8c396d200) 00010000:00010000:3.0:1789049516.216768:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1789049516.216783:0:5850:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cb8c6b35a00, rc 0) 00000100:00100000:3.0:1789049516.216877:0:5850:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8c12ab100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e823b53a-3591-475c-8624-c682227e5c13+26:11353:x1875954089657600:12345-192.168.206.26@tcp:101:lfs.0 Request processed in 752us (1040us total) trans 4294967427 rc 0/0 00000100:00100000:3.0:1789049516.216884:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.26@tcp, seq: 146 00000100:00100000:3.0:1789049516.225883:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.26@tcp (source: 12345-192.168.206.26@tcp) 00000100:00100000:0.0:1789049516.225963:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954089657856 00000100:00100000:0.0:1789049516.225972:0:6704:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954089657856 00000100:00100000:0.0:1789049516.226039:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.26@tcp, seq: 49 00000100:00100000:0.0:1789049516.226049:0:6704:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb900a55180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e823b53a-3591-475c-8624-c682227e5c13+6:2358:x1875954089657856:12345-192.168.206.26@tcp:1:lfs.0 00010000:00010000:0.0:1789049516.226089:0:6704:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002f0dec02/0xf4f48ce5e1bbf79b lrc: 3/0,1 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049516.226119:0:6704:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000d266eacc/0xf4f48ce5e1bbf74e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a3574 expref: 6 pid: 10560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049516.226128:0:6704:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x4:0x0].0x0 since=1s v=(0 0) 00010000:00010000:0.0:1789049516.226133:0:6704:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1789049516.226138:0:6704:0:(ldlm_resource.c:1751:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002f0dec02/0xf4f48ce5e1bbf79b lrc: 4/0,1 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049516.226193:0:6704:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000d266eacc/0xf4f48ce5e1bbf74e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a3574 expref: 6 pid: 10560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049516.226206:0:6704:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000d266eacc/0xf4f48ce5e1bbf74e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a3574 expref: 6 pid: 10560 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789049516.226221:0:6704:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb8f7ac8e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6704:1875954110633088:192.168.206.26@tcp:104: 00000100:00100000:0.0:1789049516.226324:0:6704:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cb8c12ed240 going to sleep for 11 seconds 00000100:00100000:0.0:1789049516.233310:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.26@tcp (source: 12345-192.168.206.26@tcp) 00000100:00100000:1.0:1789049516.233456:0:6708:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954089657984 00000100:00100000:1.0:1789049516.233466:0:6708:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954089657984 00002000:00100000:1.0:1789049516.233514:0:6708:0:(ofd_dev.c:2725:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x4:0x0] (0->12) req@ffff8cb8f7ac8700 x1875954089657984/t0(0) o4->e823b53a-3591-475c-8624-c682227e5c13@192.168.206.26@tcp:17/0 lens 504/0 e 0 to 0 dl 1789049527 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789049516.233524:0:6708:0:(ofd_dev.c:2581:ofd_prolong_extent_locks()) Prolong locks for req ffff8cb8f7ac8700 with x1875954089657984 ext(0->12) 00010000:00010000:1.0:1789049516.233533:0:6708:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000d266eacc/0xf4f48ce5e1bbf74e lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a3574 expref: 7 pid: 10560 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049516.233550:0:6708:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000d266eacc/0xf4f48ce5e1bbf74e lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a3574 expref: 7 pid: 10560 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1789049516.233558:0:6708:0:(ofd_dev.c:2730:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8cb8f7ac8700 00000100:00100000:1.0:1789049516.233600:0:6708:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.26@tcp, seq: 2 00000100:00100000:1.0:1789049516.233609:0:6708:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8f7ac8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:e823b53a-3591-475c-8624-c682227e5c13+7:2357:x1875954089657984:12345-192.168.206.26@tcp:4:lfs.0 00000100:00100000:1.0:1789049516.234124:0:6708:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8f7ac8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:e823b53a-3591-475c-8624-c682227e5c13+9:2357:x1875954089657984:12345-192.168.206.26@tcp:4:lfs.0 Request processed in 502us (810us total) trans 4294967305 rc 0/0 00000100:00100000:1.0:1789049516.234133:0:6708:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.26@tcp, seq: 2 00002000:00100000:1.0:1789049516.234140:0:6708:0:(ofd_dev.c:2725:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x4:0x0] (0->12) req@ffff8cb8f7ac8700 x1875954089657984/t4294967305(0) o4->e823b53a-3591-475c-8624-c682227e5c13@192.168.206.26@tcp:17/0 lens 504/448 e 0 to 0 dl 1789049527 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789049516.234150:0:6708:0:(ofd_dev.c:2581:ofd_prolong_extent_locks()) Prolong locks for req ffff8cb8f7ac8700 with x1875954089657984 ext(0->12) 00010000:00010000:1.0:1789049516.234156:0:6708:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000d266eacc/0xf4f48ce5e1bbf74e lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a3574 expref: 9 pid: 10560 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049516.234170:0:6708:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000d266eacc/0xf4f48ce5e1bbf74e lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a3574 expref: 9 pid: 10560 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1789049516.234177:0:6708:0:(ofd_dev.c:2730:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8cb8f7ac8700 00000100:00100000:3.0:1789049516.234298:0:6704:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb8f7ac8e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6704:1875954110633088:192.168.206.26@tcp:104: 00010000:00010000:3.0:1789049516.234321:0:6704:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000002f0dec02/0xf4f48ce5e1bbf79b lrc: 3/0,1 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789049516.239273:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.26@tcp (source: 12345-192.168.206.26@tcp) 00000100:00100000:0.0:1789049516.239424:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954089658112 00000100:00100000:0.0:1789049516.239434:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954089658112 00010000:00010000:0.0:1789049516.239471:0:5836:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000d266eacc/0xf4f48ce5e1bbf74e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a3574 expref: 9 pid: 10560 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789049516.239511:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.26@tcp, seq: 61 00000100:00100000:0.0:1789049516.239520:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8fce96680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e823b53a-3591-475c-8624-c682227e5c13+9:2355:x1875954089658112:12345-192.168.206.26@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789049516.239534:0:5836:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:0.0:1789049516.239551:0:5836:0:(ofd_lvb.c:321:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:0.0:1789049516.239554:0:5836:0:(ofd_lvb.c:328:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb mtime from disk: 0 -> 1789049515150122341 00002000:00010000:0.0:1789049516.239557:0:5836:0:(ofd_lvb.c:334:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb atime from disk: 0 -> 1789049515540122261 00002000:00010000:0.0:1789049516.239559:0:5836:0:(ofd_lvb.c:340:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb ctime from disk: 0 -> 1789049515150122341 00010000:00010000:0.0:1789049516.239565:0:5836:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000d266eacc/0xf4f48ce5e1bbf74e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a3574 expref: 9 pid: 10560 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049516.239579:0:5836:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000d266eacc/0xf4f48ce5e1bbf74e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a3574 expref: 9 pid: 10560 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049516.239601:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d266eacc/0xf4f48ce5e1bbf74e lrc: 0/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a3574 expref: 9 pid: 10560 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049516.239618:0:5836:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1789049516.239622:0:5836:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1789049516.239628:0:5836:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000002f0dec02/0xf4f48ce5e1bbf79b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049516.239650:0:5836:0:(ldlm_resource.c:1751:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002f0dec02/0xf4f48ce5e1bbf79b lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049516.239687:0:5836:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789049516.239742:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8fce96680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e823b53a-3591-475c-8624-c682227e5c13+8:2355:x1875954089658112:12345-192.168.206.26@tcp:103:ldlm_bl.0 Request processed in 223us (477us total) trans 0 rc 0/0 00000100:00100000:0.0:1789049516.239750:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.26@tcp, seq: 61 00010000:00010000:1.0:1789049516.239838:0:6704:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000002f0dec02/0xf4f48ce5e1bbf79b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049516.239879:0:6704:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002f0dec02/0xf4f48ce5e1bbf79b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049516.239902:0:6704:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002f0dec02/0xf4f48ce5e1bbf79b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049516.239911:0:6704:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000002f0dec02/0xf4f48ce5e1bbf79b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049516.239926:0:6704:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002f0dec02/0xf4f48ce5e1bbf79b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049516.239934:0:6704:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cb7c4c38e00 already unused, calling callback (ffffffffc166a8f0) 00010000:00010000:1.0:1789049516.239939:0:6704:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002f0dec02/0xf4f48ce5e1bbf79b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049516.239948:0:6704:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002f0dec02/0xf4f48ce5e1bbf79b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049516.239961:0:6704:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002f0dec02/0xf4f48ce5e1bbf79b lrc: 2/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049516.239968:0:6704:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002f0dec02/0xf4f48ce5e1bbf79b lrc: 0/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789049516.240011:0:6704:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb900a55180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e823b53a-3591-475c-8624-c682227e5c13+7:2358:x1875954089657856:12345-192.168.206.26@tcp:1:lfs.0 Request processed in 13964us (14170us total) trans 0 rc 0/0 00000100:00100000:1.0:1789049516.240019:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.26@tcp, seq: 49 00000100:00100000:2.0:1789049516.248078:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.26@tcp (source: 12345-192.168.206.26@tcp) 00000100:00100000:3.0:1789049516.248209:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954089658368 00000100:00100000:3.0:1789049516.248218:0:5853:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954089658368 00000100:00100000:3.0:1789049516.248372:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.26@tcp, seq: 38 00000100:00100000:3.0:1789049516.248382:0:5853:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8d1d2bc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e823b53a-3591-475c-8624-c682227e5c13+26:11353:x1875954089658368:12345-192.168.206.26@tcp:35:lfs.0 00000004:00010000:3.0:1789049516.248439:0:5853:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0xb:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c6b35a00/0xf4f48ce5e1bbf78d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a3590 expref: 26 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789049516.248658:0:5853:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967428 00000001:00080000:3.0:1789049516.248697:0:5853:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967429 00000001:00080000:3.0:1789049516.249209:0:5853:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967430 00010000:00010000:2.0:1789049516.251403:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6715a00/0xf4f48ce5e1bbf7a2 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049516.251437:0:5853:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c2000/0xf4f48ce5e1bbf739 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a3566 expref: 30 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049516.251447:0:5853:0:(ldlm_resource.c:1751:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6715a00/0xf4f48ce5e1bbf7a2 lrc: 4/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049516.251482:0:5853:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c2000/0xf4f48ce5e1bbf739 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a3566 expref: 30 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049516.251497:0:5853:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c2000/0xf4f48ce5e1bbf739 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a3566 expref: 30 pid: 5852 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789049516.251510:0:5853:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb8c12aa680 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5853:1875954110633216:192.168.206.26@tcp:104: 00000100:00100000:2.0:1789049516.251594:0:5853:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cb8c63eab40 going to sleep for 11 seconds 00000100:00100000:2.0:1789049516.260279:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.26@tcp (source: 12345-192.168.206.26@tcp) 00000100:00100000:0.0:1789049516.260331:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954089658496 00000100:00100000:0.0:1789049516.260341:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954089658496 00010000:00010000:0.0:1789049516.260378:0:5837:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c2000/0xf4f48ce5e1bbf739 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a3566 expref: 31 pid: 5852 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789049516.260421:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.26@tcp, seq: 62 00000100:00100000:0.0:1789049516.260429:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8c12abb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e823b53a-3591-475c-8624-c682227e5c13+31:2357:x1875954089658496:12345-192.168.206.26@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789049516.260444:0:5837:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789049516.260450:0:5837:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c2000/0xf4f48ce5e1bbf739 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a3566 expref: 31 pid: 5852 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049516.260462:0:5837:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c2000/0xf4f48ce5e1bbf739 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a3566 expref: 31 pid: 5852 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049516.260482:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8cb8c396d200) 00010000:00010000:0.0:1789049516.260488:0:5837:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6715a00/0xf4f48ce5e1bbf7a2 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049516.260496:0:5837:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6715a00/0xf4f48ce5e1bbf7a2 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049516.260517:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6715a00/0xf4f48ce5e1bbf7a2 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049516.260536:0:5837:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789049516.260557:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c2000/0xf4f48ce5e1bbf739 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a3566 expref: 31 pid: 5852 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789049516.260578:0:5853:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb8c12aa680 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5853:1875954110633216:192.168.206.26@tcp:104: 00010000:00010000:3.0:1789049516.260600:0:5853:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6715a00/0xf4f48ce5e1bbf7a2 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789049516.260600:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8c12abb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e823b53a-3591-475c-8624-c682227e5c13+30:2357:x1875954089658496:12345-192.168.206.26@tcp:103:ldlm_bl.0 Request processed in 155us (315us total) trans 0 rc 0/0 00000100:00100000:0.0:1789049516.260616:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.26@tcp, seq: 62 00010000:00010000:3.0:1789049516.260630:0:5853:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6715a00/0xf4f48ce5e1bbf7a2 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049516.260637:0:5853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6715a00/0xf4f48ce5e1bbf7a2 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789049516.260752:0:5853:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967431 00000001:00080000:3.0:1789049516.263567:0:5853:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967432 00000100:00100000:3.0:1789049516.263701:0:5853:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb8fce97b80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5853:1875954110633344:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1789049516.263759:0:5853:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789049516.263885:0:5853:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cb8c799f900 going to sleep for 11 seconds 00000100:00100000:2.0:1789049516.263971:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954110633344 00000100:00100000:2.0:1789049516.263979:0:5856:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954110633344 00000100:00080000:0.0:1789049516.264035:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789049516.264055:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1789049516.264064:0:5856:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8c581b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5853:x1875954110633344:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1789049516.264140:0:5856:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8c581b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5853:x1875954110633344:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 77us (379us total) trans 0 rc 0/0 00000100:00100000:2.0:1789049516.264148:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1789049516.264267:0:5853:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb8fce97b80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5853:1875954110633344:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:3.0:1789049516.264734:0:5853:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967433 00000100:00100000:3.0:1789049516.264788:0:5853:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb8c5819f80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5853:1875954110633472:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1789049516.265091:0:5853:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789049516.265119:0:5853:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cb8c799fa80 going to sleep for 11 seconds 00000100:00100000:2.0:1789049516.265635:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954110633472 00000100:00100000:2.0:1789049516.265642:0:5856:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954110633472 00000100:00100000:2.0:1789049516.265691:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1789049516.265700:0:5856:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8fce97b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5853:x1875954110633472:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1789049516.265969:0:5856:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8fce97b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5853:x1875954110633472:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 269us (877us total) trans 4294967306 rc 0/0 00000100:00100000:2.0:1789049516.265977:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1789049516.266289:0:5853:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb8c5819f80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5853:1875954110633472:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:3.0:1789049516.266346:0:5853:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967434 00010000:00010000:3.0:1789049516.266386:0:5853:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6715a00/0xf4f48ce5e1bbf7a2 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049516.266396:0:5853:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6715a00/0xf4f48ce5e1bbf7a2 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049516.266405:0:5853:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6715a00/0xf4f48ce5e1bbf7a2 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049516.266411:0:5853:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cb8d6715a00 already unused, calling callback (ffffffffc20ca4f0) 00010000:00010000:3.0:1789049516.266422:0:5853:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6715a00/0xf4f48ce5e1bbf7a2 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049516.266431:0:5853:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6715a00/0xf4f48ce5e1bbf7a2 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049516.266445:0:5853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8cb8c396d200) 00010000:00010000:3.0:1789049516.266448:0:5853:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:3.0:1789049516.266453:0:5853:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6715a00/0xf4f48ce5e1bbf7a2 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049516.266459:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6715a00/0xf4f48ce5e1bbf7a2 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1789049516.266640:0:5853:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0xc:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:3.0:1789049516.266787:0:5853:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].4, 64 off8448 00000004:00080000:3.0:1789049516.266823:0:5853:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 342318978722ns, next at 343318966898ns, rc = 0 00000001:00080000:3.0:1789049516.266830:0:5853:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967435 00010000:00010000:3.0:1789049516.266891:0:5853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8cb8c396d200) 00010000:00010000:3.0:1789049516.266895:0:5853:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1789049516.266902:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c6b35a00/0xf4f48ce5e1bbf78d lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a3590 expref: 34 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789049516.266998:0:5853:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8d1d2bc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e823b53a-3591-475c-8624-c682227e5c13+33:11353:x1875954089658368:12345-192.168.206.26@tcp:35:lfs.0 Request processed in 18618us (18929us total) trans 4294967436 rc 0/0 00000100:00100000:3.0:1789049516.267007:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.26@tcp, seq: 38 00000020:00080000:3.0:1789049516.267025:0:5853:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:2.0:1789049516.273408:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.26@tcp (source: 12345-192.168.206.26@tcp) 00000100:00100000:3.0:1789049516.273497:0:6841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954089658624 00000100:00100000:3.0:1789049516.273507:0:6841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954089658624 00000100:00100000:3.0:1789049516.273621:0:6841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.26@tcp, seq: 147 00000100:00100000:3.0:1789049516.273632:0:6841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8c12a8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e823b53a-3591-475c-8624-c682227e5c13+33:11353:x1875954089658624:12345-192.168.206.26@tcp:101:lfs.0 00010000:00010000:3.0:1789049516.273667:0:6841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789049516.273701:0:6841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c6b34000/0xf4f48ce5e1bbf7a9 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7fc5e358805a3597 expref: -99 pid: 6841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049516.273760:0:6841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c6b34000/0xf4f48ce5e1bbf7a9 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a3597 expref: 34 pid: 6841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049516.273774:0:6841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c6b34000/0xf4f48ce5e1bbf7a9 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a3597 expref: 34 pid: 6841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049516.273792:0:6841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8cb8c687d500) 00010000:00010000:3.0:1789049516.273795:0:6841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1789049516.273798:0:6841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cb8c6b34000, rc 0) 00000100:00100000:3.0:1789049516.273911:0:6841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8c12a8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e823b53a-3591-475c-8624-c682227e5c13+34:11353:x1875954089658624:12345-192.168.206.26@tcp:101:lfs.0 Request processed in 281us (511us total) trans 0 rc 0/0 00000100:00100000:3.0:1789049516.273918:0:6841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.26@tcp, seq: 147 00000100:00100000:2.0:1789049516.292433:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.26@tcp (source: 12345-192.168.206.26@tcp) 00000100:00100000:1.0:1789049516.293923:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954089658880 00000100:00100000:1.0:1789049516.293936:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954089658880 00000100:00100000:1.0:1789049516.295418:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.26@tcp, seq: 39 00000100:00100000:1.0:1789049516.295437:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8c12aa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e823b53a-3591-475c-8624-c682227e5c13+34:11353:x1875954089658880:12345-192.168.206.26@tcp:35:lfs.0 00000100:00100000:1.0:1789049516.295656:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8c12aa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e823b53a-3591-475c-8624-c682227e5c13+35:11353:x1875954089658880:12345-192.168.206.26@tcp:35:lfs.0 Request processed in 226us (3231us total) trans 4294967437 rc 0/0 00000100:00100000:1.0:1789049516.295678:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.26@tcp, seq: 39 00000100:00100000:0.0:1789049516.424626:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.26@tcp (source: 12345-192.168.206.26@tcp) 00000100:00100000:2.0:1789049516.424721:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954089659136 00000100:00100000:2.0:1789049516.424731:0:5852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954089659136 00000100:00100000:2.0:1789049516.424787:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.26@tcp, seq: 148 00000100:00100000:2.0:1789049516.424797:0:5852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8f7ac9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e823b53a-3591-475c-8624-c682227e5c13+35:11363:x1875954089659136:12345-192.168.206.26@tcp:101:lfs.0 00010000:00010000:2.0:1789049516.424833:0:5852:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789049516.424893:0:5852:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6715c00/0xf4f48ce5e1bbf7b0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7fc5e358805a359e expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789049516.424977:0:5852:0:(mdt_handler.c:922:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00010000:00010000:2.0:1789049516.425084:0:5852:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6715c00/0xf4f48ce5e1bbf7b0 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a359e expref: 37 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049516.425369:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8cb8e0130500) 00010000:00010000:2.0:1789049516.425374:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1789049516.425380:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6715c00/0xf4f48ce5e1bbf7b0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a359e expref: 37 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049516.425395:0:5852:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cb8d6715c00, rc 0) 00000100:00100000:2.0:1789049516.425496:0:5852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8f7ac9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e823b53a-3591-475c-8624-c682227e5c13+36:11363:x1875954089659136:12345-192.168.206.26@tcp:101:lfs.0 Request processed in 700us (877us total) trans 4294967438 rc 301/301 00000100:00100000:2.0:1789049516.425504:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.26@tcp, seq: 148 00000100:00100000:3.0:1789049516.429178:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.26@tcp (source: 12345-192.168.206.26@tcp) 00000100:00100000:1.0:1789049516.429247:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954089659264 00000100:00100000:1.0:1789049516.429256:0:5851:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954089659264 00000100:00100000:1.0:1789049516.429324:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.26@tcp, seq: 149 00000100:00100000:1.0:1789049516.429334:0:5851:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8df20aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e823b53a-3591-475c-8624-c682227e5c13+36:11363:x1875954089659264:12345-192.168.206.26@tcp:34:lfs.0 00010000:00010000:1.0:1789049516.429405:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c2800/0xf4f48ce5e1bbf7be lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049516.429421:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c2800/0xf4f48ce5e1bbf7be lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049516.429434:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c2800/0xf4f48ce5e1bbf7be lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049516.429447:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c2e00/0xf4f48ce5e1bbf7c5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049516.429455:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c2e00/0xf4f48ce5e1bbf7c5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049516.429462:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c2e00/0xf4f48ce5e1bbf7c5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049516.429543:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c2400/0xf4f48ce5e1bbf7cc lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049516.429552:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c2400/0xf4f48ce5e1bbf7cc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049516.429559:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c2400/0xf4f48ce5e1bbf7cc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789049516.429612:0:5851:0:(mdt_handler.c:2522:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c2400/0xf4f48ce5e1bbf7cc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049516.429623:0:5851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c2800/0xf4f48ce5e1bbf7be lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049516.429629:0:5851:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c2800/0xf4f48ce5e1bbf7be lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049516.429635:0:5851:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c2800/0xf4f48ce5e1bbf7be lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049516.429641:0:5851:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cb8c28c2800 already unused, calling callback (ffffffffc20ca4f0) 00010000:00010000:1.0:1789049516.429645:0:5851:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c2800/0xf4f48ce5e1bbf7be lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049516.429651:0:5851:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c2800/0xf4f48ce5e1bbf7be lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049516.429662:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8cb8e0130100) 00010000:00010000:1.0:1789049516.429664:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789049516.429669:0:5851:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c2800/0xf4f48ce5e1bbf7be lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049516.429675:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c2800/0xf4f48ce5e1bbf7be lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049516.429688:0:5851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c2e00/0xf4f48ce5e1bbf7c5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049516.429694:0:5851:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c2e00/0xf4f48ce5e1bbf7c5 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049516.429706:0:5851:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c2e00/0xf4f48ce5e1bbf7c5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049516.429711:0:5851:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cb8c28c2e00 already unused, calling callback (ffffffffc20ca4f0) 00010000:00010000:1.0:1789049516.429714:0:5851:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c2e00/0xf4f48ce5e1bbf7c5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049516.429721:0:5851:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c2e00/0xf4f48ce5e1bbf7c5 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049516.429728:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8cb8c396da00) 00010000:00010000:1.0:1789049516.429731:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789049516.429734:0:5851:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c2e00/0xf4f48ce5e1bbf7c5 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049516.429739:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c2e00/0xf4f48ce5e1bbf7c5 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049516.429753:0:5851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c2400/0xf4f48ce5e1bbf7cc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049516.429760:0:5851:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c2400/0xf4f48ce5e1bbf7cc lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049516.429766:0:5851:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c2400/0xf4f48ce5e1bbf7cc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049516.429771:0:5851:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cb8c28c2400 already unused, calling callback (ffffffffc20ca4f0) 00010000:00010000:1.0:1789049516.429774:0:5851:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c2400/0xf4f48ce5e1bbf7cc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049516.429788:0:5851:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c2400/0xf4f48ce5e1bbf7cc lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049516.429796:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8cb8c687d500) 00010000:00010000:1.0:1789049516.429798:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789049516.429801:0:5851:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c2400/0xf4f48ce5e1bbf7cc lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049516.429807:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c2400/0xf4f48ce5e1bbf7cc lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789049516.430492:0:5851:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8df20aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e823b53a-3591-475c-8624-c682227e5c13+36:11363:x1875954089659264:12345-192.168.206.26@tcp:34:lfs.0 Request processed in 1155us (1317us total) trans 0 rc 0/0 00000100:00100000:1.0:1789049516.430502:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.26@tcp, seq: 149 00000100:00100000:3.0:1789049516.435172:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.26@tcp (source: 12345-192.168.206.26@tcp) 00000100:00100000:2.0:1789049516.435299:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954089659520 00000100:00100000:2.0:1789049516.435322:0:5853:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954089659520 00000100:00100000:2.0:1789049516.435377:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.26@tcp, seq: 40 00000100:00100000:2.0:1789049516.435387:0:5853:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8df208a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e823b53a-3591-475c-8624-c682227e5c13+36:11363:x1875954089659520:12345-192.168.206.26@tcp:35:lfs.0 00000100:00100000:2.0:1789049516.435578:0:5853:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8df208a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e823b53a-3591-475c-8624-c682227e5c13+37:11363:x1875954089659520:12345-192.168.206.26@tcp:35:lfs.0 Request processed in 193us (425us total) trans 4294967439 rc 0/0 00000100:00100000:2.0:1789049516.435587:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.26@tcp, seq: 40 00000100:00100000:3.0:1789049516.444386:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789049516.444408:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb8c12aaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3311:1875954110633600:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789049516.444472:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789049516.444578:0:6707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954110633600 00000100:00100000:1.0:1789049516.444587:0:6707:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954110633600 00000100:00100000:1.0:1789049516.444654:0:6707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1789049516.444663:0:6707:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb900a1ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1875954110633600:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789049516.444696:0:6707:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789049516.444740:0:6707:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb900a1ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1875954110633600:12345-0@lo:13:osp-pre-0-0.0 Request processed in 79us (268us total) trans 0 rc 0/0 00000100:00100000:1.0:1789049516.444747:0:6707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00080000:2.0:1789049516.444793:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789049516.444899:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb8c12aaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3311:1875954110633600:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789049516.481075:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.26@tcp (source: 12345-192.168.206.26@tcp) 00000100:00100000:3.0:1789049516.481289:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954089659776 00000100:00100000:3.0:1789049516.481298:0:5850:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954089659776 00000100:00100000:3.0:1789049516.481352:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.26@tcp, seq: 150 00000100:00100000:3.0:1789049516.481362:0:5850:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8c12ab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e823b53a-3591-475c-8624-c682227e5c13+37:11366:x1875954089659776:12345-192.168.206.26@tcp:101:lfs.0 00010000:00010000:3.0:1789049516.481402:0:5850:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789049516.481421:0:5850:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c6b35a00/0xf4f48ce5e1bbf7d3 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7fc5e358805a35a5 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049516.481487:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c6b35800/0xf4f48ce5e1bbf7da lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049516.481502:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c6b35800/0xf4f48ce5e1bbf7da lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049516.481513:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c6b35800/0xf4f48ce5e1bbf7da lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049516.481526:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c6b35400/0xf4f48ce5e1bbf7e1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049516.481534:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c6b35400/0xf4f48ce5e1bbf7e1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049516.481540:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c6b35400/0xf4f48ce5e1bbf7e1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049516.481647:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c6b34e00/0xf4f48ce5e1bbf7e8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049516.481656:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c6b34e00/0xf4f48ce5e1bbf7e8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049516.481663:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c6b34e00/0xf4f48ce5e1bbf7e8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789049516.481672:0:5850:0:(mdt_handler.c:922:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:3.0:1789049516.481768:0:5850:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c6b35800/0xf4f48ce5e1bbf7da lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049516.481776:0:5850:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c6b35800/0xf4f48ce5e1bbf7da lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049516.481781:0:5850:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c6b35800/0xf4f48ce5e1bbf7da lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049516.481787:0:5850:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cb8c6b35800 already unused, calling callback (ffffffffc20ca4f0) 00010000:00010000:3.0:1789049516.481790:0:5850:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c6b35800/0xf4f48ce5e1bbf7da lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049516.481797:0:5850:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c6b35800/0xf4f48ce5e1bbf7da lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049516.481807:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8cb8e0130100) 00010000:00010000:3.0:1789049516.481821:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789049516.481827:0:5850:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c6b35800/0xf4f48ce5e1bbf7da lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049516.481833:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c6b35800/0xf4f48ce5e1bbf7da lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049516.481876:0:5850:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c6b35400/0xf4f48ce5e1bbf7e1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049516.481883:0:5850:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c6b35400/0xf4f48ce5e1bbf7e1 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049516.481889:0:5850:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c6b35400/0xf4f48ce5e1bbf7e1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049516.481903:0:5850:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cb8c6b35400 already unused, calling callback (ffffffffc20ca4f0) 00010000:00010000:3.0:1789049516.481906:0:5850:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c6b35400/0xf4f48ce5e1bbf7e1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049516.481913:0:5850:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c6b35400/0xf4f48ce5e1bbf7e1 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049516.481922:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8cb8c687d800) 00010000:00010000:3.0:1789049516.481924:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789049516.481927:0:5850:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c6b35400/0xf4f48ce5e1bbf7e1 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049516.481933:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c6b35400/0xf4f48ce5e1bbf7e1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049516.481969:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c6b35a00/0xf4f48ce5e1bbf7d3 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a35a5 expref: 40 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049516.481982:0:5850:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c6b34e00/0xf4f48ce5e1bbf7e8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a35a5 expref: 39 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049516.481989:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8cb8c687d500) 00010000:00010000:3.0:1789049516.481991:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789049516.481993:0:5850:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cb8c6b34e00, rc 0) 00000100:00100000:3.0:1789049516.482052:0:5850:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8c12ab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e823b53a-3591-475c-8624-c682227e5c13+39:11366:x1875954089659776:12345-192.168.206.26@tcp:101:lfs.0 Request processed in 691us (985us total) trans 4294967440 rc 0/0 00000100:00100000:3.0:1789049516.482059:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.26@tcp, seq: 150 00000100:00100000:0.0:1789049516.487656:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.26@tcp (source: 12345-192.168.206.26@tcp) 00000100:00100000:3.0:1789049516.487740:0:6841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954089659904 00000100:00100000:3.0:1789049516.487761:0:6841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954089659904 00000100:00100000:3.0:1789049516.487827:0:6841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.26@tcp, seq: 151 00000100:00100000:3.0:1789049516.487837:0:6841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8f7ac9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e823b53a-3591-475c-8624-c682227e5c13+39:11366:x1875954089659904:12345-192.168.206.26@tcp:54:lfs.0 00010000:00010000:3.0:1789049516.487928:0:6841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c6b35a00/0xf4f48ce5e1bbf7f6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049516.487944:0:6841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c6b35a00/0xf4f48ce5e1bbf7f6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049516.487957:0:6841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c6b35a00/0xf4f48ce5e1bbf7f6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049516.487981:0:6841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c6b35a00/0xf4f48ce5e1bbf7f6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049516.487989:0:6841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c6b35a00/0xf4f48ce5e1bbf7f6 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049516.487996:0:6841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c6b35a00/0xf4f48ce5e1bbf7f6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049516.488003:0:6841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cb8c6b35a00 already unused, calling callback (ffffffffc20ca4f0) 00010000:00010000:3.0:1789049516.488007:0:6841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c6b35a00/0xf4f48ce5e1bbf7f6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049516.488015:0:6841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c6b35a00/0xf4f48ce5e1bbf7f6 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049516.488027:0:6841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8cb8c687d500) 00010000:00010000:3.0:1789049516.488030:0:6841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1789049516.488034:0:6841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c6b35a00/0xf4f48ce5e1bbf7f6 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049516.488052:0:6841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c6b35a00/0xf4f48ce5e1bbf7f6 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6841 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789049516.488134:0:6841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8f7ac9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e823b53a-3591-475c-8624-c682227e5c13+39:11366:x1875954089659904:12345-192.168.206.26@tcp:54:lfs.0 Request processed in 298us (486us total) trans 0 rc 0/0 00000100:00100000:3.0:1789049516.488142:0:6841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.26@tcp, seq: 151 00000100:00100000:0.0:1789049516.491143:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.26@tcp (source: 12345-192.168.206.26@tcp) 00000100:00100000:2.0:1789049516.491294:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954089660160 00000100:00100000:2.0:1789049516.491304:0:5853:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954089660160 00000100:00100000:2.0:1789049516.491360:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.26@tcp, seq: 41 00000100:00100000:2.0:1789049516.491370:0:5853:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8f7acb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e823b53a-3591-475c-8624-c682227e5c13+39:11366:x1875954089660160:12345-192.168.206.26@tcp:35:lfs.0 00000100:00100000:2.0:1789049516.491592:0:5853:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8f7acb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e823b53a-3591-475c-8624-c682227e5c13+40:11366:x1875954089660160:12345-192.168.206.26@tcp:35:lfs.0 Request processed in 223us (457us total) trans 4294967441 rc 0/0 00000100:00100000:2.0:1789049516.491600:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.26@tcp, seq: 41 00010000:00010000:0.0:1789049516.763047:0:6719:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789049516.791593:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.26@tcp (source: 12345-192.168.206.26@tcp) 00000100:00100000:3.0:1789049516.791698:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954089660416 00000100:00100000:3.0:1789049516.791707:0:5850:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954089660416 00000100:00100000:3.0:1789049516.791765:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.26@tcp, seq: 152 00000100:00100000:3.0:1789049516.791774:0:5850:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8c12aaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e823b53a-3591-475c-8624-c682227e5c13+40:11397:x1875954089660416:12345-192.168.206.26@tcp:101:cat.0 00010000:00010000:3.0:1789049516.791796:0:5850:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789049516.791824:0:5850:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c6b35a00/0xf4f48ce5e1bbf7fd lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7fc5e358805a35ac expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049516.791940:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c6b35400/0xf4f48ce5e1bbf804 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049516.791954:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c6b35400/0xf4f48ce5e1bbf804 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049516.791966:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c6b35400/0xf4f48ce5e1bbf804 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789049516.791978:0:5850:0:(mdt_handler.c:922:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:3.0:1789049516.792099:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c6b35a00/0xf4f48ce5e1bbf7fd lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a35ac expref: 43 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049516.792117:0:5850:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c6b35400/0xf4f48ce5e1bbf804 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a35ac expref: 42 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049516.792139:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8cb8c687d500) 00010000:00010000:3.0:1789049516.792142:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789049516.792145:0:5850:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cb8c6b35400, rc 0) 00000100:00100000:3.0:1789049516.792212:0:5850:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8c12aaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e823b53a-3591-475c-8624-c682227e5c13+42:11397:x1875954089660416:12345-192.168.206.26@tcp:101:cat.0 Request processed in 439us (628us total) trans 4294967442 rc 0/0 00000100:00100000:3.0:1789049516.792219:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.26@tcp, seq: 152 00000100:00100000:0.0:1789049516.801930:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.26@tcp (source: 12345-192.168.206.26@tcp) 00000100:00100000:0.0:1789049516.802009:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.26@tcp (source: 12345-192.168.206.26@tcp) 00000100:00100000:2.0:1789049516.803025:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954089660672 00000100:00100000:2.0:1789049516.803038:0:5853:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954089660672 00000100:00100000:2.0:1789049516.803109:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.26@tcp, seq: 42 00000100:00100000:2.0:1789049516.803119:0:5853:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8f7ac8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e823b53a-3591-475c-8624-c682227e5c13+42:11397:x1875954089660672:12345-192.168.206.26@tcp:35:cat.0 00000100:00100000:2.0:1789049516.803404:0:5853:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8f7ac8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e823b53a-3591-475c-8624-c682227e5c13+43:11397:x1875954089660672:12345-192.168.206.26@tcp:35:cat.0 Request processed in 286us (1484us total) trans 4294967443 rc 0/0 00000100:00100000:2.0:1789049516.803413:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.26@tcp, seq: 42 00000100:00100000:3.0:1789049516.803682:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954089660800 00000100:00100000:3.0:1789049516.803687:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954089660800 00000100:00100000:3.0:1789049516.803733:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.26@tcp, seq: 11 00000100:00100000:3.0:1789049516.803741:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8f7acad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e823b53a-3591-475c-8624-c682227e5c13+43:2357:x1875954089660800:12345-192.168.206.26@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789049516.803752:0:5836:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789049516.803774:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c6b35400/0xf4f48ce5e1bbf804 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a35ac expref: 43 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049516.803790:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8cb8c687d500) 00010000:00010000:3.0:1789049516.803795:0:5836:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789049516.803826:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8f7acad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e823b53a-3591-475c-8624-c682227e5c13+42:2357:x1875954089660800:12345-192.168.206.26@tcp:103:ldlm_bl.0 Request processed in 86us (1816us total) trans 0 rc 0/0 00000100:00100000:3.0:1789049516.803832:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.26@tcp, seq: 11 00000100:00100000:0.0:1789049516.884227:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.26@tcp (source: 12345-192.168.206.26@tcp) 00000100:00100000:3.0:1789049516.887058:0:6841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954089661056 00000100:00100000:3.0:1789049516.887071:0:6841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954089661056 00000100:00100000:3.0:1789049516.887139:0:6841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.26@tcp, seq: 153 00000100:00100000:3.0:1789049516.887148:0:6841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8f7ac9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e823b53a-3591-475c-8624-c682227e5c13+42:11403:x1875954089661056:12345-192.168.206.26@tcp:101:dd.0 00010000:00010000:3.0:1789049516.887172:0:6841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789049516.887175:0:6841:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1789049516.887218:0:6841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c6b35e00/0xf4f48ce5e1bbf76a lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a3582 expref: 42 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049516.887239:0:6841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8cb8e0130100) 00010000:00010000:3.0:1789049516.887244:0:6841:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789049516.887257:0:6841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c6b35400/0xf4f48ce5e1bbf812 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7fc5e358805a35b3 expref: -99 pid: 6841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049516.887349:0:6841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c6b35a00/0xf4f48ce5e1bbf819 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049516.887364:0:6841:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c6b34e00/0xf4f48ce5e1bbf7e8 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a35a5 expref: 42 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049516.887372:0:6841:0:(ldlm_resource.c:1751:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c6b35a00/0xf4f48ce5e1bbf819 lrc: 4/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049516.887401:0:6841:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c6b34e00/0xf4f48ce5e1bbf7e8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a35a5 expref: 42 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049516.887428:0:6841:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c6b34e00/0xf4f48ce5e1bbf7e8 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a35a5 expref: 42 pid: 5850 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789049516.887441:0:6841:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb900a1dc00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6841:1875954110633728:192.168.206.26@tcp:104: 00000100:00100000:3.0:1789049516.887538:0:6841:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cb8c799f540 going to sleep for 11 seconds 00000100:00100000:0.0:1789049516.898969:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.26@tcp (source: 12345-192.168.206.26@tcp) 00000100:00100000:1.0:1789049516.899110:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954089661184 00000100:00100000:1.0:1789049516.899123:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954089661184 00010000:00010000:1.0:1789049516.899191:0:5837:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c6b34e00/0xf4f48ce5e1bbf7e8 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a35a5 expref: 43 pid: 5850 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789049516.899253:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.26@tcp, seq: 63 00000100:00100000:1.0:1789049516.899293:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8f7ac9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e823b53a-3591-475c-8624-c682227e5c13+43:2357:x1875954089661184:12345-192.168.206.26@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789049516.899643:0:5837:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789049516.899653:0:5837:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c6b34e00/0xf4f48ce5e1bbf7e8 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a35a5 expref: 43 pid: 5850 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049516.899671:0:5837:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c6b34e00/0xf4f48ce5e1bbf7e8 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a35a5 expref: 43 pid: 5850 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049516.899700:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8cb8c687d500) 00010000:00010000:1.0:1789049516.899707:0:5837:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c6b35a00/0xf4f48ce5e1bbf819 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049516.899718:0:5837:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c6b35a00/0xf4f48ce5e1bbf819 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049516.899728:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c6b35a00/0xf4f48ce5e1bbf819 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049516.899753:0:5837:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789049516.899837:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8f7ac9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e823b53a-3591-475c-8624-c682227e5c13+43:2357:x1875954089661184:12345-192.168.206.26@tcp:103:ldlm_bl.0 Request processed in 547us (881us total) trans 0 rc 0/0 00000100:00100000:1.0:1789049516.899903:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.26@tcp, seq: 63 00010000:00010000:3.0:1789049516.903758:0:6841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c6b34e00/0xf4f48ce5e1bbf7e8 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a35a5 expref: 42 pid: 5850 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789049516.903791:0:6841:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb900a1dc00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6841:1875954110633728:192.168.206.26@tcp:104: 00010000:00010000:3.0:1789049516.903874:0:6841:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c6b35a00/0xf4f48ce5e1bbf819 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049516.903887:0:6841:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c6b35a00/0xf4f48ce5e1bbf819 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049516.903894:0:6841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c6b35a00/0xf4f48ce5e1bbf819 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6841 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789049516.903926:0:6841:0:(mdt_handler.c:922:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:3.0:1789049516.904125:0:6841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c6b35400/0xf4f48ce5e1bbf812 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a35b3 expref: 43 pid: 6841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049516.904142:0:6841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c6b35a00/0xf4f48ce5e1bbf819 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a35b3 expref: 42 pid: 6841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049516.904151:0:6841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8cb8c687d500) 00010000:00010000:3.0:1789049516.904155:0:6841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1789049516.904159:0:6841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cb8c6b35a00, rc 0) 00000100:00100000:3.0:1789049516.905195:0:6841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8f7ac9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e823b53a-3591-475c-8624-c682227e5c13+42:11403:x1875954089661056:12345-192.168.206.26@tcp:101:dd.0 Request processed in 18037us (20965us total) trans 4294967444 rc 0/0 00000100:00100000:3.0:1789049516.905207:0:6841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.26@tcp, seq: 153 00000100:00100000:0.0:1789049516.912287:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.26@tcp (source: 12345-192.168.206.26@tcp) 00000100:00100000:3.0:1789049516.912443:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954089661440 00000100:00100000:3.0:1789049516.912456:0:5850:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954089661440 00000100:00100000:3.0:1789049516.912537:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.26@tcp, seq: 154 00000100:00100000:3.0:1789049516.912550:0:5850:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8f7acb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e823b53a-3591-475c-8624-c682227e5c13+42:11403:x1875954089661440:12345-192.168.206.26@tcp:36:dd.0 00010000:00010000:3.0:1789049516.913096:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c6b35e00/0xf4f48ce5e1bbf827 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049516.913140:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c6b35e00/0xf4f48ce5e1bbf827 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049516.913165:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c6b35e00/0xf4f48ce5e1bbf827 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789049516.913227:0:5850:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967445 00000004:00010000:3.0:1789049516.913252:0:5850:0:(mdt_handler.c:4507:mdt_save_lock()) ### save lock request 00000000abee95f6 reply state 00000000697b6126 transno 4294967446 ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c6b35e00/0xf4f48ce5e1bbf827 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789049516.913261:0:5850:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1789049516.913569:0:5850:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8f7acb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e823b53a-3591-475c-8624-c682227e5c13+45:11403:x1875954089661440:12345-192.168.206.26@tcp:36:dd.0 Request processed in 1017us (1299us total) trans 4294967446 rc 0/0 00000100:00100000:3.0:1789049516.913578:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.26@tcp, seq: 154 00000020:00080000:3.0:1789049516.913584:0:5850:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1789049516.917747:0:3295:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c6b35e00/0xf4f48ce5e1bbf827 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049516.917771:0:3295:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c6b35e00/0xf4f48ce5e1bbf827 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049516.917798:0:3295:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c6b35e00/0xf4f48ce5e1bbf827 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049516.917806:0:3295:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cb8c6b35e00 already unused, calling callback (ffffffffc20ca4f0) 00010000:00010000:2.0:1789049516.917823:0:3295:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c6b35e00/0xf4f48ce5e1bbf827 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049516.917834:0:3295:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c6b35e00/0xf4f48ce5e1bbf827 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049516.917894:0:3295:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8cb8c687d500) 00010000:00010000:2.0:1789049516.917899:0:3295:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789049516.917905:0:3295:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c6b35e00/0xf4f48ce5e1bbf827 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049516.917912:0:3295:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c6b35e00/0xf4f48ce5e1bbf827 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789049517.256599:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.26@tcp (source: 12345-192.168.206.26@tcp) 00000100:00100000:1.0:1789049517.261685:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954089661568 00000100:00100000:1.0:1789049517.261707:0:5851:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954089661568 00000100:00100000:1.0:1789049517.261861:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.26@tcp, seq: 155 00000100:00100000:1.0:1789049517.261876:0:5851:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8f7aca680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e823b53a-3591-475c-8624-c682227e5c13+44:11417:x1875954089661568:12345-192.168.206.26@tcp:101:stat.0 00010000:00010000:1.0:1789049517.261922:0:5851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789049517.261954:0:5851:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c2e00/0xf4f48ce5e1bbf82e lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7fc5e358805a35ba expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049517.262064:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c2800/0xf4f48ce5e1bbf835 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049517.262083:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c2800/0xf4f48ce5e1bbf835 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049517.262098:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c2800/0xf4f48ce5e1bbf835 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049517.262116:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c2c00/0xf4f48ce5e1bbf83c lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049517.262124:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c2c00/0xf4f48ce5e1bbf83c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049517.262131:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c2c00/0xf4f48ce5e1bbf83c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:2.0:1789049517.262680:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1789049517.262772:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c3400/0xf4f48ce5e1bbf843 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049517.262789:0:5851:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c6b35a00/0xf4f48ce5e1bbf819 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a35b3 expref: 45 pid: 6841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049517.262798:0:5851:0:(ldlm_resource.c:1751:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c3400/0xf4f48ce5e1bbf843 lrc: 4/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049517.262889:0:5851:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c6b35a00/0xf4f48ce5e1bbf819 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a35b3 expref: 45 pid: 6841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049517.263054:0:5851:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c6b35a00/0xf4f48ce5e1bbf819 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a35b3 expref: 45 pid: 6841 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789049517.263072:0:5851:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb8df260380 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5851:1875954110633856:192.168.206.26@tcp:104: 00000100:00100000:1.0:1789049517.269748:0:5851:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cb8c7c979c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789049517.274692:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.26@tcp (source: 12345-192.168.206.26@tcp) 00000100:00100000:3.0:1789049517.274929:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954089661824 00000100:00100000:3.0:1789049517.274942:0:5853:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954089661824 00000100:00100000:3.0:1789049517.275018:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.26@tcp, seq: 43 00000100:00100000:3.0:1789049517.275030:0:5853:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8fc99a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e823b53a-3591-475c-8624-c682227e5c13+46:5594:x1875954089661824:12345-192.168.206.26@tcp:35:ldlm_bl.0 00000100:00100000:3.0:1789049517.275472:0:5853:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8fc99a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e823b53a-3591-475c-8624-c682227e5c13+47:5594:x1875954089661824:12345-192.168.206.26@tcp:35:ldlm_bl.0 Request processed in 442us (792us total) trans 4294967447 rc 0/0 00000100:00100000:3.0:1789049517.275481:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.26@tcp, seq: 43 00000100:00100000:2.0:1789049517.278498:0:5851:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb8df260380 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5851:1875954110633856:192.168.206.26@tcp:104: 00010000:00010000:2.0:1789049517.278538:0:5851:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c3400/0xf4f48ce5e1bbf843 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789049517.280764:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.26@tcp (source: 12345-192.168.206.26@tcp) 00000100:00100000:3.0:1789049517.280985:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954089661952 00000100:00100000:3.0:1789049517.280999:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954089661952 00010000:00010000:3.0:1789049517.281054:0:5836:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c6b35a00/0xf4f48ce5e1bbf819 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a35b3 expref: 47 pid: 6841 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789049517.281113:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.26@tcp, seq: 64 00000100:00100000:3.0:1789049517.281146:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8c7defc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e823b53a-3591-475c-8624-c682227e5c13+47:2357:x1875954089661952:12345-192.168.206.26@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789049517.281178:0:5836:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789049517.281187:0:5836:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c6b35a00/0xf4f48ce5e1bbf819 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a35b3 expref: 47 pid: 6841 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049517.281201:0:5836:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c6b35a00/0xf4f48ce5e1bbf819 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a35b3 expref: 47 pid: 6841 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049517.281227:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c6b35a00/0xf4f48ce5e1bbf819 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a35b3 expref: 47 pid: 6841 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049517.281247:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8cb8c687d500) 00010000:00010000:3.0:1789049517.281252:0:5836:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c3400/0xf4f48ce5e1bbf843 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049517.281263:0:5836:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c3400/0xf4f48ce5e1bbf843 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049517.281272:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c3400/0xf4f48ce5e1bbf843 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049517.281311:0:5836:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789049517.281387:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8c7defc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e823b53a-3591-475c-8624-c682227e5c13+46:2357:x1875954089661952:12345-192.168.206.26@tcp:103:ldlm_bl.0 Request processed in 245us (637us total) trans 0 rc 0/0 00000100:00100000:3.0:1789049517.281396:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.26@tcp, seq: 64 00010000:00010000:2.0:1789049517.282708:0:5851:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c3400/0xf4f48ce5e1bbf843 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049517.282739:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c3400/0xf4f48ce5e1bbf843 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789049517.282826:0:5851:0:(mdt_handler.c:922:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:2.0:1789049517.282889:0:5851:0:(mdt_handler.c:1587:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1789049517.282920:0:5851:0:(mdt_handler.c:2522:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c3400/0xf4f48ce5e1bbf843 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049517.282938:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c3400/0xf4f48ce5e1bbf843 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049517.282951:0:5851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c2800/0xf4f48ce5e1bbf835 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049517.282958:0:5851:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c2800/0xf4f48ce5e1bbf835 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049517.282966:0:5851:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c2800/0xf4f48ce5e1bbf835 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049517.282973:0:5851:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cb8c28c2800 already unused, calling callback (ffffffffc20ca4f0) 00010000:00010000:2.0:1789049517.282979:0:5851:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c2800/0xf4f48ce5e1bbf835 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049517.282987:0:5851:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c2800/0xf4f48ce5e1bbf835 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049517.283003:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8cb8e0130100) 00010000:00010000:2.0:1789049517.283007:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789049517.283013:0:5851:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c2800/0xf4f48ce5e1bbf835 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049517.283019:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c2800/0xf4f48ce5e1bbf835 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049517.283040:0:5851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c2c00/0xf4f48ce5e1bbf83c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049517.283057:0:5851:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c2c00/0xf4f48ce5e1bbf83c lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049517.283063:0:5851:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c2c00/0xf4f48ce5e1bbf83c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049517.283067:0:5851:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cb8c28c2c00 already unused, calling callback (ffffffffc20ca4f0) 00010000:00010000:2.0:1789049517.283070:0:5851:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c2c00/0xf4f48ce5e1bbf83c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049517.283076:0:5851:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c2c00/0xf4f48ce5e1bbf83c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049517.283084:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8cb8c396da00) 00010000:00010000:2.0:1789049517.283087:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789049517.283089:0:5851:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c2c00/0xf4f48ce5e1bbf83c lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049517.283095:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c2c00/0xf4f48ce5e1bbf83c lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049517.283148:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c2e00/0xf4f48ce5e1bbf82e lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a35ba expref: 46 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049517.283179:0:5851:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c3400/0xf4f48ce5e1bbf843 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a35ba expref: 45 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049517.283187:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8cb8c687d500) 00010000:00010000:2.0:1789049517.283189:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789049517.283199:0:5851:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cb8c28c3400, rc 0) 00000100:00100000:2.0:1789049517.283263:0:5851:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8f7aca680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e823b53a-3591-475c-8624-c682227e5c13+45:11417:x1875954089661568:12345-192.168.206.26@tcp:101:stat.0 Request processed in 21389us (26679us total) trans 0 rc 0/0 00000100:00100000:2.0:1789049517.283272:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.26@tcp, seq: 155 00000100:00100000:0.0:1789049517.407944:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.26@tcp (source: 12345-192.168.206.26@tcp) 00000100:00100000:3.0:1789049517.408083:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954089662208 00000100:00100000:3.0:1789049517.408097:0:5850:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954089662208 00000100:00100000:3.0:1789049517.408183:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.26@tcp, seq: 156 00000100:00100000:3.0:1789049517.408194:0:5850:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8f7acbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e823b53a-3591-475c-8624-c682227e5c13+45:11423:x1875954089662208:12345-192.168.206.26@tcp:36:truncate.0 00010000:00010000:3.0:1789049517.408286:0:5850:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789049517.408319:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c3400/0xf4f48ce5e1bbf843 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a35ba expref: 45 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049517.408343:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8cb8c687d500) 00010000:00010000:3.0:1789049517.408348:0:5850:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789049517.408603:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c6b35a00/0xf4f48ce5e1bbf84a lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049517.408619:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c6b35a00/0xf4f48ce5e1bbf84a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049517.408630:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c6b35a00/0xf4f48ce5e1bbf84a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789049517.408684:0:5850:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967448 00000004:00010000:3.0:1789049517.408970:0:5850:0:(mdt_handler.c:4507:mdt_save_lock()) ### save lock request 000000003e661a1a reply state 00000000f26a34fe transno 4294967449 ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c6b35a00/0xf4f48ce5e1bbf84a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789049517.408981:0:5850:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1789049517.409103:0:5850:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8f7acbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e823b53a-3591-475c-8624-c682227e5c13+47:11423:x1875954089662208:12345-192.168.206.26@tcp:36:truncate.0 Request processed in 909us (1171us total) trans 4294967449 rc 0/0 00000100:00100000:3.0:1789049517.409112:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.26@tcp, seq: 156 00000020:00080000:3.0:1789049517.409118:0:5850:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1789049517.416694:0:3294:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c6b35a00/0xf4f48ce5e1bbf84a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049517.416715:0:3294:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c6b35a00/0xf4f48ce5e1bbf84a lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049517.416723:0:3294:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c6b35a00/0xf4f48ce5e1bbf84a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049517.416730:0:3294:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cb8c6b35a00 already unused, calling callback (ffffffffc20ca4f0) 00010000:00010000:1.0:1789049517.416736:0:3294:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c6b35a00/0xf4f48ce5e1bbf84a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049517.416744:0:3294:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c6b35a00/0xf4f48ce5e1bbf84a lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049517.416765:0:3294:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8cb8c687d500) 00010000:00010000:1.0:1789049517.416768:0:3294:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789049517.416774:0:3294:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c6b35a00/0xf4f48ce5e1bbf84a lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049517.416782:0:3294:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c6b35a00/0xf4f48ce5e1bbf84a lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1789049517.467237:0:8129:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 343519390358ns, next at 344519387510ns, rc = 0 00000100:00100000:3.0:1789049517.467277:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb900a1dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3311:1875954110633984:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789049517.467363:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789049517.467963:0:6707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954110633984 00000100:00100000:1.0:1789049517.467976:0:6707:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954110633984 00000100:00100000:1.0:1789049517.468032:0:6707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1789049517.468041:0:6707:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8f7747480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3311:x1875954110633984:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789049517.468070:0:6707:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 51052544 pending 1703936 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789049517.468137:0:6707:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8f7747480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3311:x1875954110633984:12345-0@lo:13:osp-pre-1-0.0 Request processed in 95us (772us total) trans 0 rc 0/0 00000100:00100000:1.0:1789049517.468144:0:6707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1789049517.468212:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb900a1dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3311:1875954110633984:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789049517.470344:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb8fc999500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7ef694ec-1ea0-4f02-800c-d1279b4fdf12:3308:1875954110634112:0@lo:400:kworker.0 00000100:00100000:3.0:1789049517.470867:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb900a1dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3309:1875954110634240:0@lo:400:kworker.0 00000100:00100000:3.0:1789049517.470966:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789049517.471028:0:6841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954110634240 00000100:00100000:3.0:1789049517.471037:0:6841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954110634240 00000100:00100000:3.0:1789049517.471089:0:6841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:3.0:1789049517.471099:0:6841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb900a5a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1875954110634240:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789049517.471155:0:6841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb900a5a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1875954110634240:12345-0@lo:400:kworker.0 Request processed in 57us (189us total) trans 0 rc 0/0 00000100:00100000:3.0:1789049517.471162:0:6841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:3.0:1789049517.471212:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb900a1dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3309:1875954110634240:0@lo:400:kworker.0 00000100:00100000:3.0:1789049517.471263:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb9009c3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3310:1875954110634368:0@lo:400:kworker.0 00000100:00100000:3.0:1789049517.471290:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789049517.471318:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789049517.471325:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb9009c2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1875954110634496:0@lo:400:kworker.0 00000100:00100000:3.0:1789049517.471352:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789049517.473642:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789049517.475327:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954110634368 00000100:00100000:2.0:1789049517.475349:0:5852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954110634368 00000100:00100000:2.0:1789049517.475443:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:2.0:1789049517.475455:0:5852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb900a1dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1875954110634368:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789049517.475562:0:5852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb900a1dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1875954110634368:12345-0@lo:400:kworker.0 Request processed in 109us (4270us total) trans 0 rc 0/0 00000100:00100000:2.0:1789049517.475571:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00080000:2.0:1789049517.475595:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789049517.476022:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb9009c3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3308:1875954110634624:0@lo:400:kworker.0 00000100:00100000:1.0:1789049517.476070:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789049517.476740:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954110634112 00000100:00100000:0.0:1789049517.476751:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954110634112 00000100:00100000:0.0:1789049517.476798:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 292 00000100:00100000:0.0:1789049517.476818:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8c6296050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7ef694ec-1ea0-4f02-800c-d1279b4fdf12+19:3308:x1875954110634112:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789049517.476909:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8c6296050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7ef694ec-1ea0-4f02-800c-d1279b4fdf12+19:3308:x1875954110634112:12345-0@lo:400:kworker.0 Request processed in 103us (3279us total) trans 0 rc 0/0 00000100:00100000:0.0:1789049517.476918:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 292 00000100:00100000:0.0:1789049517.476973:0:6841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954110634624 00000100:00100000:0.0:1789049517.476977:0:6841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954110634624 00000100:00100000:0.0:1789049517.477010:0:6841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:0.0:1789049517.477016:0:6841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb9009c0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1875954110634624:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789049517.477050:0:6841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb9009c0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1875954110634624:12345-0@lo:400:kworker.0 Request processed in 34us (980us total) trans 0 rc 0/0 00000100:00100000:0.0:1789049517.477056:0:6841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:0.0:1789049517.477103:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb8fc999500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7ef694ec-1ea0-4f02-800c-d1279b4fdf12:3308:1875954110634112:0@lo:400:kworker.0 00000100:00100000:0.0:1789049517.477120:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb9009c3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3308:1875954110634624:0@lo:400:kworker.0 00000100:00080000:2.0:1789049517.479911:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789049517.489528:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb9009c3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3310:1875954110634368:0@lo:400:kworker.0 00000100:00100000:1.0:1789049517.503359:0:6703:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954110634496 00000100:00100000:1.0:1789049517.503380:0:6703:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954110634496 00000100:00100000:1.0:1789049517.503466:0:6703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1789049517.503477:0:6703:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8fce96680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3310:x1875954110634496:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789049517.503598:0:6703:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8fce96680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3310:x1875954110634496:12345-0@lo:400:kworker.0 Request processed in 122us (32243us total) trans 0 rc 0/0 00000100:00100000:1.0:1789049517.503606:0:6703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1789049517.503666:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb9009c2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1875954110634496:0@lo:400:kworker.0 00000001:00080000:3.0:1789049517.578101:0:7663:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967305 is committed 00000001:00080000:3.0:1789049517.578134:0:7663:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967306 is committed 00000100:00100000:3.0:1789049517.586622:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.26@tcp (source: 12345-192.168.206.26@tcp) 00000100:00100000:2.0:1789049517.587416:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954089662336 00000100:00100000:2.0:1789049517.587435:0:5851:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954089662336 00000100:00100000:2.0:1789049517.587530:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.26@tcp, seq: 157 00000100:00100000:2.0:1789049517.587541:0:5851:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8df4d3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e823b53a-3591-475c-8624-c682227e5c13+46:11437:x1875954089662336:12345-192.168.206.26@tcp:101:stat.0 00010000:00010000:2.0:1789049517.587577:0:5851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789049517.587610:0:5851:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6715c00/0xf4f48ce5e1bbf851 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7fc5e358805a35c1 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049517.587700:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6714c00/0xf4f48ce5e1bbf858 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049517.587719:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6714c00/0xf4f48ce5e1bbf858 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049517.587734:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6714c00/0xf4f48ce5e1bbf858 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049517.587773:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6714a00/0xf4f48ce5e1bbf85f lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049517.587781:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6714a00/0xf4f48ce5e1bbf85f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049517.587787:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6714a00/0xf4f48ce5e1bbf85f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049517.588195:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6715a00/0xf4f48ce5e1bbf866 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049517.588205:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6715a00/0xf4f48ce5e1bbf866 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049517.588214:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6715a00/0xf4f48ce5e1bbf866 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789049517.588263:0:5851:0:(mdt_handler.c:922:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 1234567 00000004:00200000:2.0:1789049517.588268:0:5851:0:(mdt_handler.c:1587:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1789049517.588292:0:5851:0:(mdt_handler.c:2522:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6715a00/0xf4f48ce5e1bbf866 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049517.588304:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6715a00/0xf4f48ce5e1bbf866 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049517.588313:0:5851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6714c00/0xf4f48ce5e1bbf858 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049517.588320:0:5851:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6714c00/0xf4f48ce5e1bbf858 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049517.588339:0:5851:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6714c00/0xf4f48ce5e1bbf858 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049517.588345:0:5851:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cb8d6714c00 already unused, calling callback (ffffffffc20ca4f0) 00010000:00010000:2.0:1789049517.588350:0:5851:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6714c00/0xf4f48ce5e1bbf858 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049517.588359:0:5851:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6714c00/0xf4f48ce5e1bbf858 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049517.588372:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8cb8e0130100) 00010000:00010000:2.0:1789049517.588376:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789049517.588383:0:5851:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6714c00/0xf4f48ce5e1bbf858 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049517.588390:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6714c00/0xf4f48ce5e1bbf858 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049517.588405:0:5851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6714a00/0xf4f48ce5e1bbf85f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049517.588412:0:5851:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6714a00/0xf4f48ce5e1bbf85f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049517.588418:0:5851:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6714a00/0xf4f48ce5e1bbf85f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049517.588424:0:5851:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cb8d6714a00 already unused, calling callback (ffffffffc20ca4f0) 00010000:00010000:2.0:1789049517.588427:0:5851:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6714a00/0xf4f48ce5e1bbf85f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049517.588444:0:5851:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6714a00/0xf4f48ce5e1bbf85f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049517.588452:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8cb8e0130300) 00010000:00010000:2.0:1789049517.588454:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789049517.588458:0:5851:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6714a00/0xf4f48ce5e1bbf85f lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049517.588463:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6714a00/0xf4f48ce5e1bbf85f lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049517.588502:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6715c00/0xf4f48ce5e1bbf851 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a35c1 expref: 48 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049517.588516:0:5851:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6715a00/0xf4f48ce5e1bbf866 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a35c1 expref: 47 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049517.588523:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8cb8c687d500) 00010000:00010000:2.0:1789049517.588525:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789049517.588528:0:5851:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cb8d6715a00, rc 0) 00000100:00100000:2.0:1789049517.588611:0:5851:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8df4d3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e823b53a-3591-475c-8624-c682227e5c13+47:11437:x1875954089662336:12345-192.168.206.26@tcp:101:stat.0 Request processed in 1071us (2004us total) trans 0 rc 0/0 00000100:00100000:2.0:1789049517.588621:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.26@tcp, seq: 157 00000001:00080000:3.0:1789049517.605703:0:5872:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967437 is committed 00000001:00080000:3.0:1789049517.605736:0:5872:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967443 is committed 00000004:00080000:3.0:1789049517.605751:0:5872:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 5 committed 00000001:00080000:3.0:1789049517.605775:0:5872:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967449 is committed 00000004:00080000:3.0:1789049517.605796:0:5872:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 4 committed 00000020:00080000:3.0:1789049517.605816:0:5872:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8cb8c799f900 refcount 2 committed 0 result 0 batchid 5 00000020:00080000:3.0:1789049517.605823:0:5872:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8cb8c6236700 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8cb8c799fc00 00000020:00080000:3.0:1789049517.605826:0:5872:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8cb8c6236f00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8cb8f7bb7400 00000020:00080000:3.0:1789049517.605917:0:5883:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 5 committed batchid 4 00000100:00100000:0.0:1789049517.606537:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789049517.606565:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb8f7ac8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1875954110634752:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1789049517.606651:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789049517.606742:0:6705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954110634752 00000100:00100000:0.0:1789049517.606751:0:6705:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954110634752 00000100:00100000:0.0:1789049517.606821:0:6705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1789049517.606830:0:6705:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8f7aca300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3308:x1875954110634752:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:0.0:1789049517.606887:0:6705:0:(ofd_dev.c:1868:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:4 count 1 00002000:00010000:0.0:1789049517.606927:0:6705:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x4:0x0] initial LVB size: 13, mtime: 0x18d3fb0e241b9d65, atime: 0x18d3fb0e3b5a8a95, ctime: 0x18d3fb0e241b9d65, blocks: 0xb 00010000:00010000:0.0:1789049517.606938:0:6705:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001ed3566f/0xf4f48ce5e1bbf86d lrc: 3/0,1 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049517.606958:0:6705:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=343s v=(0 0) 00010000:00010000:0.0:1789049517.606962:0:6705:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789049517.606970:0:6705:0:(ldlm_resource.c:1751:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001ed3566f/0xf4f48ce5e1bbf86d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049517.607006:0:6705:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001ed3566f/0xf4f48ce5e1bbf86d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049517.607018:0:6705:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001ed3566f/0xf4f48ce5e1bbf86d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049517.607026:0:6705:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001ed3566f/0xf4f48ce5e1bbf86d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049517.607045:0:6705:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000020:00080000:3.0:1789049517.607436:0:5883:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00010000:00010000:3.0:1789049517.607452:0:5839:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789049517.607460:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001ed3566f/0xf4f48ce5e1bbf86d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049517.607469:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cb7c4c39400 already unused, calling callback (ffffffffc166a8f0) 00010000:00010000:3.0:1789049517.607474:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001ed3566f/0xf4f48ce5e1bbf86d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049517.607484:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001ed3566f/0xf4f48ce5e1bbf86d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049517.607504:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001ed3566f/0xf4f48ce5e1bbf86d lrc: 1/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049517.607512:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001ed3566f/0xf4f48ce5e1bbf86d lrc: 0/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049517.607535:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789049517.607537:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789049517.607539:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789049517.608741:0:6705:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8f7aca300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3308:x1875954110634752:12345-0@lo:6:osp-syn-1-0.0 Request processed in 1905us (2083us total) trans 4294967307 rc 0/0 00000100:00100000:0.0:1789049517.608755:0:6705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1789049517.608996:0:3308:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967306 gen 2 00000004:00080000:3.0:1789049517.609005:0:3308:0:(osp_trans.c:1063:osp_request_commit_cb()) trans no 4294967306 committed transno 4294967306 00000100:00100000:3.0:1789049517.609035:0:3308:0:(client.c:3170:ptlrpc_free_committed()) @@@ stopping search req@ffff8cb8f7ac8380 x1875954110634752/t4294967307(4294967307) o6->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1789049533 ref 2 fl Rpc:RQU/204/0 rc 0/0 job:'osp-syn-1-0.0' uid:0 gid:0 projid:4294967295 00000004:00080000:3.0:1789049517.609050:0:3308:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8cb8f7ac8380/2, rc 0, transno 4294967307 00000100:00100000:3.0:1789049517.609084:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb8f7ac8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1875954110634752:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1789049517.691902:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.26@tcp (source: 12345-192.168.206.26@tcp) 00000100:00100000:0.0:1789049517.693231:0:6841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954089662592 00000100:00100000:0.0:1789049517.693252:0:6841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954089662592 00000100:00100000:0.0:1789049517.693353:0:6841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.26@tcp, seq: 158 00000100:00100000:0.0:1789049517.693366:0:6841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8c12a8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e823b53a-3591-475c-8624-c682227e5c13+16:11447:x1875954089662592:12345-192.168.206.26@tcp:101:lfs.0 00010000:00010000:0.0:1789049517.693394:0:6841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789049517.693421:0:6841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb7c4c39a00/0xf4f48ce5e1bbf874 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7fc5e358805a35c8 expref: -99 pid: 6841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789049517.693540:0:6841:0:(mdt_handler.c:922:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00010000:00010000:0.0:1789049517.693877:0:6841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb7c4c39a00/0xf4f48ce5e1bbf874 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a35c8 expref: 18 pid: 6841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049517.693919:0:6841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8cb8e0130500) 00010000:00010000:0.0:1789049517.693922:0:6841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1789049517.693927:0:6841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb7c4c39a00/0xf4f48ce5e1bbf874 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a35c8 expref: 18 pid: 6841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049517.693941:0:6841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cb7c4c39a00, rc 0) 00000100:00100000:0.0:1789049517.694033:0:6841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8c12a8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e823b53a-3591-475c-8624-c682227e5c13+17:11447:x1875954089662592:12345-192.168.206.26@tcp:101:lfs.0 Request processed in 670us (2144us total) trans 4294967450 rc 301/301 00000100:00100000:0.0:1789049517.694052:0:6841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.26@tcp, seq: 158 00000100:00100000:0.0:1789049517.706936:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.26@tcp (source: 12345-192.168.206.26@tcp) 00000100:00100000:3.0:1789049517.707150:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954089662848 00000100:00100000:3.0:1789049517.707172:0:5853:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954089662848 00000100:00100000:3.0:1789049517.707259:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.26@tcp, seq: 44 00000100:00100000:3.0:1789049517.707271:0:5853:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8d1d29850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e823b53a-3591-475c-8624-c682227e5c13+17:11447:x1875954089662848:12345-192.168.206.26@tcp:35:lfs.0 00000100:00100000:3.0:1789049517.707870:0:5853:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8d1d29850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e823b53a-3591-475c-8624-c682227e5c13+18:11447:x1875954089662848:12345-192.168.206.26@tcp:35:lfs.0 Request processed in 572us (919us total) trans 4294967451 rc 0/0 00000100:00100000:3.0:1789049517.707880:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.26@tcp, seq: 44 00010000:00010000:0.0:1789049517.787473:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789049517.805982:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.26@tcp (source: 12345-192.168.206.26@tcp) 00000100:00100000:2.0:1789049517.806531:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954089663104 00000100:00100000:2.0:1789049517.806546:0:5851:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954089663104 00000100:00100000:2.0:1789049517.806633:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.26@tcp, seq: 159 00000100:00100000:2.0:1789049517.806645:0:5851:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8df4d3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e823b53a-3591-475c-8624-c682227e5c13+18:11453:x1875954089663104:12345-192.168.206.26@tcp:101:bash.0 00010000:00010000:2.0:1789049517.806694:0:5851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789049517.806720:0:5851:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6714a00/0xf4f48ce5e1bbf882 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7fc5e358805a35cf expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049517.806902:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6714c00/0xf4f48ce5e1bbf889 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049517.806921:0:5851:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6715a00/0xf4f48ce5e1bbf866 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a35c1 expref: 19 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049517.806937:0:5851:0:(ldlm_resource.c:1751:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6714c00/0xf4f48ce5e1bbf889 lrc: 4/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049517.806987:0:5851:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6715a00/0xf4f48ce5e1bbf866 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a35c1 expref: 19 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049517.807003:0:5851:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6715a00/0xf4f48ce5e1bbf866 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a35c1 expref: 19 pid: 5851 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789049517.807019:0:5851:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb8c12aa680 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5851:1875954110634880:192.168.206.26@tcp:104: 00000100:00100000:2.0:1789049517.807426:0:5851:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cb8c63eab40 going to sleep for 11 seconds 00000100:00100000:0.0:1789049517.812261:0:5851:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb8c12aa680 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5851:1875954110634880:192.168.206.26@tcp:104: 00010000:00010000:0.0:1789049517.812313:0:5851:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6714c00/0xf4f48ce5e1bbf889 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789049517.813824:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.26@tcp (source: 12345-192.168.206.26@tcp) 00000100:00100000:0.0:1789049517.815327:0:6720:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954089663232 00000100:00100000:0.0:1789049517.815347:0:6720:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954089663232 00010000:00010000:0.0:1789049517.815416:0:6720:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6715a00/0xf4f48ce5e1bbf866 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a35c1 expref: 20 pid: 5851 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789049517.815473:0:6720:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.26@tcp, seq: 65 00000100:00100000:0.0:1789049517.815485:0:6720:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8df4d1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e823b53a-3591-475c-8624-c682227e5c13+20:2357:x1875954089663232:12345-192.168.206.26@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789049517.815504:0:6720:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789049517.815512:0:6720:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6715a00/0xf4f48ce5e1bbf866 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a35c1 expref: 20 pid: 5851 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049517.815554:0:6720:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6715a00/0xf4f48ce5e1bbf866 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a35c1 expref: 20 pid: 5851 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049517.815583:0:6720:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6715a00/0xf4f48ce5e1bbf866 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a35c1 expref: 20 pid: 5851 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049517.815604:0:6720:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8cb8c687d500) 00010000:00010000:0.0:1789049517.815611:0:6720:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6714c00/0xf4f48ce5e1bbf889 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049517.815621:0:6720:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6714c00/0xf4f48ce5e1bbf889 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049517.815631:0:6720:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6714c00/0xf4f48ce5e1bbf889 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049517.815672:0:6720:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789049517.816031:0:5851:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6714c00/0xf4f48ce5e1bbf889 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049517.816040:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6714c00/0xf4f48ce5e1bbf889 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789049517.816064:0:5851:0:(mdt_handler.c:922:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 1234567 00010000:00010000:2.0:1789049517.816254:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6714a00/0xf4f48ce5e1bbf882 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a35cf expref: 21 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049517.816282:0:5851:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6714c00/0xf4f48ce5e1bbf889 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a35cf expref: 20 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049517.816291:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8cb8c687d500) 00010000:00010000:2.0:1789049517.816294:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1789049517.816307:0:5851:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cb8d6714c00, rc 0) 00000100:00100000:2.0:1789049517.816365:0:5851:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8df4d3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e823b53a-3591-475c-8624-c682227e5c13+20:11453:x1875954089663104:12345-192.168.206.26@tcp:101:bash.0 Request processed in 9722us (10396us total) trans 4294967452 rc 0/0 00000100:00100000:2.0:1789049517.816374:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.26@tcp, seq: 159 00000100:00100000:0.0:1789049517.816552:0:6720:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8df4d1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e823b53a-3591-475c-8624-c682227e5c13+19:2357:x1875954089663232:12345-192.168.206.26@tcp:103:ldlm_bl.0 Request processed in 1069us (2748us total) trans 0 rc 0/0 00000100:00100000:0.0:1789049517.816560:0:6720:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.26@tcp, seq: 65 00000100:00100000:2.0:1789049517.821918:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.26@tcp (source: 12345-192.168.206.26@tcp) 00000100:00100000:0.0:1789049517.822681:0:6841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954089663488 00000100:00100000:0.0:1789049517.822697:0:6841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954089663488 00000100:00100000:0.0:1789049517.822787:0:6841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.26@tcp, seq: 160 00000100:00100000:0.0:1789049517.822799:0:6841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8c12a8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e823b53a-3591-475c-8624-c682227e5c13+19:11453:x1875954089663488:12345-192.168.206.26@tcp:36:bash.0 00010000:00010000:0.0:1789049517.823435:0:6841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb7c4c38a00/0xf4f48ce5e1bbf897 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049517.823457:0:6841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cb7c4c38a00/0xf4f48ce5e1bbf897 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049517.823482:0:6841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb7c4c38a00/0xf4f48ce5e1bbf897 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6841 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789049517.823558:0:6841:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967453 00000004:00010000:0.0:1789049517.823582:0:6841:0:(mdt_handler.c:4507:mdt_save_lock()) ### save lock request 0000000051745e5c reply state 00000000bc26825a transno 4294967454 ns: mdt-lustre-MDT0000_UUID lock: ffff8cb7c4c38a00/0xf4f48ce5e1bbf897 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6841 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789049517.823592:0:6841:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1789049517.823717:0:6841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8c12a8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e823b53a-3591-475c-8624-c682227e5c13+22:11453:x1875954089663488:12345-192.168.206.26@tcp:36:bash.0 Request processed in 916us (1808us total) trans 4294967454 rc 0/0 00000100:00100000:0.0:1789049517.823726:0:6841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.26@tcp, seq: 160 00000020:00080000:0.0:1789049517.823730:0:6841:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1789049517.827679:0:3295:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb7c4c38a00/0xf4f48ce5e1bbf897 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049517.827703:0:3295:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cb7c4c38a00/0xf4f48ce5e1bbf897 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049517.827712:0:3295:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cb7c4c38a00/0xf4f48ce5e1bbf897 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049517.827718:0:3295:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cb7c4c38a00 already unused, calling callback (ffffffffc20ca4f0) 00010000:00010000:2.0:1789049517.827724:0:3295:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb7c4c38a00/0xf4f48ce5e1bbf897 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049517.827733:0:3295:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb7c4c38a00/0xf4f48ce5e1bbf897 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049517.827754:0:3295:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8cb8c687d500) 00010000:00010000:2.0:1789049517.827758:0:3295:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789049517.827786:0:3295:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cb7c4c38a00/0xf4f48ce5e1bbf897 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049517.827793:0:3295:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb7c4c38a00/0xf4f48ce5e1bbf897 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6841 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789049517.845600:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.26@tcp (source: 12345-192.168.206.26@tcp) 00000100:00100000:3.0:1789049517.847615:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954089663616 00000100:00100000:3.0:1789049517.847630:0:5850:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954089663616 00000100:00100000:3.0:1789049517.847708:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.26@tcp, seq: 161 00000100:00100000:3.0:1789049517.847718:0:5850:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8c12a9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e823b53a-3591-475c-8624-c682227e5c13+21:11453:x1875954089663616:12345-192.168.206.26@tcp:101:bash.0 00010000:00010000:3.0:1789049517.847740:0:5850:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789049517.847759:0:5850:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c6b35400/0xf4f48ce5e1bbf89e lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7fc5e358805a35d6 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049517.847893:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c6b34e00/0xf4f48ce5e1bbf8a5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049517.847908:0:5850:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6714c00/0xf4f48ce5e1bbf889 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a35cf expref: 22 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049517.847924:0:5850:0:(ldlm_resource.c:1751:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c6b34e00/0xf4f48ce5e1bbf8a5 lrc: 4/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049517.848384:0:5850:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6714c00/0xf4f48ce5e1bbf889 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a35cf expref: 22 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049517.848412:0:5850:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6714c00/0xf4f48ce5e1bbf889 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a35cf expref: 22 pid: 5851 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789049517.848427:0:5850:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb8df4d0380 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5850:1875954110635008:192.168.206.26@tcp:104: 00000100:00100000:3.0:1789049517.848563:0:5850:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cb8dbb6b600 going to sleep for 11 seconds 00000100:00100000:2.0:1789049517.863311:0:5850:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb8df4d0380 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5850:1875954110635008:192.168.206.26@tcp:104: 00010000:00010000:2.0:1789049517.863344:0:5850:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c6b34e00/0xf4f48ce5e1bbf8a5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789049517.866429:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.26@tcp (source: 12345-192.168.206.26@tcp) 00000100:00100000:3.0:1789049517.866527:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954089663744 00000100:00100000:3.0:1789049517.866545:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954089663744 00010000:00010000:3.0:1789049517.866701:0:5836:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6714c00/0xf4f48ce5e1bbf889 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a35cf expref: 23 pid: 5851 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789049517.866828:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.26@tcp, seq: 66 00000100:00100000:3.0:1789049517.866889:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8c12a8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e823b53a-3591-475c-8624-c682227e5c13+23:2357:x1875954089663744:12345-192.168.206.26@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789049517.866909:0:5836:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789049517.866917:0:5836:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6714c00/0xf4f48ce5e1bbf889 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a35cf expref: 23 pid: 5851 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049517.866933:0:5836:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6714c00/0xf4f48ce5e1bbf889 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a35cf expref: 23 pid: 5851 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049517.866960:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6714c00/0xf4f48ce5e1bbf889 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a35cf expref: 23 pid: 5851 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049517.866980:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8cb8c687d500) 00010000:00010000:3.0:1789049517.866986:0:5836:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c6b34e00/0xf4f48ce5e1bbf8a5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049517.867019:0:5836:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c6b34e00/0xf4f48ce5e1bbf8a5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049517.867029:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c6b34e00/0xf4f48ce5e1bbf8a5 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049517.867069:0:5836:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789049517.867239:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8c12a8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e823b53a-3591-475c-8624-c682227e5c13+22:2357:x1875954089663744:12345-192.168.206.26@tcp:103:ldlm_bl.0 Request processed in 401us (818us total) trans 0 rc 0/0 00000100:00100000:3.0:1789049517.867248:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.26@tcp, seq: 66 00010000:00010000:2.0:1789049517.868271:0:5850:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c6b34e00/0xf4f48ce5e1bbf8a5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049517.868286:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c6b34e00/0xf4f48ce5e1bbf8a5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789049517.868360:0:5850:0:(mdt_handler.c:922:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:2.0:1789049517.868365:0:5850:0:(mdt_handler.c:1587:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1789049517.868394:0:5850:0:(mdt_handler.c:2522:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c6b34e00/0xf4f48ce5e1bbf8a5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049517.868440:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c6b35400/0xf4f48ce5e1bbf89e lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a35d6 expref: 22 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049517.868462:0:5850:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c6b34e00/0xf4f48ce5e1bbf8a5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a35d6 expref: 21 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049517.868471:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8cb8c687d500) 00010000:00010000:2.0:1789049517.868473:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789049517.868494:0:5850:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cb8c6b34e00, rc 0) 00000100:00100000:2.0:1789049517.868579:0:5850:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8c12a9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e823b53a-3591-475c-8624-c682227e5c13+21:11453:x1875954089663616:12345-192.168.206.26@tcp:101:bash.0 Request processed in 20862us (22993us total) trans 0 rc 0/0 00000100:00100000:2.0:1789049517.868589:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.26@tcp, seq: 161 00000100:00100000:2.0:1789049517.880706:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.26@tcp (source: 12345-192.168.206.26@tcp) 00000100:00100000:1.0:1789049517.880828:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954089664000 00000100:00100000:1.0:1789049517.880882:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954089664000 00000100:00100000:1.0:1789049517.880948:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.26@tcp, seq: 45 00000100:00100000:1.0:1789049517.880978:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8c12aa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e823b53a-3591-475c-8624-c682227e5c13+21:11453:x1875954089664000:12345-192.168.206.26@tcp:35:bash.0 00000100:00100000:1.0:1789049517.881635:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8c12aa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e823b53a-3591-475c-8624-c682227e5c13+22:11453:x1875954089664000:12345-192.168.206.26@tcp:35:bash.0 Request processed in 654us (936us total) trans 4294967455 rc 0/0 00000100:00100000:1.0:1789049517.881645:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.26@tcp, seq: 45 00000100:00100000:0.0:1789049518.005620:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.26@tcp (source: 12345-192.168.206.26@tcp) 00000100:00100000:3.0:1789049518.011668:0:6841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954089664256 00000100:00100000:3.0:1789049518.011690:0:6841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954089664256 00000100:00100000:3.0:1789049518.011826:0:6841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.26@tcp, seq: 162 00000100:00100000:3.0:1789049518.011838:0:6841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8f7acaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e823b53a-3591-475c-8624-c682227e5c13+22:11463:x1875954089664256:12345-192.168.206.26@tcp:101:lfs.0 00010000:00010000:3.0:1789049518.011896:0:6841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789049518.011924:0:6841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c6b35800/0xf4f48ce5e1bbf8ac lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7fc5e358805a35dd expref: -99 pid: 6841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789049518.012053:0:6841:0:(mdt_handler.c:922:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00010000:00010000:3.0:1789049518.012566:0:6841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c6b35800/0xf4f48ce5e1bbf8ac lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a35dd expref: 24 pid: 6841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049518.012583:0:6841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8cb8e0130500) 00010000:00010000:3.0:1789049518.012586:0:6841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1789049518.012593:0:6841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c6b35800/0xf4f48ce5e1bbf8ac lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a35dd expref: 24 pid: 6841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049518.012610:0:6841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cb8c6b35800, rc 0) 00000100:00100000:3.0:1789049518.012726:0:6841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8f7acaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e823b53a-3591-475c-8624-c682227e5c13+23:11463:x1875954089664256:12345-192.168.206.26@tcp:101:lfs.0 Request processed in 890us (7123us total) trans 4294967456 rc 301/301 00000100:00100000:3.0:1789049518.012736:0:6841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.26@tcp, seq: 162 00000100:00100000:0.0:1789049518.027281:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.26@tcp (source: 12345-192.168.206.26@tcp) 00000100:00100000:2.0:1789049518.027407:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954089664384 00000100:00100000:2.0:1789049518.027420:0:5851:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954089664384 00000100:00100000:2.0:1789049518.027500:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.26@tcp, seq: 163 00000100:00100000:2.0:1789049518.027512:0:5851:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8f7acb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e823b53a-3591-475c-8624-c682227e5c13+23:11463:x1875954089664384:12345-192.168.206.26@tcp:34:lfs.0 00010000:00010000:2.0:1789049518.027610:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6715200/0xf4f48ce5e1bbf8ba lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049518.027629:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6715200/0xf4f48ce5e1bbf8ba lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049518.027645:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6715200/0xf4f48ce5e1bbf8ba lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049518.027663:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6714c00/0xf4f48ce5e1bbf8c1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049518.027670:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6714c00/0xf4f48ce5e1bbf8c1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049518.027675:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6714c00/0xf4f48ce5e1bbf8c1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049518.028097:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6714a00/0xf4f48ce5e1bbf8c8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049518.028108:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6714a00/0xf4f48ce5e1bbf8c8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049518.028124:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6714a00/0xf4f48ce5e1bbf8c8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789049518.028179:0:5851:0:(mdt_handler.c:2522:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6714a00/0xf4f48ce5e1bbf8c8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049518.028194:0:5851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6715200/0xf4f48ce5e1bbf8ba lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049518.028200:0:5851:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6715200/0xf4f48ce5e1bbf8ba lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049518.028208:0:5851:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6715200/0xf4f48ce5e1bbf8ba lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049518.028214:0:5851:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cb8d6715200 already unused, calling callback (ffffffffc20ca4f0) 00010000:00010000:2.0:1789049518.028219:0:5851:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6715200/0xf4f48ce5e1bbf8ba lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049518.028226:0:5851:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6715200/0xf4f48ce5e1bbf8ba lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049518.028239:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8cb8e0130100) 00010000:00010000:2.0:1789049518.028242:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789049518.028248:0:5851:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6715200/0xf4f48ce5e1bbf8ba lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049518.028255:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6715200/0xf4f48ce5e1bbf8ba lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049518.028268:0:5851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6714c00/0xf4f48ce5e1bbf8c1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049518.028281:0:5851:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6714c00/0xf4f48ce5e1bbf8c1 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049518.028287:0:5851:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6714c00/0xf4f48ce5e1bbf8c1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049518.028292:0:5851:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cb8d6714c00 already unused, calling callback (ffffffffc20ca4f0) 00010000:00010000:2.0:1789049518.028295:0:5851:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6714c00/0xf4f48ce5e1bbf8c1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049518.028302:0:5851:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6714c00/0xf4f48ce5e1bbf8c1 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049518.028311:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8cb8e0130300) 00010000:00010000:2.0:1789049518.028313:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789049518.028316:0:5851:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6714c00/0xf4f48ce5e1bbf8c1 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049518.028322:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6714c00/0xf4f48ce5e1bbf8c1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049518.028340:0:5851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6714a00/0xf4f48ce5e1bbf8c8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049518.028346:0:5851:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6714a00/0xf4f48ce5e1bbf8c8 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049518.028352:0:5851:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6714a00/0xf4f48ce5e1bbf8c8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049518.028357:0:5851:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cb8d6714a00 already unused, calling callback (ffffffffc20ca4f0) 00010000:00010000:2.0:1789049518.028365:0:5851:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6714a00/0xf4f48ce5e1bbf8c8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049518.028372:0:5851:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6714a00/0xf4f48ce5e1bbf8c8 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049518.028380:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8cb8c687d500) 00010000:00010000:2.0:1789049518.028383:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789049518.028386:0:5851:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6714a00/0xf4f48ce5e1bbf8c8 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049518.028392:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6714a00/0xf4f48ce5e1bbf8c8 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789049518.028496:0:5851:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8f7acb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e823b53a-3591-475c-8624-c682227e5c13+23:11463:x1875954089664384:12345-192.168.206.26@tcp:34:lfs.0 Request processed in 984us (1228us total) trans 0 rc 0/0 00000100:00100000:2.0:1789049518.028506:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.26@tcp, seq: 163 00000100:00100000:2.0:1789049518.036069:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.26@tcp (source: 12345-192.168.206.26@tcp) 00000100:00100000:1.0:1789049518.037038:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954089664640 00000100:00100000:1.0:1789049518.037054:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954089664640 00000100:00100000:1.0:1789049518.037143:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.26@tcp, seq: 46 00000100:00100000:1.0:1789049518.037157:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8c12aa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e823b53a-3591-475c-8624-c682227e5c13+23:11463:x1875954089664640:12345-192.168.206.26@tcp:35:lfs.0 00000100:00100000:1.0:1789049518.037524:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8c12aa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e823b53a-3591-475c-8624-c682227e5c13+24:11463:x1875954089664640:12345-192.168.206.26@tcp:35:lfs.0 Request processed in 368us (1470us total) trans 4294967457 rc 0/0 00000100:00100000:1.0:1789049518.037532:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.26@tcp, seq: 46 00000100:00100000:0.0:1789049518.097948:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.26@tcp (source: 12345-192.168.206.26@tcp) 00000100:00100000:2.0:1789049518.098116:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954089664896 00000100:00100000:2.0:1789049518.098130:0:5852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954089664896 00000100:00100000:2.0:1789049518.098208:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.26@tcp, seq: 164 00000100:00100000:2.0:1789049518.098219:0:5852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8f7ac9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e823b53a-3591-475c-8624-c682227e5c13+24:11466:x1875954089664896:12345-192.168.206.26@tcp:101:lfs.0 00010000:00010000:2.0:1789049518.098252:0:5852:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789049518.098279:0:5852:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6714a00/0xf4f48ce5e1bbf8cf lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7fc5e358805a35e4 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049518.098372:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6714c00/0xf4f48ce5e1bbf8d6 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049518.098389:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6714c00/0xf4f48ce5e1bbf8d6 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049518.098421:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6714c00/0xf4f48ce5e1bbf8d6 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049518.098438:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6715200/0xf4f48ce5e1bbf8dd lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049518.098446:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6715200/0xf4f48ce5e1bbf8dd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049518.098454:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6715200/0xf4f48ce5e1bbf8dd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049518.098840:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6715a00/0xf4f48ce5e1bbf8e4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049518.098906:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6715a00/0xf4f48ce5e1bbf8e4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049518.098914:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6715a00/0xf4f48ce5e1bbf8e4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789049518.098926:0:5852:0:(mdt_handler.c:922:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:2.0:1789049518.099101:0:5852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6714c00/0xf4f48ce5e1bbf8d6 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049518.099109:0:5852:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6714c00/0xf4f48ce5e1bbf8d6 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049518.099117:0:5852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6714c00/0xf4f48ce5e1bbf8d6 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049518.099123:0:5852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cb8d6714c00 already unused, calling callback (ffffffffc20ca4f0) 00010000:00010000:2.0:1789049518.099136:0:5852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6714c00/0xf4f48ce5e1bbf8d6 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049518.099146:0:5852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6714c00/0xf4f48ce5e1bbf8d6 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049518.099161:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8cb8e0130100) 00010000:00010000:2.0:1789049518.099164:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789049518.099170:0:5852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6714c00/0xf4f48ce5e1bbf8d6 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049518.099177:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6714c00/0xf4f48ce5e1bbf8d6 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049518.099191:0:5852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6715200/0xf4f48ce5e1bbf8dd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049518.099198:0:5852:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6715200/0xf4f48ce5e1bbf8dd lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049518.099203:0:5852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6715200/0xf4f48ce5e1bbf8dd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049518.099208:0:5852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cb8d6715200 already unused, calling callback (ffffffffc20ca4f0) 00010000:00010000:2.0:1789049518.099211:0:5852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6715200/0xf4f48ce5e1bbf8dd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049518.099216:0:5852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6715200/0xf4f48ce5e1bbf8dd lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049518.099223:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8cb8e0130300) 00010000:00010000:2.0:1789049518.099226:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789049518.099235:0:5852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6715200/0xf4f48ce5e1bbf8dd lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049518.099241:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6715200/0xf4f48ce5e1bbf8dd lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049518.099294:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6714a00/0xf4f48ce5e1bbf8cf lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a35e4 expref: 27 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049518.099309:0:5852:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6715a00/0xf4f48ce5e1bbf8e4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a35e4 expref: 26 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049518.099316:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8cb8c687d500) 00010000:00010000:2.0:1789049518.099318:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789049518.099321:0:5852:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cb8d6715a00, rc 0) 00000100:00100000:2.0:1789049518.099409:0:5852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8f7ac9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e823b53a-3591-475c-8624-c682227e5c13+26:11466:x1875954089664896:12345-192.168.206.26@tcp:101:lfs.0 Request processed in 1192us (1474us total) trans 4294967458 rc 0/0 00000100:00100000:2.0:1789049518.099419:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.26@tcp, seq: 164 00000100:00100000:0.0:1789049518.114421:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.26@tcp (source: 12345-192.168.206.26@tcp) 00000100:00100000:2.0:1789049518.114476:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954089665024 00000100:00100000:0.0:1789049518.114491:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.26@tcp (source: 12345-192.168.206.26@tcp) 00000100:00100000:2.0:1789049518.114493:0:5851:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954089665024 00000100:00100000:1.0:1789049518.114550:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954089665152 00000100:00100000:1.0:1789049518.114555:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954089665152 00000100:00100000:1.0:1789049518.114653:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.26@tcp, seq: 12 00000100:00100000:1.0:1789049518.114666:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8f7acb800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e823b53a-3591-475c-8624-c682227e5c13+27:2355:x1875954089665152:12345-192.168.206.26@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789049518.114686:0:5837:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789049518.114720:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6715a00/0xf4f48ce5e1bbf8e4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a35e4 expref: 27 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049518.114742:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8cb8c687d500) 00010000:00010000:1.0:1789049518.114748:0:5837:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789049518.114827:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8f7acb800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e823b53a-3591-475c-8624-c682227e5c13+26:2355:x1875954089665152:12345-192.168.206.26@tcp:103:ldlm_bl.0 Request processed in 164us (336us total) trans 0 rc 0/0 00000100:00100000:1.0:1789049518.114835:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.26@tcp, seq: 12 00000100:00100000:3.0:1789049518.114867:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.26@tcp, seq: 165 00000100:00100000:3.0:1789049518.114879:0:5851:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8f7ac8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e823b53a-3591-475c-8624-c682227e5c13+25:11466:x1875954089665024:12345-192.168.206.26@tcp:54:lfs.0 00010000:00010000:1.0:1789049518.115273:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c3200/0xf4f48ce5e1bbf8f2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049518.115307:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c3200/0xf4f48ce5e1bbf8f2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049518.115319:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c3200/0xf4f48ce5e1bbf8f2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049518.115354:0:5851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c3200/0xf4f48ce5e1bbf8f2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049518.115362:0:5851:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c3200/0xf4f48ce5e1bbf8f2 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049518.115369:0:5851:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c3200/0xf4f48ce5e1bbf8f2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049518.115375:0:5851:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cb8c28c3200 already unused, calling callback (ffffffffc20ca4f0) 00010000:00010000:1.0:1789049518.115380:0:5851:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c3200/0xf4f48ce5e1bbf8f2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049518.115388:0:5851:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c3200/0xf4f48ce5e1bbf8f2 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049518.115398:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8cb8c687d500) 00010000:00010000:1.0:1789049518.115401:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1789049518.115405:0:5851:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c3200/0xf4f48ce5e1bbf8f2 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049518.115412:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c3200/0xf4f48ce5e1bbf8f2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789049518.115459:0:5851:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8f7ac8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e823b53a-3591-475c-8624-c682227e5c13+25:11466:x1875954089665024:12345-192.168.206.26@tcp:54:lfs.0 Request processed in 582us (1056us total) trans 0 rc 0/0 00000100:00100000:1.0:1789049518.115473:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.26@tcp, seq: 165 00000100:00100000:1.0:1789049518.122931:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.26@tcp (source: 12345-192.168.206.26@tcp) 00000100:00100000:3.0:1789049518.123035:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954089665408 00000100:00100000:3.0:1789049518.123049:0:5853:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954089665408 00000100:00100000:3.0:1789049518.123132:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.26@tcp, seq: 47 00000100:00100000:3.0:1789049518.123145:0:5853:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb9009c2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e823b53a-3591-475c-8624-c682227e5c13+25:11466:x1875954089665408:12345-192.168.206.26@tcp:35:lfs.0 00000100:00100000:3.0:1789049518.123467:0:5853:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb9009c2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e823b53a-3591-475c-8624-c682227e5c13+26:11466:x1875954089665408:12345-192.168.206.26@tcp:35:lfs.0 Request processed in 324us (550us total) trans 4294967459 rc 0/0 00000100:00100000:3.0:1789049518.123476:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.26@tcp, seq: 47 00000100:00100000:1.0:1789049518.291708:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.26@tcp (source: 12345-192.168.206.26@tcp) 00000100:00100000:2.0:1789049518.291910:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954089665664 00000100:00100000:2.0:1789049518.291924:0:5852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954089665664 00000100:00100000:2.0:1789049518.291999:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.26@tcp, seq: 166 00000100:00100000:2.0:1789049518.292012:0:5852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb9009c2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e823b53a-3591-475c-8624-c682227e5c13+26:11484:x1875954089665664:12345-192.168.206.26@tcp:101:cat.0 00010000:00010000:2.0:1789049518.292047:0:5852:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789049518.292077:0:5852:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6714a00/0xf4f48ce5e1bbf8f9 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7fc5e358805a35eb expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049518.292387:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6715200/0xf4f48ce5e1bbf900 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049518.292424:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6715200/0xf4f48ce5e1bbf900 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049518.292440:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6715200/0xf4f48ce5e1bbf900 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789049518.292458:0:5852:0:(mdt_handler.c:922:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:2.0:1789049518.292636:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6714a00/0xf4f48ce5e1bbf8f9 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a35eb expref: 29 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049518.292664:0:5852:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6715200/0xf4f48ce5e1bbf900 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a35eb expref: 28 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049518.292674:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8cb8c687d500) 00010000:00010000:2.0:1789049518.292677:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:2.0:1789049518.292681:0:5852:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cb8d6715200, rc 0) 00000100:00100000:2.0:1789049518.293410:0:5852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb9009c2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e823b53a-3591-475c-8624-c682227e5c13+28:11484:x1875954089665664:12345-192.168.206.26@tcp:101:cat.0 Request processed in 1395us (1711us total) trans 4294967460 rc 0/0 00000100:00100000:2.0:1789049518.293423:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.26@tcp, seq: 166 00000100:00100000:0.0:1789049518.330792:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.26@tcp (source: 12345-192.168.206.26@tcp) 00000100:00100000:2.0:1789049518.330967:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954089665792 00000100:00100000:2.0:1789049518.330983:0:5850:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954089665792 00000100:00100000:2.0:1789049518.331062:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.26@tcp, seq: 167 00000100:00100000:2.0:1789049518.331075:0:5850:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8f7ac8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e823b53a-3591-475c-8624-c682227e5c13+28:11485:x1875954089665792:12345-192.168.206.26@tcp:101:lfs.0 00010000:00010000:2.0:1789049518.331104:0:5850:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789049518.331130:0:5850:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6714a00/0xf4f48ce5e1bbf90e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7fc5e358805a35f2 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049518.331262:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6714c00/0xf4f48ce5e1bbf915 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049518.331279:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6714c00/0xf4f48ce5e1bbf915 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049518.331293:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6714c00/0xf4f48ce5e1bbf915 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789049518.331336:0:5850:0:(mdt_handler.c:922:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00000004:00200000:2.0:1789049518.331339:0:5850:0:(mdt_handler.c:1587:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1789049518.331358:0:5850:0:(mdt_handler.c:2522:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6714c00/0xf4f48ce5e1bbf915 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049518.331387:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6714a00/0xf4f48ce5e1bbf90e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a35f2 expref: 30 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049518.331407:0:5850:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6714c00/0xf4f48ce5e1bbf915 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a35f2 expref: 29 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049518.331415:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8cb8e0130100) 00010000:00010000:2.0:1789049518.331418:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789049518.331422:0:5850:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cb8d6714c00, rc 0) 00000100:00100000:2.0:1789049518.331501:0:5850:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8f7ac8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e823b53a-3591-475c-8624-c682227e5c13+29:11485:x1875954089665792:12345-192.168.206.26@tcp:101:lfs.0 Request processed in 428us (726us total) trans 0 rc 0/0 00000100:00100000:2.0:1789049518.331509:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.26@tcp, seq: 167 00000100:00100000:1.0:1789049518.338341:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.26@tcp (source: 12345-192.168.206.26@tcp) 00000100:00100000:3.0:1789049518.338499:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954089666176 00000100:00100000:3.0:1789049518.338518:0:5853:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954089666176 00000100:00100000:3.0:1789049518.338586:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.26@tcp, seq: 48 00000100:00100000:3.0:1789049518.338595:0:5853:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb9009c2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e823b53a-3591-475c-8624-c682227e5c13+29:11485:x1875954089666176:12345-192.168.206.26@tcp:35:lfs.0 00000001:00080000:3.0:1789049518.338985:0:5853:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967461 00000100:00100000:3.0:1789049518.339117:0:5853:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb9009c2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e823b53a-3591-475c-8624-c682227e5c13+31:11485:x1875954089666176:12345-192.168.206.26@tcp:35:lfs.0 Request processed in 522us (797us total) trans 4294967462 rc 0/0 00000100:00100000:3.0:1789049518.339127:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.26@tcp, seq: 48 00000020:00080000:3.0:1789049518.339132:0:5853:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1789049518.345747:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.26@tcp (source: 12345-192.168.206.26@tcp) 00000100:00100000:1.0:1789049518.345952:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954089666304 00000100:00100000:1.0:1789049518.345965:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954089666304 00000100:00100000:1.0:1789049518.346048:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.26@tcp, seq: 13 00000100:00100000:1.0:1789049518.346060:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8f7acad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e823b53a-3591-475c-8624-c682227e5c13+31:11485:x1875954089666304:12345-192.168.206.26@tcp:103:lfs.0 00010000:00010000:1.0:1789049518.346082:0:5835:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:1.0:1789049518.346117:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c6b34e00/0xf4f48ce5e1bbf8a5 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a35d6 expref: 31 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049518.346145:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6715200/0xf4f48ce5e1bbf900 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a35eb expref: 30 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049518.346174:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c6b34000/0xf4f48ce5e1bbf7a9 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a3597 expref: 29 pid: 6841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049518.346187:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8cb8c687d500) 00010000:00010000:1.0:1789049518.346199:0:5835:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789049518.346571:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8f7acad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e823b53a-3591-475c-8624-c682227e5c13+28:11485:x1875954089666304:12345-192.168.206.26@tcp:103:lfs.0 Request processed in 511us (837us total) trans 0 rc 0/0 00000100:00100000:1.0:1789049518.346582:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.26@tcp, seq: 13 00000100:00100000:0.0:1789049518.355514:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.26@tcp (source: 12345-192.168.206.26@tcp) 00000100:00100000:3.0:1789049518.355778:0:6841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954089666432 00000100:00100000:3.0:1789049518.355792:0:6841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954089666432 00000100:00100000:3.0:1789049518.355925:0:6841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.26@tcp, seq: 168 00000100:00100000:3.0:1789049518.355939:0:6841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8f7ac9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e823b53a-3591-475c-8624-c682227e5c13+28:11485:x1875954089666432:12345-192.168.206.26@tcp:58:lfs.0 00010000:00010000:3.0:1789049518.356105:0:6841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c6b35800/0xf4f48ce5e1bbf91c lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049518.356126:0:6841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c6b35800/0xf4f48ce5e1bbf91c lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049518.356141:0:6841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c6b35800/0xf4f48ce5e1bbf91c lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6841 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1789049518.356794:0:6841:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].4, 136 off8736 00000100:00100000:3.0:1789049518.357894:0:6841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8f7ac9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e823b53a-3591-475c-8624-c682227e5c13+28:11485:x1875954089666432:12345-192.168.206.26@tcp:58:lfs.0 Request processed in 1946us (2383us total) trans 0 rc 0/0 00000100:00100000:3.0:1789049518.357909:0:6841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.26@tcp, seq: 168 00000100:00100000:2.0:1789049518.389087:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.26@tcp (source: 12345-192.168.206.26@tcp) 00000100:00100000:3.0:1789049518.389430:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954089666560 00000100:00100000:3.0:1789049518.389444:0:5850:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954089666560 00000100:00100000:3.0:1789049518.389522:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.26@tcp, seq: 169 00000100:00100000:3.0:1789049518.389535:0:5850:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8c12abb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e823b53a-3591-475c-8624-c682227e5c13+28:11487:x1875954089666560:12345-192.168.206.26@tcp:101:lfs.0 00010000:00010000:3.0:1789049518.389563:0:5850:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789049518.389590:0:5850:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c6b34200/0xf4f48ce5e1bbf923 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7fc5e358805a35f9 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049518.389708:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c6b34000/0xf4f48ce5e1bbf92a lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049518.389727:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c6b34000/0xf4f48ce5e1bbf92a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049518.389741:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c6b34000/0xf4f48ce5e1bbf92a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049518.389771:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c6b34e00/0xf4f48ce5e1bbf931 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049518.389779:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c6b34e00/0xf4f48ce5e1bbf931 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049518.389787:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c6b34e00/0xf4f48ce5e1bbf931 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049518.395634:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6715200/0xf4f48ce5e1bbf938 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049518.395675:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6715200/0xf4f48ce5e1bbf938 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049518.395690:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6715200/0xf4f48ce5e1bbf938 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789049518.395751:0:5850:0:(mdt_handler.c:922:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:2.0:1789049518.395755:0:5850:0:(mdt_handler.c:1587:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1789049518.395778:0:5850:0:(mdt_handler.c:2522:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6715200/0xf4f48ce5e1bbf938 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049518.395791:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6715200/0xf4f48ce5e1bbf938 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049518.395814:0:5850:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c6b34000/0xf4f48ce5e1bbf92a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049518.395822:0:5850:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c6b34000/0xf4f48ce5e1bbf92a lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049518.395829:0:5850:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c6b34000/0xf4f48ce5e1bbf92a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049518.395836:0:5850:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cb8c6b34000 already unused, calling callback (ffffffffc20ca4f0) 00010000:00010000:2.0:1789049518.395840:0:5850:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c6b34000/0xf4f48ce5e1bbf92a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049518.395868:0:5850:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c6b34000/0xf4f48ce5e1bbf92a lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049518.395883:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8cb8e0130100) 00010000:00010000:2.0:1789049518.395886:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789049518.395897:0:5850:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c6b34000/0xf4f48ce5e1bbf92a lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049518.395904:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c6b34000/0xf4f48ce5e1bbf92a lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049518.395921:0:5850:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c6b34e00/0xf4f48ce5e1bbf931 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049518.395927:0:5850:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c6b34e00/0xf4f48ce5e1bbf931 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049518.395934:0:5850:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c6b34e00/0xf4f48ce5e1bbf931 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049518.395939:0:5850:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cb8c6b34e00 already unused, calling callback (ffffffffc20ca4f0) 00010000:00010000:2.0:1789049518.395942:0:5850:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c6b34e00/0xf4f48ce5e1bbf931 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049518.395947:0:5850:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c6b34e00/0xf4f48ce5e1bbf931 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049518.395954:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8cb8c687d100) 00010000:00010000:2.0:1789049518.395956:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789049518.395958:0:5850:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c6b34e00/0xf4f48ce5e1bbf931 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049518.395964:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c6b34e00/0xf4f48ce5e1bbf931 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049518.396011:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c6b34200/0xf4f48ce5e1bbf923 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a35f9 expref: 30 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049518.396036:0:5850:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6715200/0xf4f48ce5e1bbf938 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a35f9 expref: 29 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049518.396044:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8cb8c687d800) 00010000:00010000:2.0:1789049518.396046:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789049518.396049:0:5850:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cb8d6715200, rc 0) 00000100:00100000:2.0:1789049518.398159:0:5850:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8c12abb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e823b53a-3591-475c-8624-c682227e5c13+29:11487:x1875954089666560:12345-192.168.206.26@tcp:101:lfs.0 Request processed in 8604us (9064us total) trans 0 rc 0/0 00000100:00100000:2.0:1789049518.398176:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.26@tcp, seq: 169 00000100:00100000:1.0:1789049518.406531:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.26@tcp (source: 12345-192.168.206.26@tcp) 00000100:00100000:1.0:1789049518.406590:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.26@tcp (source: 12345-192.168.206.26@tcp) 00000100:00100000:1.0:1789049518.406625:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.26@tcp (source: 12345-192.168.206.26@tcp) 00000100:00100000:1.0:1789049518.406689:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.26@tcp (source: 12345-192.168.206.26@tcp) 00000100:00100000:1.0:1789049518.406729:0:10560:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954089666944 00000100:00100000:1.0:1789049518.406743:0:10560:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954089666944 00000100:00100000:1.0:1789049518.406835:0:10560:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954089666816 00000100:00100000:1.0:1789049518.406839:0:10560:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954089666816 00000100:00100000:1.0:1789049518.406904:0:10560:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.26@tcp, seq: 71 00000100:00100000:1.0:1789049518.406918:0:10560:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb9009c3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e823b53a-3591-475c-8624-c682227e5c13+5:2357:x1875954089666944:12345-192.168.206.26@tcp:400:kworker.0 00000100:00100000:1.0:1789049518.407011:0:10560:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb9009c3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e823b53a-3591-475c-8624-c682227e5c13+5:2357:x1875954089666944:12345-192.168.206.26@tcp:400:kworker.0 Request processed in 96us (419us total) trans 0 rc 0/0 00000100:00100000:1.0:1789049518.407019:0:10560:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.26@tcp, seq: 71 00000100:00100000:1.0:1789049518.407039:0:10560:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.26@tcp, seq: 72 00000100:00100000:1.0:1789049518.407046:0:10560:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb9009c1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e823b53a-3591-475c-8624-c682227e5c13+6:2357:x1875954089666816:12345-192.168.206.26@tcp:400:kworker.0 00000100:00100000:1.0:1789049518.407071:0:10560:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb9009c1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e823b53a-3591-475c-8624-c682227e5c13+6:2357:x1875954089666816:12345-192.168.206.26@tcp:400:kworker.0 Request processed in 25us (445us total) trans 0 rc 0/0 00000100:00100000:1.0:1789049518.407078:0:10560:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.26@tcp, seq: 72 00000100:00080000:1.0:1789049518.407095:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1789049518.407100:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789049518.407115:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954089667072 00000100:00100000:1.0:1789049518.407119:0:5852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954089667072 00000100:00100000:1.0:1789049518.407152:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.26@tcp, seq: 149 00000100:00100000:1.0:1789049518.407159:0:5852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb9009c0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:59d63492-f1ee-4aa5-bf8c-853a603b0252+5:2357:x1875954089667072:12345-192.168.206.26@tcp:400:kworker.0 00000100:00100000:1.0:1789049518.407188:0:5852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb9009c0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:59d63492-f1ee-4aa5-bf8c-853a603b0252+5:2357:x1875954089667072:12345-192.168.206.26@tcp:400:kworker.0 Request processed in 29us (499us total) trans 0 rc 0/0 00000100:00100000:1.0:1789049518.407194:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.26@tcp, seq: 149 00000100:00080000:1.0:1789049518.407209:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789049518.407882:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954089666688 00000100:00100000:3.0:1789049518.407892:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954089666688 00000100:00100000:3.0:1789049518.407935:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.26@tcp, seq: 293 00000100:00100000:3.0:1789049518.407944:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8c6befc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:de93d576-ed8d-4d27-ab00-9189a62cea33+13:2357:x1875954089666688:12345-192.168.206.26@tcp:400:kworker.0 00000100:00100000:3.0:1789049518.407998:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8c6befc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:de93d576-ed8d-4d27-ab00-9189a62cea33+13:2357:x1875954089666688:12345-192.168.206.26@tcp:400:kworker.0 Request processed in 55us (1483us total) trans 0 rc 0/0 00000100:00100000:3.0:1789049518.408005:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.26@tcp, seq: 293 00000040:00080000:3.0:1789049518.427372:0:11704:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1789049518.427387:0:11704:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1789049518.427465:0:11704:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 4 00000040:00080000:3.0:1789049518.427480:0:11704:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1789049518.427650:0:11704:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb8df4d0380 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11704:1875954110635136:192.168.206.26@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1789049518.427917:0:11704:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cb8dbb6b300 going to sleep for 11 seconds 00000100:00100000:3.0:1789049518.437589:0:11704:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb8df4d0380 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11704:1875954110635136:192.168.206.26@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1789049518.437980:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.26@tcp (source: 12345-192.168.206.26@tcp) 00000100:00100000:0.0:1789049518.438082:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954089667200 00000100:00100000:0.0:1789049518.438091:0:5851:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954089667200 00000100:00100000:0.0:1789049518.438169:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.26@tcp, seq: 170 00000100:00100000:0.0:1789049518.438181:0:5851:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb9009c0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e823b53a-3591-475c-8624-c682227e5c13+29:11493:x1875954089667200:12345-192.168.206.26@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1789049518.438232:0:5851:0:(mdt_handler.c:7990:mdt_fid2path()) path get [0x200000401:0xb:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1789049518.438380:0:5851:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb9009c0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e823b53a-3591-475c-8624-c682227e5c13+29:11493:x1875954089667200:12345-192.168.206.26@tcp:53:lhsmtool_posix.0 Request processed in 201us (401us total) trans 0 rc 0/0 00000100:00100000:0.0:1789049518.438400:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.26@tcp, seq: 170 00000100:00100000:1.0:1789049518.456466:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.26@tcp (source: 12345-192.168.206.26@tcp) 00000100:00100000:2.0:1789049518.456876:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954089667328 00000100:00100000:2.0:1789049518.456891:0:5852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954089667328 00000100:00100000:2.0:1789049518.456967:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.26@tcp, seq: 171 00000100:00100000:2.0:1789049518.456980:0:5852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb9009c0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e823b53a-3591-475c-8624-c682227e5c13+29:11493:x1875954089667328:12345-192.168.206.26@tcp:34:lhsmtool_posix.0 00010000:00010000:2.0:1789049518.457073:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6714a00/0xf4f48ce5e1bbf93f lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049518.457095:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6714a00/0xf4f48ce5e1bbf93f lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049518.457110:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6714a00/0xf4f48ce5e1bbf93f lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049518.462734:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6715a00/0xf4f48ce5e1bbf946 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049518.462759:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6715a00/0xf4f48ce5e1bbf946 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049518.462792:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6715a00/0xf4f48ce5e1bbf946 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049518.462841:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6715c00/0xf4f48ce5e1bbf94d lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049518.463207:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6715c00/0xf4f48ce5e1bbf94d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049518.463216:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6715c00/0xf4f48ce5e1bbf94d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789049518.463488:0:5852:0:(mdt_handler.c:922:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:2.0:1789049518.463492:0:5852:0:(mdt_handler.c:1587:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1789049518.463507:0:5852:0:(mdt_handler.c:2522:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6715c00/0xf4f48ce5e1bbf94d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049518.463519:0:5852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6714a00/0xf4f48ce5e1bbf93f lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049518.463526:0:5852:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6714a00/0xf4f48ce5e1bbf93f lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049518.463533:0:5852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6714a00/0xf4f48ce5e1bbf93f lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049518.463539:0:5852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cb8d6714a00 already unused, calling callback (ffffffffc20ca4f0) 00010000:00010000:2.0:1789049518.463544:0:5852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6714a00/0xf4f48ce5e1bbf93f lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049518.463550:0:5852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6714a00/0xf4f48ce5e1bbf93f lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049518.463573:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8cb8e0130a00) 00010000:00010000:2.0:1789049518.463576:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789049518.463582:0:5852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6714a00/0xf4f48ce5e1bbf93f lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049518.463588:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6714a00/0xf4f48ce5e1bbf93f lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049518.463605:0:5852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6715a00/0xf4f48ce5e1bbf946 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049518.463611:0:5852:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6715a00/0xf4f48ce5e1bbf946 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049518.463617:0:5852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6715a00/0xf4f48ce5e1bbf946 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049518.463623:0:5852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cb8d6715a00 already unused, calling callback (ffffffffc20ca4f0) 00010000:00010000:2.0:1789049518.463625:0:5852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6715a00/0xf4f48ce5e1bbf946 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049518.463631:0:5852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6715a00/0xf4f48ce5e1bbf946 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049518.463638:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x19697575 (ffff8cb8e0130300) 00010000:00010000:2.0:1789049518.463641:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789049518.463644:0:5852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6715a00/0xf4f48ce5e1bbf946 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049518.463650:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6715a00/0xf4f48ce5e1bbf946 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049518.463678:0:5852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6715c00/0xf4f48ce5e1bbf94d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049518.463685:0:5852:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6715c00/0xf4f48ce5e1bbf94d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049518.463691:0:5852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6715c00/0xf4f48ce5e1bbf94d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049518.463695:0:5852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cb8d6715c00 already unused, calling callback (ffffffffc20ca4f0) 00010000:00010000:2.0:1789049518.463698:0:5852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6715c00/0xf4f48ce5e1bbf94d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049518.463704:0:5852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6715c00/0xf4f48ce5e1bbf94d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049518.463712:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8cb8c687d800) 00010000:00010000:2.0:1789049518.463714:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789049518.463717:0:5852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6715c00/0xf4f48ce5e1bbf94d lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049518.463723:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6715c00/0xf4f48ce5e1bbf94d lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789049518.463960:0:5852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb9009c0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e823b53a-3591-475c-8624-c682227e5c13+29:11493:x1875954089667328:12345-192.168.206.26@tcp:34:lhsmtool_posix.0 Request processed in 6977us (7504us total) trans 0 rc 0/0 00000100:00100000:2.0:1789049518.463971:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.26@tcp, seq: 171 00000100:00100000:1.0:1789049518.481961:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.26@tcp (source: 12345-192.168.206.26@tcp) 00000100:00100000:0.0:1789049518.482108:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954089667584 00000100:00100000:0.0:1789049518.482120:0:5851:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954089667584 00000100:00100000:0.0:1789049518.482257:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.26@tcp, seq: 172 00000100:00100000:0.0:1789049518.482268:0:5851:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb9009c1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e823b53a-3591-475c-8624-c682227e5c13+29:11493:x1875954089667584:12345-192.168.206.26@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789049518.482294:0:5851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789049518.482324:0:5851:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb7c4c39e00/0xf4f48ce5e1bbf954 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7fc5e358805a3600 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049518.482447:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb7c4c38c00/0xf4f48ce5e1bbf95b lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049518.482465:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cb7c4c38c00/0xf4f48ce5e1bbf95b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049518.482479:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb7c4c38c00/0xf4f48ce5e1bbf95b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789049518.482492:0:5851:0:(mdt_handler.c:922:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:0.0:1789049518.482609:0:5851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb7c4c38c00/0xf4f48ce5e1bbf95b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049518.482618:0:5851:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cb7c4c38c00/0xf4f48ce5e1bbf95b lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049518.482625:0:5851:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cb7c4c38c00/0xf4f48ce5e1bbf95b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049518.482631:0:5851:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cb7c4c38c00 already unused, calling callback (ffffffffc20ca4f0) 00010000:00010000:0.0:1789049518.482636:0:5851:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb7c4c38c00/0xf4f48ce5e1bbf95b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049518.482661:0:5851:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb7c4c38c00/0xf4f48ce5e1bbf95b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049518.482675:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8cb8c687d800) 00010000:00010000:0.0:1789049518.482678:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1789049518.482684:0:5851:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cb7c4c38c00/0xf4f48ce5e1bbf95b lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049518.482691:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb7c4c38c00/0xf4f48ce5e1bbf95b lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049518.482737:0:5851:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb7c4c39e00/0xf4f48ce5e1bbf954 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a3600 expref: 31 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049518.482747:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8cb8e0130a00) 00010000:00010000:0.0:1789049518.482749:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1789049518.482753:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb7c4c39e00/0xf4f48ce5e1bbf954 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a3600 expref: 31 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049518.482762:0:5851:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cb7c4c39e00, rc 0) 00000100:00100000:0.0:1789049518.482837:0:5851:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb9009c1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e823b53a-3591-475c-8624-c682227e5c13+30:11493:x1875954089667584:12345-192.168.206.26@tcp:101:lhsmtool_posix.0 Request processed in 570us (889us total) trans 4294967463 rc 301/301 00000100:00100000:0.0:1789049518.482900:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.26@tcp, seq: 172 00000100:00100000:1.0:1789049518.491919:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.26@tcp (source: 12345-192.168.206.26@tcp) 00000100:00100000:0.0:1789049518.492218:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954089667712 00000100:00100000:0.0:1789049518.492232:0:5851:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954089667712 00000100:00100000:0.0:1789049518.492321:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.26@tcp, seq: 173 00000100:00100000:0.0:1789049518.492332:0:5851:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb9009c1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e823b53a-3591-475c-8624-c682227e5c13+30:11493:x1875954089667712:12345-192.168.206.26@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1789049518.492406:0:5851:0:(mdt_handler.c:7990:mdt_fid2path()) path get [0x200000401:0xb:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1789049518.492547:0:5851:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb9009c1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e823b53a-3591-475c-8624-c682227e5c13+30:11493:x1875954089667712:12345-192.168.206.26@tcp:53:lhsmtool_posix.0 Request processed in 216us (646us total) trans 0 rc 0/0 00000100:00100000:0.0:1789049518.492554:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.26@tcp, seq: 173 00000100:00100000:1.0:1789049518.496671:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.26@tcp (source: 12345-192.168.206.26@tcp) 00000100:00100000:2.0:1789049518.496776:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954089667968 00000100:00100000:2.0:1789049518.496792:0:5850:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954089667968 00000100:00100000:2.0:1789049518.496929:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.26@tcp, seq: 174 00000100:00100000:2.0:1789049518.496962:0:5850:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb9009c3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e823b53a-3591-475c-8624-c682227e5c13+30:11493:x1875954089667968:12345-192.168.206.26@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789049518.496997:0:5850:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789049518.497001:0:5850:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1789049518.497039:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6714c00/0xf4f48ce5e1bbf915 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a35f2 expref: 30 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049518.497065:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8cb8e0130100) 00010000:00010000:2.0:1789049518.497072:0:5850:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789049518.497088:0:5850:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6715c00/0xf4f48ce5e1bbf969 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7fc5e358805a3607 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1789049518.498065:0:5850:0:(osp_object.c:1667:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x5:0x0], index 0: 0 00010000:00010000:2.0:1789049518.498399:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6715a00/0xf4f48ce5e1bbf970 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049518.498420:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6715a00/0xf4f48ce5e1bbf970 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049518.498435:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6715a00/0xf4f48ce5e1bbf970 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049518.498512:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6715c00/0xf4f48ce5e1bbf969 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a3607 expref: 32 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049518.498533:0:5850:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6715a00/0xf4f48ce5e1bbf970 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a3607 expref: 31 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049518.498544:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff8cb8e0130300) 00010000:00010000:2.0:1789049518.498547:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789049518.498560:0:5850:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cb8d6715a00, rc 0) 00000100:00100000:2.0:1789049518.498639:0:5850:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb9009c3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e823b53a-3591-475c-8624-c682227e5c13+31:11493:x1875954089667968:12345-192.168.206.26@tcp:101:lhsmtool_posix.0 Request processed in 1679us (1982us total) trans 4294967464 rc 0/0 00000100:00100000:2.0:1789049518.498650:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.26@tcp, seq: 174 00000100:00100000:1.0:1789049518.505099:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.26@tcp (source: 12345-192.168.206.26@tcp) 00000100:00100000:2.0:1789049518.505388:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954089668224 00000100:00100000:2.0:1789049518.505403:0:5852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954089668224 00000100:00100000:2.0:1789049518.505480:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.26@tcp, seq: 175 00000100:00100000:2.0:1789049518.505493:0:5852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb9009c0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e823b53a-3591-475c-8624-c682227e5c13+31:11493:x1875954089668224:12345-192.168.206.26@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1789049518.505575:0:5852:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789049518.505609:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6715a00/0xf4f48ce5e1bbf970 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a3607 expref: 31 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049518.505634:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff8cb8e0130300) 00010000:00010000:2.0:1789049518.505648:0:5852:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789049518.505678:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6714a00/0xf4f48ce5e1bbf97e lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049518.505696:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6714a00/0xf4f48ce5e1bbf97e lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049518.505706:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6714a00/0xf4f48ce5e1bbf97e lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049518.508753:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c6b35400/0xf4f48ce5e1bbf985 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0xe3cc3ba6 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049518.508787:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c6b35400/0xf4f48ce5e1bbf985 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0xe3cc3ba6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049518.508869:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c6b35400/0xf4f48ce5e1bbf985 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0xe3cc3ba6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049518.509188:0:5852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6714a00/0xf4f48ce5e1bbf97e lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049518.509199:0:5852:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6714a00/0xf4f48ce5e1bbf97e lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049518.509217:0:5852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6714a00/0xf4f48ce5e1bbf97e lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049518.509224:0:5852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cb8d6714a00 already unused, calling callback (ffffffffc20ca4f0) 00010000:00010000:3.0:1789049518.509231:0:5852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6714a00/0xf4f48ce5e1bbf97e lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049518.509241:0:5852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6714a00/0xf4f48ce5e1bbf97e lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049518.509258:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8cb8e0130100) 00010000:00010000:3.0:1789049518.509262:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789049518.509268:0:5852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6714a00/0xf4f48ce5e1bbf97e lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049518.509276:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6714a00/0xf4f48ce5e1bbf97e lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049518.509292:0:5852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c6b35400/0xf4f48ce5e1bbf985 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0xe3cc3ba6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049518.509299:0:5852:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c6b35400/0xf4f48ce5e1bbf985 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0xe3cc3ba6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049518.509312:0:5852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c6b35400/0xf4f48ce5e1bbf985 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0xe3cc3ba6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049518.509318:0:5852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cb8c6b35400 already unused, calling callback (ffffffffc20ca4f0) 00010000:00010000:3.0:1789049518.509322:0:5852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c6b35400/0xf4f48ce5e1bbf985 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0xe3cc3ba6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049518.509329:0:5852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c6b35400/0xf4f48ce5e1bbf985 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0xe3cc3ba6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049518.509338:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0xe3cc3ba6 (ffff8cb8c687d200) 00010000:00010000:3.0:1789049518.509341:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789049518.509344:0:5852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c6b35400/0xf4f48ce5e1bbf985 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0xe3cc3ba6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049518.509351:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c6b35400/0xf4f48ce5e1bbf985 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0xe3cc3ba6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789049518.509502:0:5852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb9009c0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e823b53a-3591-475c-8624-c682227e5c13+30:11493:x1875954089668224:12345-192.168.206.26@tcp:36:lhsmtool_posix.0 Request processed in 4006us (4411us total) trans 0 rc -2/-2 00000100:00100000:3.0:1789049518.509513:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.26@tcp, seq: 175 00000100:00100000:1.0:1789049518.530481:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.26@tcp (source: 12345-192.168.206.26@tcp) 00000100:00100000:2.0:1789049518.530604:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954089668352 00000100:00100000:2.0:1789049518.530623:0:5850:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954089668352 00000100:00100000:3.0:1789049518.531941:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.26@tcp, seq: 176 00000100:00100000:3.0:1789049518.531959:0:5850:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb9009c2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e823b53a-3591-475c-8624-c682227e5c13+30:11493:x1875954089668352:12345-192.168.206.26@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789049518.531991:0:5850:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789049518.532025:0:5850:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c6b35400/0xf4f48ce5e1bbf98c lrc: 2/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7fc5e358805a360e expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049518.532076:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c6b35a00/0xf4f48ce5e1bbf993 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049518.532112:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c6b35a00/0xf4f48ce5e1bbf993 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049518.532127:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c6b35a00/0xf4f48ce5e1bbf993 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049518.533359:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c6b35400/0xf4f48ce5e1bbf98c lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a360e expref: 32 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049518.533391:0:5850:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c6b35a00/0xf4f48ce5e1bbf993 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a360e expref: 31 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049518.533402:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff8cb8c687d200) 00010000:00010000:3.0:1789049518.533405:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1789049518.533410:0:5850:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cb8c6b35a00, rc 0) 00000100:00100000:3.0:1789049518.533501:0:5850:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb9009c2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e823b53a-3591-475c-8624-c682227e5c13+31:11493:x1875954089668352:12345-192.168.206.26@tcp:101:lhsmtool_posix.0 Request processed in 1546us (3034us total) trans 0 rc 0/0 00000100:00100000:3.0:1789049518.533511:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.26@tcp, seq: 176 00000100:00100000:1.0:1789049518.542478:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.26@tcp (source: 12345-192.168.206.26@tcp) 00000100:00100000:3.0:1789049518.543741:0:6841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954089668608 00000100:00100000:3.0:1789049518.543759:0:6841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954089668608 00000100:00100000:3.0:1789049518.543882:0:6841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.26@tcp, seq: 177 00000100:00100000:3.0:1789049518.543900:0:6841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb9009c1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e823b53a-3591-475c-8624-c682227e5c13+31:11493:x1875954089668608:12345-192.168.206.26@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1789049518.544019:0:6841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c6b35e00/0xf4f48ce5e1bbf99a lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049518.544042:0:6841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c6b35e00/0xf4f48ce5e1bbf99a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049518.544077:0:6841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c6b35e00/0xf4f48ce5e1bbf99a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6841 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1789049518.544962:0:6841:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].6, 88 off8648 00000004:00080000:3.0:1789049518.544981:0:6841:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 344597136377ns, next at 345597132756ns, rc = 0 00000004:00010000:3.0:1789049518.545117:0:6841:0:(mdt_handler.c:4507:mdt_save_lock()) ### save lock request 00000000a28ea9ea reply state 00000000bdc789a2 transno 4294967465 ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c6b35e00/0xf4f48ce5e1bbf99a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6841 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789049518.545130:0:6841:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1789049518.545284:0:6841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb9009c1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e823b53a-3591-475c-8624-c682227e5c13+33:11493:x1875954089668608:12345-192.168.206.26@tcp:36:lhsmtool_posix.0 Request processed in 1388us (2817us total) trans 4294967465 rc 0/0 00000100:00100000:3.0:1789049518.545295:0:6841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.26@tcp, seq: 177 00010000:00010000:3.0:1789049518.548955:0:3294:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c6b35e00/0xf4f48ce5e1bbf99a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049518.548980:0:3294:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c6b35e00/0xf4f48ce5e1bbf99a lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049518.548989:0:3294:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c6b35e00/0xf4f48ce5e1bbf99a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049518.549008:0:3294:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cb8c6b35e00 already unused, calling callback (ffffffffc20ca4f0) 00010000:00010000:3.0:1789049518.549015:0:3294:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c6b35e00/0xf4f48ce5e1bbf99a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049518.549026:0:3294:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c6b35e00/0xf4f48ce5e1bbf99a lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049518.549049:0:3294:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff8cb8c687d200) 00010000:00010000:3.0:1789049518.549054:0:3294:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1789049518.549076:0:3294:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c6b35e00/0xf4f48ce5e1bbf99a lrc: 2/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049518.549084:0:3294:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c6b35e00/0xf4f48ce5e1bbf99a lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6841 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789049518.549489:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.26@tcp (source: 12345-192.168.206.26@tcp) 00000100:00100000:0.0:1789049518.549600:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954089668736 00000100:00100000:0.0:1789049518.549614:0:5851:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954089668736 00000100:00100000:0.0:1789049518.549686:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.26@tcp, seq: 178 00000100:00100000:0.0:1789049518.549700:0:5851:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb9009c1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e823b53a-3591-475c-8624-c682227e5c13+32:11493:x1875954089668736:12345-192.168.206.26@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789049518.549733:0:5851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789049518.549756:0:5851:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb7c4c39e00/0xf4f48ce5e1bbf9a1 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7fc5e358805a3615 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049518.549956:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cb7c4c39e00/0xf4f48ce5e1bbf9a1 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a3615 expref: 33 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049518.549976:0:5851:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb7c4c39e00/0xf4f48ce5e1bbf9a1 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a3615 expref: 33 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049518.550003:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff8cb8c687d200) 00010000:00010000:0.0:1789049518.550006:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1789049518.550010:0:5851:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cb7c4c39e00, rc 0) 00000100:00100000:0.0:1789049518.550078:0:5851:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb9009c1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e823b53a-3591-475c-8624-c682227e5c13+33:11493:x1875954089668736:12345-192.168.206.26@tcp:101:lhsmtool_posix.0 Request processed in 381us (596us total) trans 0 rc 0/0 00000100:00100000:0.0:1789049518.550087:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.26@tcp, seq: 178 00000100:00100000:1.0:1789049518.556755:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.26@tcp (source: 12345-192.168.206.26@tcp) 00000100:00100000:3.0:1789049518.556916:0:10560:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954089668864 00000100:00100000:3.0:1789049518.556930:0:10560:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954089668864 00000100:00100000:3.0:1789049518.557002:0:10560:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.26@tcp, seq: 51 00000100:00100000:3.0:1789049518.557017:0:10560:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb9009c3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e823b53a-3591-475c-8624-c682227e5c13+6:2358:x1875954089668864:12345-192.168.206.26@tcp:2:lhsmtool_posix.0 00000100:00100000:3.0:1789049518.557566:0:10560:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb9009c3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e823b53a-3591-475c-8624-c682227e5c13+7:2358:x1875954089668864:12345-192.168.206.26@tcp:2:lhsmtool_posix.0 Request processed in 551us (823us total) trans 4294967313 rc 0/0 00000100:00100000:3.0:1789049518.557576:0:10560:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.26@tcp, seq: 51 00000100:00100000:1.0:1789049518.563073:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.26@tcp (source: 12345-192.168.206.26@tcp) 00000100:00100000:3.0:1789049518.563202:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954089669120 00000100:00100000:3.0:1789049518.563225:0:5853:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954089669120 00000100:00100000:3.0:1789049518.563295:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.26@tcp, seq: 49 00000100:00100000:3.0:1789049518.563307:0:5853:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb9009c3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e823b53a-3591-475c-8624-c682227e5c13+33:11493:x1875954089669120:12345-192.168.206.26@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1789049518.563629:0:5853:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb9009c3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e823b53a-3591-475c-8624-c682227e5c13+34:11493:x1875954089669120:12345-192.168.206.26@tcp:35:lhsmtool_posix.0 Request processed in 323us (570us total) trans 4294967466 rc 0/0 00000100:00100000:3.0:1789049518.563639:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.26@tcp, seq: 49 00000100:00100000:0.0:1789049518.594825:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.26@tcp (source: 12345-192.168.206.26@tcp) 00000100:00100000:1.0:1789049518.595008:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954089669376 00000100:00100000:1.0:1789049518.595023:0:5852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954089669376 00000100:00100000:1.0:1789049518.595096:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.26@tcp, seq: 179 00000100:00100000:1.0:1789049518.595109:0:5852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8f7ac8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e823b53a-3591-475c-8624-c682227e5c13+34:11493:x1875954089669376:12345-192.168.206.26@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1789049518.595263:0:5852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8f7ac8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e823b53a-3591-475c-8624-c682227e5c13+34:11493:x1875954089669376:12345-192.168.206.26@tcp:57:lhsmtool_posix.0 Request processed in 156us (462us total) trans 0 rc 0/0 00000100:00100000:1.0:1789049518.595271:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.26@tcp, seq: 179 00000100:00100000:0.0:1789049518.598331:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.26@tcp (source: 12345-192.168.206.26@tcp) 00000100:00100000:1.0:1789049518.598434:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954089669504 00000100:00100000:1.0:1789049518.598451:0:5851:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954089669504 00000100:00100000:1.0:1789049518.598531:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.26@tcp, seq: 180 00000100:00100000:1.0:1789049518.598544:0:5851:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8fc99a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e823b53a-3591-475c-8624-c682227e5c13+34:11493:x1875954089669504:12345-192.168.206.26@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1789049518.598573:0:5851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789049518.598600:0:5851:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c3000/0xf4f48ce5e1bbf9a8 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7fc5e358805a361c expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049518.598699:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c3800/0xf4f48ce5e1bbf9af lrc: 3/1,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049518.598737:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c3800/0xf4f48ce5e1bbf9af lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049518.598751:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c3800/0xf4f48ce5e1bbf9af lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789049518.598811:0:5851:0:(mdt_handler.c:1587:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1789049518.598836:0:5851:0:(mdt_handler.c:2522:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c3800/0xf4f48ce5e1bbf9af lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049518.598918:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c3000/0xf4f48ce5e1bbf9a8 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a361c expref: 36 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049518.598943:0:5851:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c3800/0xf4f48ce5e1bbf9af lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a361c expref: 35 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049518.598952:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff8cb8c687d200) 00010000:00010000:1.0:1789049518.598956:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1789049518.598960:0:5851:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cb8c28c3800, rc 0) 00000100:00100000:1.0:1789049518.599045:0:5851:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8fc99a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e823b53a-3591-475c-8624-c682227e5c13+35:11493:x1875954089669504:12345-192.168.206.26@tcp:101:lhsmtool_posix.0 Request processed in 503us (723us total) trans 0 rc 0/0 00000100:00100000:1.0:1789049518.599053:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.26@tcp, seq: 180 00000100:00100000:0.0:1789049518.606435:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.26@tcp (source: 12345-192.168.206.26@tcp) 00000100:00100000:1.0:1789049518.606989:0:6705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954089669632 00000100:00100000:1.0:1789049518.607006:0:6705:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954089669632 00000100:00100000:1.0:1789049518.607092:0:6705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.26@tcp, seq: 52 00000100:00100000:1.0:1789049518.607104:0:6705:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8fc999500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e823b53a-3591-475c-8624-c682227e5c13+7:2356:x1875954089669632:12345-192.168.206.26@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1789049518.607130:0:6705:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789049518.607174:0:6705:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000acc6525f/0xf4f48ce5e1bbf9b6 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x7fc5e358805a3623 expref: -99 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1789049518.607354:0:6705:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x18d3fb0ec517bcc0, blocks: 0x1 00010000:00010000:1.0:1789049518.607383:0:6705:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=344s v=(0 0) 00010000:00010000:1.0:1789049518.607389:0:6705:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789049518.607400:0:6705:0:(ldlm_resource.c:1751:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000acc6525f/0xf4f48ce5e1bbf9b6 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a3623 expref: 8 pid: 6705 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049518.607425:0:6705:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000acc6525f/0xf4f48ce5e1bbf9b6 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a3623 expref: 8 pid: 6705 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049518.607440:0:6705:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cb8c28c2600, rc 0) 00000100:00100000:1.0:1789049518.607507:0:6705:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8fc999500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e823b53a-3591-475c-8624-c682227e5c13+8:2356:x1875954089669632:12345-192.168.206.26@tcp:101:lhsmtool_posix.0 Request processed in 405us (1089us total) trans 0 rc 0/0 00000100:00100000:1.0:1789049518.607516:0:6705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.26@tcp, seq: 52 00000100:00100000:1.0:1789049518.622204:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.26@tcp (source: 12345-192.168.206.26@tcp) 00000100:00100000:3.0:1789049518.622417:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954089669888 00000100:00100000:3.0:1789049518.622429:0:5852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954089669888 00000100:00100000:3.0:1789049518.622503:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.26@tcp, seq: 181 00000100:00100000:3.0:1789049518.622515:0:5852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb7c7144000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e823b53a-3591-475c-8624-c682227e5c13+35:11493:x1875954089669888:12345-192.168.206.26@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1789049518.622655:0:5852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb7c7144000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e823b53a-3591-475c-8624-c682227e5c13+35:11493:x1875954089669888:12345-192.168.206.26@tcp:57:lhsmtool_posix.0 Request processed in 141us (465us total) trans 0 rc 0/0 00000100:00100000:3.0:1789049518.622663:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.26@tcp, seq: 181 00000100:00100000:3.0:1789049518.630418:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.26@tcp (source: 12345-192.168.206.26@tcp) 00000100:00100000:1.0:1789049518.631091:0:10560:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954089670016 00000100:00100000:1.0:1789049518.631107:0:10560:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954089670016 00000100:00100000:1.0:1789049518.631199:0:10560:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.26@tcp, seq: 53 00000100:00100000:1.0:1789049518.631222:0:10560:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8df4d0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e823b53a-3591-475c-8624-c682227e5c13+8:11493:x1875954089670016:12345-192.168.206.26@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1789049518.631248:0:10560:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789049518.631273:0:10560:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005d303c00/0xf4f48ce5e1bbf9bd lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x7fc5e358805a362a expref: -99 pid: 10560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049518.631316:0:10560:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000acc6525f/0xf4f48ce5e1bbf9b6 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a3623 expref: 9 pid: 6705 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049518.631351:0:10560:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789049518.631356:0:10560:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789049518.631363:0:10560:0:(ldlm_resource.c:1751:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005d303c00/0xf4f48ce5e1bbf9bd lrc: 4/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a362a expref: 9 pid: 10560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049518.631409:0:10560:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000acc6525f/0xf4f48ce5e1bbf9b6 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a3623 expref: 9 pid: 6705 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049518.631426:0:10560:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000acc6525f/0xf4f48ce5e1bbf9b6 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a3623 expref: 9 pid: 6705 timeout: 444 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789049518.631444:0:10560:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb7c7146d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10560:1875954110635264:192.168.206.26@tcp:104: 00000100:00100000:1.0:1789049518.631569:0:10560:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cb8d235b840 going to sleep for 11 seconds 00000100:00100000:0.0:1789049518.640974:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.26@tcp (source: 12345-192.168.206.26@tcp) 00000100:00100000:2.0:1789049518.641296:0:10560:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb7c7146d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10560:1875954110635264:192.168.206.26@tcp:104: 00010000:00010000:2.0:1789049518.641350:0:10560:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000005d303c00/0xf4f48ce5e1bbf9bd lrc: 3/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a362a expref: 9 pid: 10560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049518.641395:0:10560:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cb8c28c2000, rc 0) 00000100:00100000:2.0:1789049518.641472:0:10560:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8df4d0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e823b53a-3591-475c-8624-c682227e5c13+9:11493:x1875954089670016:12345-192.168.206.26@tcp:101:lhsmtool_posix.0 Request processed in 10260us (11066us total) trans 0 rc 0/0 00000100:00100000:2.0:1789049518.641483:0:10560:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.26@tcp, seq: 53 00000100:00100000:1.0:1789049518.644292:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954089670144 00000100:00100000:1.0:1789049518.644314:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954089670144 00010000:00010000:1.0:1789049518.644376:0:5837:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000acc6525f/0xf4f48ce5e1bbf9b6 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a3623 expref: 9 pid: 6705 timeout: 444 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789049518.644425:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.26@tcp, seq: 67 00000100:00100000:1.0:1789049518.644438:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb7c7138000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e823b53a-3591-475c-8624-c682227e5c13+9:2357:x1875954089670144:12345-192.168.206.26@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789049518.644469:0:5837:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789049518.644500:0:5837:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000acc6525f/0xf4f48ce5e1bbf9b6 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a3623 expref: 9 pid: 6705 timeout: 444 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049518.644542:0:5837:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000acc6525f/0xf4f48ce5e1bbf9b6 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a3623 expref: 9 pid: 6705 timeout: 444 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049518.644572:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000acc6525f/0xf4f48ce5e1bbf9b6 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a3623 expref: 9 pid: 6705 timeout: 444 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049518.644593:0:5837:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789049518.644599:0:5837:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789049518.644609:0:5837:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000005d303c00/0xf4f48ce5e1bbf9bd lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a362a expref: 8 pid: 10560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049518.644621:0:5837:0:(ldlm_resource.c:1751:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005d303c00/0xf4f48ce5e1bbf9bd lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a362a expref: 8 pid: 10560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049518.644673:0:5837:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 000000005d303c00/0xf4f48ce5e1bbf9bd lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a362a expref: 8 pid: 10560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789049518.644820:0:5837:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb7c7145f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:5837:1875954110635392:192.168.206.26@tcp:105: 00000100:00100000:1.0:1789049518.644957:0:5837:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cb8d235b840 going to sleep for 11 seconds 00000100:00100000:1.0:1789049518.651756:0:5837:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb7c7145f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:5837:1875954110635392:192.168.206.26@tcp:105: 00010000:00010000:1.0:1789049518.651797:0:5837:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789049518.651916:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb7c7138000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e823b53a-3591-475c-8624-c682227e5c13+8:2357:x1875954089670144:12345-192.168.206.26@tcp:103:ldlm_bl.0 Request processed in 7480us (10955us total) trans 0 rc 0/0 00000100:00100000:1.0:1789049518.651929:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.26@tcp, seq: 67 00000100:00100000:1.0:1789049518.653563:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.26@tcp (source: 12345-192.168.206.26@tcp) 00000100:00100000:2.0:1789049518.653918:0:6710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954089670272 00000100:00100000:2.0:1789049518.653931:0:6710:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954089670272 00002000:00100000:2.0:1789049518.653998:0:6710:0:(ofd_dev.c:2725:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x5:0x0] (0->8) req@ffff8cb7c7145f80 x1875954089670272/t0(0) o4->e823b53a-3591-475c-8624-c682227e5c13@192.168.206.26@tcp:19/0 lens 504/0 e 0 to 0 dl 1789049529 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789049518.654012:0:6710:0:(ofd_dev.c:2581:ofd_prolong_extent_locks()) Prolong locks for req ffff8cb7c7145f80 with x1875954089670272 ext(0->8) 00002000:00010000:2.0:1789049518.654018:0:6710:0:(ofd_dev.c:2730:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8cb7c7145f80 00000100:00100000:2.0:1789049518.654098:0:6710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.26@tcp, seq: 4 00000100:00100000:2.0:1789049518.654111:0:6710:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb7c7145f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e823b53a-3591-475c-8624-c682227e5c13+8:2357:x1875954089670272:12345-192.168.206.26@tcp:4:lhsmtool_posix.0 00000100:00100000:2.0:1789049518.654703:0:6710:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb7c7145f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e823b53a-3591-475c-8624-c682227e5c13+10:2357:x1875954089670272:12345-192.168.206.26@tcp:4:lhsmtool_posix.0 Request processed in 592us (1151us total) trans 4294967314 rc 0/0 00000100:00100000:2.0:1789049518.654713:0:6710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.26@tcp, seq: 4 00002000:00100000:2.0:1789049518.654722:0:6710:0:(ofd_dev.c:2725:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x5:0x0] (0->8) req@ffff8cb7c7145f80 x1875954089670272/t4294967314(0) o4->e823b53a-3591-475c-8624-c682227e5c13@192.168.206.26@tcp:19/0 lens 504/448 e 0 to 0 dl 1789049529 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789049518.654732:0:6710:0:(ofd_dev.c:2581:ofd_prolong_extent_locks()) Prolong locks for req ffff8cb7c7145f80 with x1875954089670272 ext(0->8) 00002000:00010000:2.0:1789049518.654736:0:6710:0:(ofd_dev.c:2730:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8cb7c7145f80 00000100:00100000:0.0:1789049518.663451:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.26@tcp (source: 12345-192.168.206.26@tcp) 00000100:00100000:2.0:1789049518.664104:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954089670400 00000100:00100000:2.0:1789049518.664120:0:5851:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954089670400 00000100:00100000:2.0:1789049518.664206:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.26@tcp, seq: 182 00000100:00100000:2.0:1789049518.664228:0:5851:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb7c713ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e823b53a-3591-475c-8624-c682227e5c13+35:11493:x1875954089670400:12345-192.168.206.26@tcp:44:lhsmtool_posix.0 00010000:00010000:1.0:1789049518.811004:0:6719:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1789049518.815003:0:5872:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967463 is committed 00000001:00080000:0.0:1789049518.815042:0:5872:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967464 is committed 00000001:00080000:0.0:1789049518.815054:0:5872:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967466 is committed 00000004:00080000:0.0:1789049518.815062:0:5872:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 7 committed 00000020:00080000:0.0:1789049518.815100:0:5872:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 5 batchid updated 00000020:00080000:3.0:1789049518.815461:0:5883:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 5 00000020:00080000:3.0:1789049518.815475:0:5883:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 5 00000100:00100000:3.0:1789049518.815483:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789049518.815509:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb8df208a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3311:1875954110635520:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1789049518.815598:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789049518.815677:0:6703:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954110635520 00000100:00100000:3.0:1789049518.815687:0:6703:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954110635520 00000100:00100000:3.0:1789049518.815754:0:6703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1789049518.815765:0:6703:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8c5819f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3311:x1875954110635520:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:3.0:1789049518.816007:0:6703:0:(ofd_lvb.c:321:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:3.0:1789049518.816012:0:6703:0:(ofd_lvb.c:328:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb mtime from disk: 0 -> 1789049517966932500 00002000:00010000:3.0:1789049518.816014:0:6703:0:(ofd_lvb.c:334:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1789049518.816017:0:6703:0:(ofd_lvb.c:340:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb ctime from disk: 1789049517851000000 -> 1789049517966932500 00002000:00010000:3.0:1789049518.816020:0:6703:0:(ofd_lvb.c:346:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:3.0:1789049518.816066:0:6703:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8c5819f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3311:x1875954110635520:12345-0@lo:2:osp-syn-0-0.0 Request processed in 303us (467us total) trans 4294967315 rc 0/0 00000100:00100000:3.0:1789049518.816074:0:6703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000004:00080000:3.0:1789049518.816128:0:3311:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8cb8df208a80/2, rc 0, transno 4294967315 00000100:00100000:3.0:1789049518.816134:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb8df208a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3311:1875954110635520:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1789049518.817613:0:5851:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb7c713ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e823b53a-3591-475c-8624-c682227e5c13+18:11493:x1875954089670400:12345-192.168.206.26@tcp:44:lhsmtool_posix.0 Request processed in 153375us (154163us total) trans 0 rc 0/0 00000100:00100000:1.0:1789049518.817627:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.26@tcp, seq: 182 00000100:00080000:1.0:1789049518.817665:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789049518.823380:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.26@tcp (source: 12345-192.168.206.26@tcp) 00000100:00100000:2.0:1789049518.826995:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954089670528 00000100:00100000:2.0:1789049518.827018:0:6704:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954089670528 00000100:00100000:3.0:1789049518.830474:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.26@tcp, seq: 55 00000100:00100000:3.0:1789049518.830493:0:6704:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb7c7139f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e823b53a-3591-475c-8624-c682227e5c13+10:2355:x1875954089670528:12345-192.168.206.26@tcp:16:lhsmtool_posix.0 00000001:00080000:2.0:1789049518.961946:0:6731:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967314 is committed 00000001:00080000:2.0:1789049518.961973:0:6731:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967315 is committed 00000100:00100000:0.0:1789049518.963049:0:6704:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb7c7139f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e823b53a-3591-475c-8624-c682227e5c13+7:2355:x1875954089670528:12345-192.168.206.26@tcp:16:lhsmtool_posix.0 Request processed in 132548us (139672us total) trans 0 rc 0/0 00000100:00100000:0.0:1789049518.963064:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.26@tcp, seq: 55 00000100:00100000:0.0:1789049518.968130:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.26@tcp (source: 12345-192.168.206.26@tcp) 00000100:00100000:3.0:1789049518.968246:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954089670784 00000100:00100000:3.0:1789049518.968258:0:5852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954089670784 00000100:00100000:3.0:1789049518.968333:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.26@tcp, seq: 183 00000100:00100000:3.0:1789049518.968345:0:5852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb7c7139880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e823b53a-3591-475c-8624-c682227e5c13+18:11493:x1875954089670784:12345-192.168.206.26@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1789049518.968433:0:5852:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789049518.968658:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c3800/0xf4f48ce5e1bbf9af lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a361c expref: 18 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049518.968694:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff8cb8c687d200) 00010000:00010000:3.0:1789049518.968701:0:5852:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789049518.968750:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c6b35e00/0xf4f48ce5e1bbf9c4 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049518.968768:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c6b35e00/0xf4f48ce5e1bbf9c4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049518.968780:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c6b35e00/0xf4f48ce5e1bbf9c4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789049518.969661:0:5852:0:(mdt_handler.c:4507:mdt_save_lock()) ### save lock request 000000005ceee6f2 reply state 0000000046d766d0 transno 4294967467 ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c6b35e00/0xf4f48ce5e1bbf9c4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789049518.969785:0:5852:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1789049518.970174:0:5852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb7c7139880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e823b53a-3591-475c-8624-c682227e5c13+19:11493:x1875954089670784:12345-192.168.206.26@tcp:36:lhsmtool_posix.0 Request processed in 1827us (2054us total) trans 4294967467 rc 0/0 00000100:00100000:3.0:1789049518.970185:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.26@tcp, seq: 183 00000100:00100000:0.0:1789049518.977889:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.26@tcp (source: 12345-192.168.206.26@tcp) 00000100:00100000:3.0:1789049518.978107:0:6703:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954089670912 00000100:00100000:3.0:1789049518.978121:0:6703:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954089670912 00000100:00100000:3.0:1789049518.978207:0:6703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.26@tcp, seq: 56 00000100:00100000:3.0:1789049518.978220:0:6703:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb7c713b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e823b53a-3591-475c-8624-c682227e5c13+7:2357:x1875954089670912:12345-192.168.206.26@tcp:2:lhsmtool_posix.0 00002000:00010000:3.0:1789049518.978588:0:6703:0:(ofd_lvb.c:321:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 9 -> 9 00002000:00010000:3.0:1789049518.978593:0:6703:0:(ofd_lvb.c:328:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb mtime from disk: 1789049517966932500 -> 1789049517195000000 00002000:00010000:3.0:1789049518.978615:0:6703:0:(ofd_lvb.c:334:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb atime from disk: 0 -> 1789049515539000000 00002000:00010000:3.0:1789049518.978618:0:6703:0:(ofd_lvb.c:340:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb ctime from disk: 1789049517966932500 -> 1789049517195000000 00002000:00010000:3.0:1789049518.978620:0:6703:0:(ofd_lvb.c:346:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:3.0:1789049518.978694:0:6703:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb7c713b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e823b53a-3591-475c-8624-c682227e5c13+8:2357:x1875954089670912:12345-192.168.206.26@tcp:2:lhsmtool_posix.0 Request processed in 476us (859us total) trans 4294967316 rc 0/0 00000100:00100000:3.0:1789049518.978705:0:6703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.26@tcp, seq: 56 00000100:00100000:1.0:1789049518.982712:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.26@tcp (source: 12345-192.168.206.26@tcp) 00000100:00100000:3.0:1789049518.982909:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954089671168 00000100:00100000:3.0:1789049518.982922:0:5850:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954089671168 00000100:00100000:3.0:1789049518.982996:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.26@tcp, seq: 184 00000100:00100000:3.0:1789049518.983008:0:5850:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb7c7145880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e823b53a-3591-475c-8624-c682227e5c13+19:11493:x1875954089671168:12345-192.168.206.26@tcp:55:lhsmtool_posix.0 00010000:00010000:3.0:1789049518.983097:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c6b35400/0xf4f48ce5e1bbf9cb lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049518.983117:0:5850:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c6b35a00/0xf4f48ce5e1bbf993 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a360e expref: 19 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049518.983127:0:5850:0:(ldlm_resource.c:1751:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c6b35400/0xf4f48ce5e1bbf9cb lrc: 4/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049518.983183:0:5850:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c6b35a00/0xf4f48ce5e1bbf993 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a360e expref: 19 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049518.983199:0:5850:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c6b35a00/0xf4f48ce5e1bbf993 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a360e expref: 19 pid: 5850 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789049518.984413:0:5850:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb8df287b80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5850:1875954110635648:192.168.206.26@tcp:104: 00000100:00100000:3.0:1789049518.984553:0:5850:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cb8dbb6b9c0 going to sleep for 11 seconds 00010000:00010000:2.0:1789049518.987362:0:3295:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c6b35e00/0xf4f48ce5e1bbf9c4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049518.987388:0:3295:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c6b35e00/0xf4f48ce5e1bbf9c4 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049518.987399:0:3295:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c6b35e00/0xf4f48ce5e1bbf9c4 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049518.987407:0:3295:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cb8c6b35e00 already unused, calling callback (ffffffffc20ca4f0) 00010000:00010000:2.0:1789049518.987413:0:3295:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c6b35e00/0xf4f48ce5e1bbf9c4 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049518.987423:0:3295:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c6b35e00/0xf4f48ce5e1bbf9c4 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049518.987448:0:3295:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff8cb8c687d200) 00010000:00010000:2.0:1789049518.987451:0:3295:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789049518.987458:0:3295:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c6b35e00/0xf4f48ce5e1bbf9c4 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049518.987466:0:3295:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c6b35e00/0xf4f48ce5e1bbf9c4 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789049518.996254:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.26@tcp (source: 12345-192.168.206.26@tcp) 00000100:00100000:2.0:1789049518.996335:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954089671296 00000100:00100000:2.0:1789049518.996348:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954089671296 00010000:00010000:2.0:1789049518.996405:0:5836:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c6b35a00/0xf4f48ce5e1bbf993 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a360e expref: 19 pid: 5850 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789049518.996480:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.26@tcp, seq: 68 00000100:00100000:2.0:1789049518.996491:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb7c7147100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e823b53a-3591-475c-8624-c682227e5c13+19:2358:x1875954089671296:12345-192.168.206.26@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789049518.996510:0:5836:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789049518.996518:0:5836:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c6b35a00/0xf4f48ce5e1bbf993 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a360e expref: 19 pid: 5850 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049518.996533:0:5836:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c6b35a00/0xf4f48ce5e1bbf993 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a360e expref: 19 pid: 5850 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049518.996562:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff8cb8c687d200) 00010000:00010000:2.0:1789049518.996567:0:5836:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c6b35400/0xf4f48ce5e1bbf9cb lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049518.996578:0:5836:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c6b35400/0xf4f48ce5e1bbf9cb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049518.996587:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c6b35400/0xf4f48ce5e1bbf9cb lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049518.996612:0:5836:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789049518.996682:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb7c7147100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e823b53a-3591-475c-8624-c682227e5c13+19:2358:x1875954089671296:12345-192.168.206.26@tcp:103:ldlm_bl.0 Request processed in 192us (442us total) trans 0 rc 0/0 00000100:00100000:2.0:1789049518.996691:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.26@tcp, seq: 68 00010000:00010000:3.0:1789049518.998957:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c6b35a00/0xf4f48ce5e1bbf993 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a360e expref: 18 pid: 5850 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789049518.998986:0:5850:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb8df287b80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5850:1875954110635648:192.168.206.26@tcp:104: 00010000:00010000:3.0:1789049518.999019:0:5850:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c6b35400/0xf4f48ce5e1bbf9cb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049518.999031:0:5850:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c6b35400/0xf4f48ce5e1bbf9cb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049518.999039:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c6b35400/0xf4f48ce5e1bbf9cb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049518.999079:0:5850:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c6b35400/0xf4f48ce5e1bbf9cb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049518.999086:0:5850:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c6b35400/0xf4f48ce5e1bbf9cb lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049518.999096:0:5850:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c6b35400/0xf4f48ce5e1bbf9cb lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049518.999103:0:5850:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cb8c6b35400 already unused, calling callback (ffffffffc20ca4f0) 00010000:00010000:3.0:1789049518.999108:0:5850:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c6b35400/0xf4f48ce5e1bbf9cb lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049518.999117:0:5850:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c6b35400/0xf4f48ce5e1bbf9cb lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049518.999135:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff8cb8c687d200) 00010000:00010000:3.0:1789049518.999139:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:3.0:1789049518.999176:0:5850:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c6b35400/0xf4f48ce5e1bbf9cb lrc: 2/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049518.999184:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c6b35400/0xf4f48ce5e1bbf9cb lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789049518.999650:0:5850:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb7c7145880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e823b53a-3591-475c-8624-c682227e5c13+17:11493:x1875954089671168:12345-192.168.206.26@tcp:55:lhsmtool_posix.0 Request processed in 16641us (16950us total) trans 0 rc -22/-22 00000100:00100000:3.0:1789049518.999663:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.26@tcp, seq: 184 00000100:00100000:0.0:1789049519.017055:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.26@tcp (source: 12345-192.168.206.26@tcp) 00000100:00100000:2.0:1789049519.017505:0:10560:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954089671424 00000100:00100000:2.0:1789049519.017520:0:10560:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954089671424 00000100:00100000:2.0:1789049519.017599:0:10560:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.26@tcp, seq: 57 00000100:00100000:2.0:1789049519.017613:0:10560:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb7c713a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e823b53a-3591-475c-8624-c682227e5c13+8:2358:x1875954089671424:12345-192.168.206.26@tcp:1:lhsmtool_posix.0 00010000:00010000:2.0:1789049519.017714:0:10560:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000099930708/0xf4f48ce5e1bbf9d2 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 10560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049519.017902:0:10560:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000005d303c00/0xf4f48ce5e1bbf9bd lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a362a expref: 8 pid: 10560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049519.017914:0:10560:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x5:0x0].0x0 since=1s v=(0 0) 00010000:00010000:2.0:1789049519.017919:0:10560:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1789049519.017925:0:10560:0:(ldlm_resource.c:1751:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000099930708/0xf4f48ce5e1bbf9d2 lrc: 4/1,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 10560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049519.017977:0:10560:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000005d303c00/0xf4f48ce5e1bbf9bd lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a362a expref: 8 pid: 10560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049519.017994:0:10560:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000005d303c00/0xf4f48ce5e1bbf9bd lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a362a expref: 8 pid: 10560 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789049519.018013:0:10560:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb8df260380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10560:1875954110635776:192.168.206.26@tcp:104: 00000100:00100000:2.0:1789049519.018200:0:10560:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cb8c63eab40 going to sleep for 11 seconds 00000100:00100000:3.0:1789049519.030024:0:10560:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb8df260380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10560:1875954110635776:192.168.206.26@tcp:104: 00010000:00010000:3.0:1789049519.030076:0:10560:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000099930708/0xf4f48ce5e1bbf9d2 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 10560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789049519.039783:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.26@tcp (source: 12345-192.168.206.26@tcp) 00000100:00100000:3.0:1789049519.039934:0:6720:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954089671552 00000100:00100000:3.0:1789049519.039947:0:6720:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954089671552 00010000:00010000:3.0:1789049519.040020:0:6720:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000005d303c00/0xf4f48ce5e1bbf9bd lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a362a expref: 9 pid: 10560 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789049519.040071:0:6720:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.26@tcp, seq: 69 00000100:00100000:3.0:1789049519.040082:0:6720:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8c7ded850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e823b53a-3591-475c-8624-c682227e5c13+9:2358:x1875954089671552:12345-192.168.206.26@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789049519.040099:0:6720:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789049519.040126:0:6720:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000005d303c00/0xf4f48ce5e1bbf9bd lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a362a expref: 9 pid: 10560 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049519.040140:0:6720:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000005d303c00/0xf4f48ce5e1bbf9bd lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a362a expref: 9 pid: 10560 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049519.040204:0:6720:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005d303c00/0xf4f48ce5e1bbf9bd lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a362a expref: 9 pid: 10560 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049519.040227:0:6720:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1789049519.040232:0:6720:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1789049519.040240:0:6720:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000099930708/0xf4f48ce5e1bbf9d2 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 10560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049519.040251:0:6720:0:(ldlm_resource.c:1751:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000099930708/0xf4f48ce5e1bbf9d2 lrc: 4/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 10560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049519.040299:0:6720:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789049519.040371:0:6720:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8c7ded850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e823b53a-3591-475c-8624-c682227e5c13+8:2358:x1875954089671552:12345-192.168.206.26@tcp:103:ldlm_bl.0 Request processed in 290us (602us total) trans 0 rc 0/0 00000100:00100000:3.0:1789049519.040380:0:6720:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.26@tcp, seq: 69 00010000:00010000:3.0:1789049519.040456:0:10560:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000099930708/0xf4f48ce5e1bbf9d2 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 10560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049519.040468:0:10560:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000099930708/0xf4f48ce5e1bbf9d2 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 10560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049519.040496:0:10560:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000099930708/0xf4f48ce5e1bbf9d2 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 10560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049519.040505:0:10560:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000099930708/0xf4f48ce5e1bbf9d2 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 10560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049519.040523:0:10560:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000099930708/0xf4f48ce5e1bbf9d2 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 10560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049519.040531:0:10560:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cb8d6715c00 already unused, calling callback (ffffffffc166a8f0) 00010000:00010000:3.0:1789049519.040536:0:10560:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000099930708/0xf4f48ce5e1bbf9d2 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 10560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049519.040547:0:10560:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000099930708/0xf4f48ce5e1bbf9d2 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 10560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049519.040561:0:10560:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000099930708/0xf4f48ce5e1bbf9d2 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 10560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049519.040570:0:10560:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000099930708/0xf4f48ce5e1bbf9d2 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 10560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789049519.040623:0:10560:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb7c713a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e823b53a-3591-475c-8624-c682227e5c13+7:2358:x1875954089671424:12345-192.168.206.26@tcp:1:lhsmtool_posix.0 Request processed in 23013us (23583us total) trans 0 rc 0/0 00000100:00100000:3.0:1789049519.040632:0:10560:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.26@tcp, seq: 57 00000100:00100000:1.0:1789049519.043944:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.26@tcp (source: 12345-192.168.206.26@tcp) 00000100:00100000:1.0:1789049519.043995:0:6841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954089671808 00000100:00100000:1.0:1789049519.044007:0:6841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954089671808 00000100:00100000:1.0:1789049519.044084:0:6841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.26@tcp, seq: 185 00000100:00100000:1.0:1789049519.044097:0:6841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb7c7146680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e823b53a-3591-475c-8624-c682227e5c13+17:11493:x1875954089671808:12345-192.168.206.26@tcp:57:lhsmtool_posix.0 00010000:00010000:1.0:1789049519.044231:0:6841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c2e00/0xf4f48ce5e1bbf9d9 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049519.044254:0:6841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c2e00/0xf4f48ce5e1bbf9d9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049519.044270:0:6841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c2e00/0xf4f48ce5e1bbf9d9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049519.044678:0:6841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c3400/0xf4f48ce5e1bbf9e0 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049519.044691:0:6841:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb7c4c39e00/0xf4f48ce5e1bbf9a1 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a3615 expref: 18 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049519.044701:0:6841:0:(ldlm_resource.c:1751:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c3400/0xf4f48ce5e1bbf9e0 lrc: 4/0,1 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049519.045502:0:6841:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8cb7c4c39e00/0xf4f48ce5e1bbf9a1 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a3615 expref: 18 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049519.045524:0:6841:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb7c4c39e00/0xf4f48ce5e1bbf9a1 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a3615 expref: 18 pid: 5851 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789049519.045543:0:6841:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb7c7147b80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6841:1875954110635904:192.168.206.26@tcp:104: 00000100:00100000:1.0:1789049519.045662:0:6841:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cb8c625f480 going to sleep for 11 seconds 00000100:00080000:1.0:1789049519.045698:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789049519.059333:0:6841:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb7c7147b80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6841:1875954110635904:192.168.206.26@tcp:104: 00010000:00010000:0.0:1789049519.059376:0:6841:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c3400/0xf4f48ce5e1bbf9e0 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6841 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789049519.060051:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.26@tcp (source: 12345-192.168.206.26@tcp) 00000100:00100000:3.0:1789049519.060497:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954089671936 00000100:00100000:3.0:1789049519.060507:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954089671936 00010000:00010000:3.0:1789049519.060562:0:5836:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cb7c4c39e00/0xf4f48ce5e1bbf9a1 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a3615 expref: 19 pid: 5851 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789049519.060609:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.26@tcp, seq: 70 00000100:00100000:3.0:1789049519.060637:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb7c713bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e823b53a-3591-475c-8624-c682227e5c13+19:2357:x1875954089671936:12345-192.168.206.26@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789049519.060655:0:5836:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789049519.060663:0:5836:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8cb7c4c39e00/0xf4f48ce5e1bbf9a1 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a3615 expref: 19 pid: 5851 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049519.060703:0:5836:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8cb7c4c39e00/0xf4f48ce5e1bbf9a1 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a3615 expref: 19 pid: 5851 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049519.060745:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb7c4c39e00/0xf4f48ce5e1bbf9a1 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a3615 expref: 19 pid: 5851 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049519.060765:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff8cb8c687d200) 00010000:00010000:3.0:1789049519.060771:0:5836:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c3400/0xf4f48ce5e1bbf9e0 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049519.060782:0:5836:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c3400/0xf4f48ce5e1bbf9e0 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 6841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049519.060790:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c3400/0xf4f48ce5e1bbf9e0 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 6841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049519.060828:0:5836:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789049519.060935:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb7c713bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e823b53a-3591-475c-8624-c682227e5c13+18:2357:x1875954089671936:12345-192.168.206.26@tcp:103:ldlm_bl.0 Request processed in 293us (881us total) trans 0 rc 0/0 00000100:00100000:3.0:1789049519.060945:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.26@tcp, seq: 70 00010000:00010000:0.0:1789049519.061750:0:6841:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c3400/0xf4f48ce5e1bbf9e0 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049519.061764:0:6841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c3400/0xf4f48ce5e1bbf9e0 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6841 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789049519.062040:0:6841:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967468 00000001:00080000:0.0:1789049519.062234:0:6841:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967469 00000001:00080000:0.0:1789049519.062296:0:6841:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967470 00000100:00100000:0.0:1789049519.062423:0:6841:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb7c7138380 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:6841:1875954110636032:0@lo:1000:mdt00_003.0 00000100:00100000:0.0:1789049519.062502:0:6841:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789049519.062551:0:6841:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cb8c799f180 going to sleep for 11 seconds 00000100:00100000:2.0:1789049519.063636:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954110636032 00000100:00100000:2.0:1789049519.063650:0:5856:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954110636032 00000100:00100000:2.0:1789049519.063881:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1789049519.063894:0:5856:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb7c713a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:6841:x1875954110636032:12345-0@lo:1000:mdt00_003.0 00000100:00100000:2.0:1789049519.064027:0:5856:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb7c713a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:6841:x1875954110636032:12345-0@lo:1000:mdt00_003.0 Request processed in 135us (1525us total) trans 0 rc 0/0 00000100:00100000:2.0:1789049519.064035:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1789049519.064216:0:6841:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967315 gen 2 00000004:00080000:3.0:1789049519.064224:0:6841:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8cb8df208a80, transno 4294967315 00000100:00100000:3.0:1789049519.064247:0:6841:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb7c7138380 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:6841:1875954110636032:0@lo:1000:mdt00_003.0 00000001:00080000:3.0:1789049519.065049:0:6841:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967471 00000100:00100000:3.0:1789049519.065205:0:6841:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb8df287b80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:6841:1875954110636160:0@lo:1000:mdt00_003.0 00000100:00100000:3.0:1789049519.065263:0:6841:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789049519.065592:0:6841:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cb8dbb6b6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789049519.065706:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954110636160 00000100:00100000:0.0:1789049519.065715:0:5855:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954110636160 00000100:00100000:0.0:1789049519.065761:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1789049519.065775:0:5855:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8df286a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:6841:x1875954110636160:12345-0@lo:1000:mdt00_003.0 00000100:00100000:0.0:1789049519.066065:0:5855:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8df286a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:6841:x1875954110636160:12345-0@lo:1000:mdt00_003.0 Request processed in 293us (800us total) trans 4294967317 rc 0/0 00000100:00100000:0.0:1789049519.066074:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1789049519.066421:0:6841:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb8df287b80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:6841:1875954110636160:0@lo:1000:mdt00_003.0 00010000:00010000:3.0:1789049519.066469:0:6841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c3400/0xf4f48ce5e1bbf9e0 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049519.066483:0:6841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c3400/0xf4f48ce5e1bbf9e0 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049519.066492:0:6841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c3400/0xf4f48ce5e1bbf9e0 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049519.066499:0:6841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cb8c28c3400 already unused, calling callback (ffffffffc20ca4f0) 00010000:00010000:3.0:1789049519.066505:0:6841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c3400/0xf4f48ce5e1bbf9e0 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049519.066513:0:6841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c3400/0xf4f48ce5e1bbf9e0 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049519.066532:0:6841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff8cb8c687d200) 00010000:00010000:3.0:1789049519.066536:0:6841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1789049519.066542:0:6841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c3400/0xf4f48ce5e1bbf9e0 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049519.066550:0:6841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c3400/0xf4f48ce5e1bbf9e0 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049519.066592:0:6841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c6b35800/0xf4f48ce5e1bbf91c lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049519.066620:0:6841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c6b35800/0xf4f48ce5e1bbf91c lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049519.066627:0:6841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c6b35800/0xf4f48ce5e1bbf91c lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049519.066633:0:6841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cb8c6b35800 already unused, calling callback (ffffffffc20ca4f0) 00010000:00010000:3.0:1789049519.066636:0:6841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c6b35800/0xf4f48ce5e1bbf91c lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049519.066644:0:6841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c6b35800/0xf4f48ce5e1bbf91c lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049519.066654:0:6841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8cb8c687d800) 00010000:00010000:3.0:1789049519.066656:0:6841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1789049519.066660:0:6841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c6b35800/0xf4f48ce5e1bbf91c lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049519.066667:0:6841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c6b35800/0xf4f48ce5e1bbf91c lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049519.066774:0:6841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c6b35a00/0xf4f48ce5e1bbf9e7 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049519.066792:0:6841:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6715200/0xf4f48ce5e1bbf938 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a35f9 expref: 21 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049519.066814:0:6841:0:(ldlm_resource.c:1751:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c6b35a00/0xf4f48ce5e1bbf9e7 lrc: 4/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049519.066882:0:6841:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6715200/0xf4f48ce5e1bbf938 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a35f9 expref: 21 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049519.066909:0:6841:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6715200/0xf4f48ce5e1bbf938 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a35f9 expref: 21 pid: 5850 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789049519.066926:0:6841:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb8df284700 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6841:1875954110636288:192.168.206.26@tcp:104: 00000100:00100000:3.0:1789049519.067019:0:6841:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cb8dbb6b6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789049519.075722:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.26@tcp (source: 12345-192.168.206.26@tcp) 00000100:00100000:0.0:1789049519.075818:0:6720:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954089672064 00000100:00100000:0.0:1789049519.075833:0:6720:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954089672064 00010000:00010000:0.0:1789049519.075931:0:6720:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6715200/0xf4f48ce5e1bbf938 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a35f9 expref: 22 pid: 5850 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789049519.075978:0:6720:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.26@tcp, seq: 71 00000100:00100000:0.0:1789049519.075989:0:6720:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8df260380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e823b53a-3591-475c-8624-c682227e5c13+22:2358:x1875954089672064:12345-192.168.206.26@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789049519.076007:0:6720:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789049519.076015:0:6720:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6715200/0xf4f48ce5e1bbf938 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a35f9 expref: 22 pid: 5850 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049519.076030:0:6720:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6715200/0xf4f48ce5e1bbf938 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a35f9 expref: 22 pid: 5850 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049519.076059:0:6720:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8cb8c687d800) 00010000:00010000:0.0:1789049519.076066:0:6720:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c6b35a00/0xf4f48ce5e1bbf9e7 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049519.076097:0:6720:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c6b35a00/0xf4f48ce5e1bbf9e7 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049519.076107:0:6720:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c6b35a00/0xf4f48ce5e1bbf9e7 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049519.076131:0:6720:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789049519.076212:0:6720:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8df260380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e823b53a-3591-475c-8624-c682227e5c13+22:2358:x1875954089672064:12345-192.168.206.26@tcp:103:ldlm_bl.0 Request processed in 225us (504us total) trans 0 rc 0/0 00000100:00100000:0.0:1789049519.076219:0:6720:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.26@tcp, seq: 71 00010000:00010000:3.0:1789049519.081498:0:6841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6715200/0xf4f48ce5e1bbf938 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a35f9 expref: 21 pid: 5850 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789049519.081535:0:6841:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb8df284700 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6841:1875954110636288:192.168.206.26@tcp:104: 00010000:00010000:3.0:1789049519.081567:0:6841:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c6b35a00/0xf4f48ce5e1bbf9e7 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049519.081579:0:6841:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c6b35a00/0xf4f48ce5e1bbf9e7 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049519.081585:0:6841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c6b35a00/0xf4f48ce5e1bbf9e7 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049519.081602:0:6841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c6b35a00/0xf4f48ce5e1bbf9e7 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049519.081609:0:6841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c6b35a00/0xf4f48ce5e1bbf9e7 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049519.081617:0:6841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c6b35a00/0xf4f48ce5e1bbf9e7 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049519.081624:0:6841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cb8c6b35a00 already unused, calling callback (ffffffffc20ca4f0) 00010000:00010000:3.0:1789049519.081649:0:6841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c6b35a00/0xf4f48ce5e1bbf9e7 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049519.081659:0:6841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c6b35a00/0xf4f48ce5e1bbf9e7 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049519.082353:0:6841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8cb8c687d800) 00010000:00010000:3.0:1789049519.082359:0:6841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789049519.082366:0:6841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c6b35a00/0xf4f48ce5e1bbf9e7 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049519.082375:0:6841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c6b35a00/0xf4f48ce5e1bbf9e7 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049519.082388:0:6841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c2e00/0xf4f48ce5e1bbf9d9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049519.082394:0:6841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c2e00/0xf4f48ce5e1bbf9d9 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049519.082401:0:6841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c2e00/0xf4f48ce5e1bbf9d9 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049519.082407:0:6841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cb8c28c2e00 already unused, calling callback (ffffffffc20ca4f0) 00010000:00010000:3.0:1789049519.082410:0:6841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c2e00/0xf4f48ce5e1bbf9d9 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049519.082416:0:6841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c2e00/0xf4f48ce5e1bbf9d9 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049519.082427:0:6841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8cb8c687d800) 00010000:00010000:3.0:1789049519.082430:0:6841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1789049519.082441:0:6841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c2e00/0xf4f48ce5e1bbf9d9 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049519.082448:0:6841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c2e00/0xf4f48ce5e1bbf9d9 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6841 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789049519.083839:0:6841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb7c7146680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e823b53a-3591-475c-8624-c682227e5c13+20:11493:x1875954089671808:12345-192.168.206.26@tcp:57:lhsmtool_posix.0 Request processed in 39732us (39897us total) trans 4294967472 rc 0/0 00000100:00100000:3.0:1789049519.083875:0:6841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.26@tcp, seq: 185 00000020:00080000:3.0:1789049519.083883:0:6841:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:0.0:1789049519.084016:0:11704:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1789049519.084023:0:11704:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1789049519.086466:0:11704:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:0.0:1789049519.086490:0:11704:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1789049519.090556:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.26@tcp (source: 12345-192.168.206.26@tcp) 00000100:00100000:3.0:1789049519.090652:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954089672320 00000100:00100000:3.0:1789049519.090666:0:5853:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954089672320 00000100:00100000:3.0:1789049519.090748:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.26@tcp, seq: 50 00000100:00100000:3.0:1789049519.090760:0:5853:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8d1d29050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e823b53a-3591-475c-8624-c682227e5c13+20:11493:x1875954089672320:12345-192.168.206.26@tcp:35:lhsmtool_posix.0 00000004:00080000:3.0:1789049519.091649:0:5853:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0xd:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:3.0:1789049519.091770:0:5853:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967473 00010000:00010000:3.0:1789049519.091879:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c6b35800/0xf4f48ce5e1bbf9ee lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049519.091902:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c6b35800/0xf4f48ce5e1bbf9ee lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049519.091919:0:5853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c6b35800/0xf4f48ce5e1bbf9ee lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049519.091928:0:5853:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c6b35800/0xf4f48ce5e1bbf9ee lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049519.091935:0:5853:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c6b35800/0xf4f48ce5e1bbf9ee lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049519.091941:0:5853:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c6b35800/0xf4f48ce5e1bbf9ee lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049519.091979:0:5853:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1789049519.092109:0:5853:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8d1d29050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e823b53a-3591-475c-8624-c682227e5c13+22:11493:x1875954089672320:12345-192.168.206.26@tcp:35:lhsmtool_posix.0 Request processed in 1349us (1565us total) trans 4294967474 rc 0/0 00000100:00100000:3.0:1789049519.092121:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.26@tcp, seq: 50 00000020:00080000:3.0:1789049519.092128:0:5853:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1789049519.092200:0:5839:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789049519.092207:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c6b35800/0xf4f48ce5e1bbf9ee lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049519.092215:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cb8c6b35800 already unused, calling callback (ffffffffc166a8f0) 00010000:00010000:3.0:1789049519.092220:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c6b35800/0xf4f48ce5e1bbf9ee lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049519.092230:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c6b35800/0xf4f48ce5e1bbf9ee lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049519.092245:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff8cb8c687d200) 00010000:00010000:3.0:1789049519.092249:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1789049519.092254:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c6b35800/0xf4f48ce5e1bbf9ee lrc: 1/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049519.092262:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c6b35800/0xf4f48ce5e1bbf9ee lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049519.092282:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789049519.092284:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789049519.092286:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1789049519.662417:0:12475:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1789049519.662425:0:12475:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1789049519.662466:0:12475:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 4 00000040:00080000:0.0:1789049519.662471:0:12475:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:0.0:1789049519.838740:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789049519.909130:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.26@tcp (source: 12345-192.168.206.26@tcp) 00000100:00100000:1.0:1789049519.909281:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954089672576 00000100:00100000:1.0:1789049519.909290:0:5851:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954089672576 00000100:00100000:1.0:1789049519.909349:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.26@tcp, seq: 186 00000100:00100000:1.0:1789049519.909360:0:5851:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8df208a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e823b53a-3591-475c-8624-c682227e5c13+22:11508:x1875954089672576:12345-192.168.206.26@tcp:101:lfs.0 00010000:00010000:1.0:1789049519.909382:0:5851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789049519.909401:0:5851:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c3200/0xf4f48ce5e1bbf9f5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7fc5e358805a3631 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049519.909500:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c3600/0xf4f48ce5e1bbf9fc lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049519.909515:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c3600/0xf4f48ce5e1bbf9fc lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049519.909526:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c3600/0xf4f48ce5e1bbf9fc lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789049519.909536:0:5851:0:(mdt_handler.c:922:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00010000:00010000:1.0:1789049519.909644:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c3200/0xf4f48ce5e1bbf9f5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a3631 expref: 25 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049519.909667:0:5851:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c3600/0xf4f48ce5e1bbf9fc lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a3631 expref: 24 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049519.909676:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8cb8e0130100) 00010000:00010000:1.0:1789049519.909679:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1789049519.909683:0:5851:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cb8c28c3600, rc 0) 00000100:00100000:1.0:1789049519.909733:0:5851:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8df208a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e823b53a-3591-475c-8624-c682227e5c13+24:11508:x1875954089672576:12345-192.168.206.26@tcp:101:lfs.0 Request processed in 375us (610us total) trans 4294967475 rc 0/0 00000100:00100000:1.0:1789049519.909740:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.26@tcp, seq: 186 00000100:00100000:0.0:1789049519.914365:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.26@tcp (source: 12345-192.168.206.26@tcp) 00000100:00100000:1.0:1789049519.914451:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954089672704 00000100:00100000:1.0:1789049519.914461:0:5852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954089672704 00000100:00100000:1.0:1789049519.914520:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.26@tcp, seq: 187 00000100:00100000:1.0:1789049519.914531:0:5852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb7c713aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e823b53a-3591-475c-8624-c682227e5c13+24:11508:x1875954089672704:12345-192.168.206.26@tcp:34:lfs.0 00010000:00010000:1.0:1789049519.914617:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c3c00/0xf4f48ce5e1bbfa0a lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049519.914634:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c3c00/0xf4f48ce5e1bbfa0a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049519.914647:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c3c00/0xf4f48ce5e1bbfa0a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049519.914662:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c2200/0xf4f48ce5e1bbfa11 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049519.914670:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c2200/0xf4f48ce5e1bbfa11 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049519.914697:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c2200/0xf4f48ce5e1bbfa11 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049519.914987:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c2e00/0xf4f48ce5e1bbfa18 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049519.914996:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c2e00/0xf4f48ce5e1bbfa18 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049519.915005:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c2e00/0xf4f48ce5e1bbfa18 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789049519.915049:0:5852:0:(mdt_handler.c:2522:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c2e00/0xf4f48ce5e1bbfa18 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049519.915063:0:5852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c3c00/0xf4f48ce5e1bbfa0a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049519.915069:0:5852:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c3c00/0xf4f48ce5e1bbfa0a lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049519.915076:0:5852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c3c00/0xf4f48ce5e1bbfa0a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049519.915083:0:5852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cb8c28c3c00 already unused, calling callback (ffffffffc20ca4f0) 00010000:00010000:1.0:1789049519.915088:0:5852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c3c00/0xf4f48ce5e1bbfa0a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049519.915095:0:5852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c3c00/0xf4f48ce5e1bbfa0a lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049519.915107:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8cb8e0130100) 00010000:00010000:1.0:1789049519.915116:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789049519.915121:0:5852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c3c00/0xf4f48ce5e1bbfa0a lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049519.915128:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c3c00/0xf4f48ce5e1bbfa0a lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049519.915154:0:5852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c2200/0xf4f48ce5e1bbfa11 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049519.915161:0:5852:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c2200/0xf4f48ce5e1bbfa11 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049519.915167:0:5852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c2200/0xf4f48ce5e1bbfa11 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049519.915171:0:5852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cb8c28c2200 already unused, calling callback (ffffffffc20ca4f0) 00010000:00010000:1.0:1789049519.915174:0:5852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c2200/0xf4f48ce5e1bbfa11 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049519.915180:0:5852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c2200/0xf4f48ce5e1bbfa11 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049519.915189:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8cb8c396d300) 00010000:00010000:1.0:1789049519.915192:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789049519.915195:0:5852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c2200/0xf4f48ce5e1bbfa11 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049519.915201:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c2200/0xf4f48ce5e1bbfa11 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049519.915216:0:5852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c2e00/0xf4f48ce5e1bbfa18 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049519.915228:0:5852:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c2e00/0xf4f48ce5e1bbfa18 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049519.915235:0:5852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c2e00/0xf4f48ce5e1bbfa18 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049519.915240:0:5852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cb8c28c2e00 already unused, calling callback (ffffffffc20ca4f0) 00010000:00010000:1.0:1789049519.915244:0:5852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c2e00/0xf4f48ce5e1bbfa18 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049519.915250:0:5852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c2e00/0xf4f48ce5e1bbfa18 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049519.915258:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8cb8c396de00) 00010000:00010000:1.0:1789049519.915260:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789049519.915263:0:5852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c2e00/0xf4f48ce5e1bbfa18 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049519.915269:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c2e00/0xf4f48ce5e1bbfa18 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789049519.915342:0:5852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb7c713aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e823b53a-3591-475c-8624-c682227e5c13+24:11508:x1875954089672704:12345-192.168.206.26@tcp:34:lfs.0 Request processed in 812us (985us total) trans 0 rc 0/0 00000100:00100000:1.0:1789049519.915350:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.26@tcp, seq: 187 00000100:00100000:0.0:1789049520.020210:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.26@tcp (source: 12345-192.168.206.26@tcp) 00000100:00100000:1.0:1789049520.020354:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954089672960 00000100:00100000:1.0:1789049520.020364:0:5851:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954089672960 00000100:00100000:1.0:1789049520.020411:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.26@tcp, seq: 188 00000100:00100000:1.0:1789049520.020421:0:5851:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb7c713b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e823b53a-3591-475c-8624-c682227e5c13+24:11512:x1875954089672960:12345-192.168.206.26@tcp:101:lfs.0 00010000:00010000:1.0:1789049520.020442:0:5851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789049520.020471:0:5851:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c2e00/0xf4f48ce5e1bbfa1f lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7fc5e358805a3638 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049520.020542:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c2200/0xf4f48ce5e1bbfa26 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049520.020557:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c2200/0xf4f48ce5e1bbfa26 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049520.020570:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c2200/0xf4f48ce5e1bbfa26 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049520.020584:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c3c00/0xf4f48ce5e1bbfa2d lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049520.020591:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c3c00/0xf4f48ce5e1bbfa2d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049520.020599:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c3c00/0xf4f48ce5e1bbfa2d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049520.020873:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c3200/0xf4f48ce5e1bbfa34 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049520.020881:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c3200/0xf4f48ce5e1bbfa34 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049520.020889:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c3200/0xf4f48ce5e1bbfa34 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789049520.020902:0:5851:0:(mdt_handler.c:922:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 9 00010000:00010000:1.0:1789049520.020986:0:5851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c2200/0xf4f48ce5e1bbfa26 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049520.021002:0:5851:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c2200/0xf4f48ce5e1bbfa26 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049520.021009:0:5851:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c2200/0xf4f48ce5e1bbfa26 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049520.021015:0:5851:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cb8c28c2200 already unused, calling callback (ffffffffc20ca4f0) 00010000:00010000:1.0:1789049520.021020:0:5851:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c2200/0xf4f48ce5e1bbfa26 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049520.021028:0:5851:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c2200/0xf4f48ce5e1bbfa26 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049520.021040:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8cb8e0130100) 00010000:00010000:1.0:1789049520.021042:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789049520.021048:0:5851:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c2200/0xf4f48ce5e1bbfa26 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049520.021054:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c2200/0xf4f48ce5e1bbfa26 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049520.021066:0:5851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c3c00/0xf4f48ce5e1bbfa2d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049520.021072:0:5851:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c3c00/0xf4f48ce5e1bbfa2d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049520.021077:0:5851:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c3c00/0xf4f48ce5e1bbfa2d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049520.021081:0:5851:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cb8c28c3c00 already unused, calling callback (ffffffffc20ca4f0) 00010000:00010000:1.0:1789049520.021090:0:5851:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c3c00/0xf4f48ce5e1bbfa2d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049520.021096:0:5851:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c3c00/0xf4f48ce5e1bbfa2d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049520.021104:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8cb8c396de00) 00010000:00010000:1.0:1789049520.021106:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789049520.021109:0:5851:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c3c00/0xf4f48ce5e1bbfa2d lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049520.021115:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c3c00/0xf4f48ce5e1bbfa2d lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049520.021273:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c2e00/0xf4f48ce5e1bbfa1f lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a3638 expref: 27 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049520.021288:0:5851:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c3200/0xf4f48ce5e1bbfa34 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a3638 expref: 26 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049520.021295:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8cb8c396d300) 00010000:00010000:1.0:1789049520.021297:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789049520.021299:0:5851:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cb8c28c3200, rc 0) 00000100:00100000:1.0:1789049520.021453:0:5851:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb7c713b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e823b53a-3591-475c-8624-c682227e5c13+26:11512:x1875954089672960:12345-192.168.206.26@tcp:101:lfs.0 Request processed in 1032us (1250us total) trans 4294967476 rc 0/0 00000100:00100000:1.0:1789049520.021461:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.26@tcp, seq: 188 00000100:00100000:3.0:1789049520.025589:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.26@tcp (source: 12345-192.168.206.26@tcp) 00000100:00100000:1.0:1789049520.025650:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954089673088 00000100:00100000:1.0:1789049520.025660:0:5852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954089673088 00000100:00100000:1.0:1789049520.025719:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.26@tcp, seq: 189 00000100:00100000:1.0:1789049520.025728:0:5852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8df284700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e823b53a-3591-475c-8624-c682227e5c13+26:11512:x1875954089673088:12345-192.168.206.26@tcp:54:lfs.0 00010000:00010000:1.0:1789049520.025807:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c3400/0xf4f48ce5e1bbfa42 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049520.025823:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c3400/0xf4f48ce5e1bbfa42 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049520.025835:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c3400/0xf4f48ce5e1bbfa42 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049520.025887:0:5852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c3400/0xf4f48ce5e1bbfa42 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049520.025895:0:5852:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c3400/0xf4f48ce5e1bbfa42 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049520.025901:0:5852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c3400/0xf4f48ce5e1bbfa42 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049520.025907:0:5852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cb8c28c3400 already unused, calling callback (ffffffffc20ca4f0) 00010000:00010000:1.0:1789049520.025911:0:5852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c3400/0xf4f48ce5e1bbfa42 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049520.025920:0:5852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c3400/0xf4f48ce5e1bbfa42 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049520.025932:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8cb8c396d300) 00010000:00010000:1.0:1789049520.025935:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1789049520.025940:0:5852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c3400/0xf4f48ce5e1bbfa42 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049520.025947:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c3400/0xf4f48ce5e1bbfa42 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789049520.026830:0:5852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8df284700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e823b53a-3591-475c-8624-c682227e5c13+26:11512:x1875954089673088:12345-192.168.206.26@tcp:54:lfs.0 Request processed in 1096us (1243us total) trans 0 rc 0/0 00000100:00100000:1.0:1789049520.026861:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.26@tcp, seq: 189 00000100:00100000:3.0:1789049520.029377:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.26@tcp (source: 12345-192.168.206.26@tcp) 00000100:00100000:0.0:1789049520.029453:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954089673344 00000100:00100000:0.0:1789049520.029462:0:5853:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954089673344 00000100:00100000:0.0:1789049520.029513:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.26@tcp, seq: 51 00000100:00100000:0.0:1789049520.029521:0:5853:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8df284380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e823b53a-3591-475c-8624-c682227e5c13+26:11512:x1875954089673344:12345-192.168.206.26@tcp:35:lfs.0 00000100:00100000:0.0:1789049520.029721:0:5853:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8df284380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e823b53a-3591-475c-8624-c682227e5c13+27:11512:x1875954089673344:12345-192.168.206.26@tcp:35:lfs.0 Request processed in 199us (351us total) trans 4294967477 rc 0/0 00000100:00100000:0.0:1789049520.029742:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.26@tcp, seq: 51 00000100:00100000:0.0:1789049520.069218:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.26@tcp (source: 12345-192.168.206.26@tcp) 00000100:00100000:3.0:1789049520.069371:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954089673600 00000100:00100000:3.0:1789049520.069395:0:5850:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954089673600 00000100:00100000:3.0:1789049520.069455:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.26@tcp, seq: 190 00000100:00100000:3.0:1789049520.069466:0:5850:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb7c7139c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e823b53a-3591-475c-8624-c682227e5c13+27:11046:x1875954089673600:12345-192.168.206.26@tcp:101:bash.0 00010000:00010000:3.0:1789049520.069490:0:5850:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789049520.069509:0:5850:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c6b35800/0xf4f48ce5e1bbfa49 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7fc5e358805a363f expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049520.069602:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c6b35a00/0xf4f48ce5e1bbfa50 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049520.069618:0:5850:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c3200/0xf4f48ce5e1bbfa34 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a3638 expref: 28 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049520.069627:0:5850:0:(ldlm_resource.c:1751:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c6b35a00/0xf4f48ce5e1bbfa50 lrc: 4/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049520.069660:0:5850:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c3200/0xf4f48ce5e1bbfa34 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a3638 expref: 28 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049520.069674:0:5850:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c3200/0xf4f48ce5e1bbfa34 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a3638 expref: 28 pid: 5851 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789049520.069687:0:5850:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb8df285c00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5850:1875954110636416:192.168.206.26@tcp:104: 00000100:00100000:3.0:1789049520.069779:0:5850:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cb8c7c97000 going to sleep for 11 seconds 00000100:00100000:3.0:1789049520.073345:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.26@tcp (source: 12345-192.168.206.26@tcp) 00000100:00100000:2.0:1789049520.073518:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954089673728 00000100:00100000:2.0:1789049520.073527:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954089673728 00010000:00010000:2.0:1789049520.073566:0:5836:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c3200/0xf4f48ce5e1bbfa34 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a3638 expref: 29 pid: 5851 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789049520.073610:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.26@tcp, seq: 72 00000100:00100000:2.0:1789049520.073619:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8df284a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e823b53a-3591-475c-8624-c682227e5c13+29:2358:x1875954089673728:12345-192.168.206.26@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789049520.073633:0:5836:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789049520.073640:0:5836:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c3200/0xf4f48ce5e1bbfa34 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a3638 expref: 29 pid: 5851 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049520.073652:0:5836:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c3200/0xf4f48ce5e1bbfa34 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a3638 expref: 29 pid: 5851 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049520.073671:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8cb8c396d300) 00010000:00010000:2.0:1789049520.073677:0:5836:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c6b35a00/0xf4f48ce5e1bbfa50 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049520.073687:0:5836:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c6b35a00/0xf4f48ce5e1bbfa50 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049520.073695:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c6b35a00/0xf4f48ce5e1bbfa50 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049520.073712:0:5836:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789049520.073761:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8df284a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e823b53a-3591-475c-8624-c682227e5c13+29:2358:x1875954089673728:12345-192.168.206.26@tcp:103:ldlm_bl.0 Request processed in 144us (425us total) trans 0 rc 0/0 00000100:00100000:2.0:1789049520.073785:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.26@tcp, seq: 72 00010000:00010000:0.0:1789049520.073925:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c3200/0xf4f48ce5e1bbfa34 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a3638 expref: 28 pid: 5851 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789049520.073941:0:5850:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb8df285c00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5850:1875954110636416:192.168.206.26@tcp:104: 00010000:00010000:0.0:1789049520.073960:0:5850:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c6b35a00/0xf4f48ce5e1bbfa50 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049520.073969:0:5850:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c6b35a00/0xf4f48ce5e1bbfa50 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049520.073975:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c6b35a00/0xf4f48ce5e1bbfa50 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789049520.073992:0:5850:0:(mdt_handler.c:922:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 9 00010000:00010000:0.0:1789049520.074121:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c6b35800/0xf4f48ce5e1bbfa49 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a363f expref: 29 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049520.074135:0:5850:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c6b35a00/0xf4f48ce5e1bbfa50 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a363f expref: 28 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049520.074155:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8cb8c396d300) 00010000:00010000:0.0:1789049520.074157:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1789049520.074160:0:5850:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cb8c6b35a00, rc 0) 00000100:00100000:0.0:1789049520.074185:0:5850:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb7c7139c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e823b53a-3591-475c-8624-c682227e5c13+28:11046:x1875954089673600:12345-192.168.206.26@tcp:101:bash.0 Request processed in 4722us (4978us total) trans 4294967478 rc 0/0 00000100:00100000:0.0:1789049520.074193:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.26@tcp, seq: 190 00000100:00100000:0.0:1789049520.077455:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.26@tcp (source: 12345-192.168.206.26@tcp) 00000100:00100000:2.0:1789049520.077543:0:6841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954089673984 00000100:00100000:2.0:1789049520.077553:0:6841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954089673984 00000100:00100000:2.0:1789049520.077611:0:6841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.26@tcp, seq: 191 00000100:00100000:2.0:1789049520.077621:0:6841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb7c7138a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e823b53a-3591-475c-8624-c682227e5c13+28:11046:x1875954089673984:12345-192.168.206.26@tcp:36:bash.0 00010000:00010000:2.0:1789049520.077907:0:6841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6715a00/0xf4f48ce5e1bbfa5e lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049520.077923:0:6841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6715a00/0xf4f48ce5e1bbfa5e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049520.077935:0:6841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6715a00/0xf4f48ce5e1bbfa5e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6841 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789049520.077985:0:6841:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967479 00000004:00010000:2.0:1789049520.078012:0:6841:0:(mdt_handler.c:4507:mdt_save_lock()) ### save lock request 0000000017e1dbd2 reply state 00000000b086ff48 transno 4294967480 ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6715a00/0xf4f48ce5e1bbfa5e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6841 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789049520.078021:0:6841:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000001:00080000:2.0:1789049520.078069:0:6841:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967480 00000100:00100000:2.0:1789049520.078400:0:6841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb7c7138a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e823b53a-3591-475c-8624-c682227e5c13+32:11046:x1875954089673984:12345-192.168.206.26@tcp:36:bash.0 Request processed in 779us (952us total) trans 4294967481 rc 0/0 00000100:00100000:2.0:1789049520.078408:0:6841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.26@tcp, seq: 191 00000020:00080000:2.0:1789049520.078414:0:6841:0:(tgt_main.c:784:tgt_ses_key_exit()) total 3 transactions per RPC 00000100:00100000:3.0:1789049520.081579:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.26@tcp (source: 12345-192.168.206.26@tcp) 00000100:00100000:2.0:1789049520.081669:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954089674112 00000100:00100000:2.0:1789049520.081679:0:5851:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954089674112 00000100:00100000:2.0:1789049520.081732:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.26@tcp, seq: 192 00000100:00100000:2.0:1789049520.081741:0:5851:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8df285f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e823b53a-3591-475c-8624-c682227e5c13+32:11046:x1875954089674112:12345-192.168.206.26@tcp:101:bash.0 00010000:00010000:2.0:1789049520.081764:0:5851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789049520.081815:0:5851:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6715c00/0xf4f48ce5e1bbfa65 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7fc5e358805a3646 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049520.081910:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6715c00/0xf4f48ce5e1bbfa65 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a3646 expref: 33 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049520.081926:0:5851:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6715c00/0xf4f48ce5e1bbfa65 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a3646 expref: 33 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049520.081946:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8cb8c396d300) 00010000:00010000:2.0:1789049520.081949:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1789049520.081953:0:5851:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cb8d6715c00, rc 0) 00000100:00100000:2.0:1789049520.082003:0:5851:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8df285f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e823b53a-3591-475c-8624-c682227e5c13+33:11046:x1875954089674112:12345-192.168.206.26@tcp:101:bash.0 Request processed in 263us (432us total) trans 0 rc 0/0 00000100:00100000:2.0:1789049520.082010:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.26@tcp, seq: 192 00010000:00010000:1.0:1789049520.082823:0:3294:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6715a00/0xf4f48ce5e1bbfa5e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049520.082834:0:3294:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6715a00/0xf4f48ce5e1bbfa5e lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049520.082876:0:3294:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6715a00/0xf4f48ce5e1bbfa5e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049520.082883:0:3294:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cb8d6715a00 already unused, calling callback (ffffffffc20ca4f0) 00010000:00010000:1.0:1789049520.082888:0:3294:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6715a00/0xf4f48ce5e1bbfa5e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049520.082896:0:3294:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6715a00/0xf4f48ce5e1bbfa5e lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049520.082910:0:3294:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8cb8c396d300) 00010000:00010000:1.0:1789049520.082913:0:3294:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789049520.082916:0:3294:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6715a00/0xf4f48ce5e1bbfa5e lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049520.082923:0:3294:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6715a00/0xf4f48ce5e1bbfa5e lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6841 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789049520.085317:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.26@tcp (source: 12345-192.168.206.26@tcp) 00000100:00100000:1.0:1789049520.085608:0:6705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954089674240 00000100:00100000:1.0:1789049520.085618:0:6705:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954089674240 00000100:00100000:1.0:1789049520.085686:0:6705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.26@tcp, seq: 58 00000100:00100000:1.0:1789049520.085710:0:6705:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8df287800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e823b53a-3591-475c-8624-c682227e5c13+7:11046:x1875954089674240:12345-192.168.206.26@tcp:101:bash.0 00010000:00010000:1.0:1789049520.085727:0:6705:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789049520.085745:0:6705:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006146009f/0xf4f48ce5e1bbfa6c lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x7fc5e358805a364d expref: -99 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1789049520.085770:0:6705:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 9, mtime: 0x18d3fb0e9dfdf8c0, atime: 0x18d3fb0e3b496ac0, ctime: 0x18d3fb0e9dfdf8c0, blocks: 0xb 00010000:00010000:1.0:1789049520.085801:0:6705:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=346s v=(0 0) 00010000:00010000:1.0:1789049520.085806:0:6705:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789049520.085814:0:6705:0:(ldlm_resource.c:1751:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006146009f/0xf4f48ce5e1bbfa6c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a364d expref: 8 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049520.085831:0:6705:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000006146009f/0xf4f48ce5e1bbfa6c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a364d expref: 8 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049520.085863:0:6705:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cb8c28c3400, rc 0) 00000100:00100000:1.0:1789049520.085915:0:6705:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8df287800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e823b53a-3591-475c-8624-c682227e5c13+8:11046:x1875954089674240:12345-192.168.206.26@tcp:101:bash.0 Request processed in 207us (607us total) trans 0 rc 0/0 00000100:00100000:1.0:1789049520.085921:0:6705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.26@tcp, seq: 58 00000100:00080000:3.0:1789049520.086602:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789049520.088593:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.26@tcp (source: 12345-192.168.206.26@tcp) 00000100:00100000:0.0:1789049520.088707:0:6709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954089674368 00000100:00100000:0.0:1789049520.088717:0:6709:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954089674368 00002000:00010000:0.0:1789049520.088756:0:6709:0:(ofd_dev.c:2841:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/5 (0->18446744073709551615) 00002000:00100000:0.0:1789049520.088761:0:6709:0:(ofd_dev.c:2581:ofd_prolong_extent_locks()) Prolong locks for req ffff8cb8df284e00 with x1875954089674368 ext(0->18446744073709551615) 00002000:00010000:0.0:1789049520.088773:0:6709:0:(ofd_dev.c:2846:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8cb8df284e00. 00000100:00100000:0.0:1789049520.088813:0:6709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.26@tcp, seq: 5 00000100:00100000:0.0:1789049520.088823:0:6709:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8df284e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:e823b53a-3591-475c-8624-c682227e5c13+8:2357:x1875954089674368:12345-192.168.206.26@tcp:10:bash.0 00002000:00010000:0.0:1789049520.089421:0:6709:0:(ofd_lvb.c:321:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 9 -> 0 00002000:00010000:0.0:1789049520.089425:0:6709:0:(ofd_lvb.c:328:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb mtime from disk: 1789049517195000000 -> 1789049519393000000 00002000:00010000:0.0:1789049520.089428:0:6709:0:(ofd_lvb.c:334:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb atime from disk: 1789049515539000000 -> 1789049515539000000 00002000:00010000:0.0:1789049520.089430:0:6709:0:(ofd_lvb.c:340:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb ctime from disk: 1789049517195000000 -> 1789049519393000000 00002000:00010000:0.0:1789049520.089432:0:6709:0:(ofd_lvb.c:346:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 11 -> 11 00000100:00100000:0.0:1789049520.089498:0:6709:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8df284e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:e823b53a-3591-475c-8624-c682227e5c13+9:2357:x1875954089674368:12345-192.168.206.26@tcp:10:bash.0 Request processed in 675us (911us total) trans 4294967318 rc 0/0 00000100:00100000:0.0:1789049520.089506:0:6709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.26@tcp, seq: 5 00002000:00010000:0.0:1789049520.089509:0:6709:0:(ofd_dev.c:2841:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/5 (0->18446744073709551615) 00002000:00100000:0.0:1789049520.089512:0:6709:0:(ofd_dev.c:2581:ofd_prolong_extent_locks()) Prolong locks for req ffff8cb8df284e00 with x1875954089674368 ext(0->18446744073709551615) 00002000:00010000:0.0:1789049520.089516:0:6709:0:(ofd_dev.c:2846:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8cb8df284e00. 00000040:00080000:0.0:1789049520.091092:0:11704:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1789049520.091212:0:11704:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1789049520.091540:0:11704:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 2 00000040:00080000:0.0:1789049520.091547:0:11704:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1789049520.188160:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.26@tcp (source: 12345-192.168.206.26@tcp) 00000100:00100000:3.0:1789049520.188292:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954089674496 00000100:00100000:3.0:1789049520.188301:0:5852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954089674496 00000100:00100000:3.0:1789049520.188355:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.26@tcp, seq: 193 00000100:00100000:3.0:1789049520.188365:0:5852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb7c7144380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e823b53a-3591-475c-8624-c682227e5c13+32:11526:x1875954089674496:12345-192.168.206.26@tcp:34:lfs.0 00010000:00010000:3.0:1789049520.188427:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c6b35400/0xf4f48ce5e1bbfa73 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049520.188446:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c6b35400/0xf4f48ce5e1bbfa73 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049520.188458:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c6b35400/0xf4f48ce5e1bbfa73 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049520.188474:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c6b35800/0xf4f48ce5e1bbfa7a lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049520.188482:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c6b35800/0xf4f48ce5e1bbfa7a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049520.188489:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c6b35800/0xf4f48ce5e1bbfa7a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049520.188704:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c6b35e00/0xf4f48ce5e1bbfa81 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049520.188713:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c6b35e00/0xf4f48ce5e1bbfa81 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049520.188719:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c6b35e00/0xf4f48ce5e1bbfa81 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789049520.188759:0:5852:0:(mdt_handler.c:2522:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c6b35e00/0xf4f48ce5e1bbfa81 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049520.188778:0:5852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c6b35400/0xf4f48ce5e1bbfa73 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049520.188783:0:5852:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c6b35400/0xf4f48ce5e1bbfa73 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049520.188801:0:5852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c6b35400/0xf4f48ce5e1bbfa73 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049520.188807:0:5852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cb8c6b35400 already unused, calling callback (ffffffffc20ca4f0) 00010000:00010000:3.0:1789049520.188811:0:5852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c6b35400/0xf4f48ce5e1bbfa73 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049520.188817:0:5852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c6b35400/0xf4f48ce5e1bbfa73 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049520.188828:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8cb8e0130100) 00010000:00010000:3.0:1789049520.188831:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789049520.188835:0:5852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c6b35400/0xf4f48ce5e1bbfa73 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049520.188870:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c6b35400/0xf4f48ce5e1bbfa73 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049520.188881:0:5852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c6b35800/0xf4f48ce5e1bbfa7a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049520.188887:0:5852:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c6b35800/0xf4f48ce5e1bbfa7a lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049520.188892:0:5852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c6b35800/0xf4f48ce5e1bbfa7a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049520.188903:0:5852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cb8c6b35800 already unused, calling callback (ffffffffc20ca4f0) 00010000:00010000:3.0:1789049520.188905:0:5852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c6b35800/0xf4f48ce5e1bbfa7a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049520.188911:0:5852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c6b35800/0xf4f48ce5e1bbfa7a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049520.188918:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8cb8c687d200) 00010000:00010000:3.0:1789049520.188920:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789049520.188923:0:5852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c6b35800/0xf4f48ce5e1bbfa7a lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049520.188928:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c6b35800/0xf4f48ce5e1bbfa7a lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049520.188942:0:5852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c6b35e00/0xf4f48ce5e1bbfa81 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049520.188948:0:5852:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c6b35e00/0xf4f48ce5e1bbfa81 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049520.188953:0:5852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c6b35e00/0xf4f48ce5e1bbfa81 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049520.188958:0:5852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cb8c6b35e00 already unused, calling callback (ffffffffc20ca4f0) 00010000:00010000:3.0:1789049520.188960:0:5852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c6b35e00/0xf4f48ce5e1bbfa81 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049520.188965:0:5852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c6b35e00/0xf4f48ce5e1bbfa81 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049520.188981:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8cb8c396d300) 00010000:00010000:3.0:1789049520.188983:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789049520.188986:0:5852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c6b35e00/0xf4f48ce5e1bbfa81 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049520.188991:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c6b35e00/0xf4f48ce5e1bbfa81 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789049520.189066:0:5852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb7c7144380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e823b53a-3591-475c-8624-c682227e5c13+32:11526:x1875954089674496:12345-192.168.206.26@tcp:34:lfs.0 Request processed in 702us (923us total) trans 0 rc 0/0 00000100:00100000:3.0:1789049520.189073:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.26@tcp, seq: 193 00000100:00100000:3.0:1789049520.233665:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.26@tcp (source: 12345-192.168.206.26@tcp) 00000100:00100000:2.0:1789049520.233764:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954089674752 00000100:00100000:2.0:1789049520.233775:0:5851:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954089674752 00000100:00100000:2.0:1789049520.233866:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.26@tcp, seq: 194 00000100:00100000:2.0:1789049520.233876:0:5851:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8df285c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e823b53a-3591-475c-8624-c682227e5c13+32:11529:x1875954089674752:12345-192.168.206.26@tcp:101:lfs.0 00010000:00010000:2.0:1789049520.233896:0:5851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789049520.233915:0:5851:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6714c00/0xf4f48ce5e1bbfa88 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7fc5e358805a3654 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049520.233978:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6715a00/0xf4f48ce5e1bbfa8f lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049520.233993:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6715a00/0xf4f48ce5e1bbfa8f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049520.234021:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6715a00/0xf4f48ce5e1bbfa8f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049520.234035:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6715200/0xf4f48ce5e1bbfa96 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049520.234043:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6715200/0xf4f48ce5e1bbfa96 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049520.234049:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6715200/0xf4f48ce5e1bbfa96 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049520.234458:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6714a00/0xf4f48ce5e1bbfa9d lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049520.234468:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6714a00/0xf4f48ce5e1bbfa9d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049520.234476:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6714a00/0xf4f48ce5e1bbfa9d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789049520.234487:0:5851:0:(mdt_handler.c:922:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:2.0:1789049520.234575:0:5851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6715a00/0xf4f48ce5e1bbfa8f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049520.234583:0:5851:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6715a00/0xf4f48ce5e1bbfa8f lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049520.234590:0:5851:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6715a00/0xf4f48ce5e1bbfa8f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049520.234596:0:5851:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cb8d6715a00 already unused, calling callback (ffffffffc20ca4f0) 00010000:00010000:2.0:1789049520.234607:0:5851:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6715a00/0xf4f48ce5e1bbfa8f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049520.234616:0:5851:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6715a00/0xf4f48ce5e1bbfa8f lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049520.234627:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8cb8e0130100) 00010000:00010000:2.0:1789049520.234630:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789049520.234635:0:5851:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6715a00/0xf4f48ce5e1bbfa8f lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049520.234642:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6715a00/0xf4f48ce5e1bbfa8f lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049520.234654:0:5851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6715200/0xf4f48ce5e1bbfa96 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049520.234660:0:5851:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6715200/0xf4f48ce5e1bbfa96 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049520.234666:0:5851:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6715200/0xf4f48ce5e1bbfa96 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049520.234671:0:5851:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cb8d6715200 already unused, calling callback (ffffffffc20ca4f0) 00010000:00010000:2.0:1789049520.234674:0:5851:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6715200/0xf4f48ce5e1bbfa96 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049520.234679:0:5851:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6715200/0xf4f48ce5e1bbfa96 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049520.234686:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8cb8e0130300) 00010000:00010000:2.0:1789049520.234688:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789049520.234697:0:5851:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6715200/0xf4f48ce5e1bbfa96 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049520.234704:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6715200/0xf4f48ce5e1bbfa96 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049520.234741:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6714c00/0xf4f48ce5e1bbfa88 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a3654 expref: 35 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049520.234755:0:5851:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6714a00/0xf4f48ce5e1bbfa9d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a3654 expref: 34 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049520.234762:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8cb8c396d300) 00010000:00010000:2.0:1789049520.234765:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1789049520.234768:0:5851:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cb8d6714a00, rc 0) 00000100:00100000:2.0:1789049520.234935:0:5851:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8df285c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e823b53a-3591-475c-8624-c682227e5c13+34:11529:x1875954089674752:12345-192.168.206.26@tcp:101:lfs.0 Request processed in 1060us (1278us total) trans 4294967482 rc 0/0 00000100:00100000:2.0:1789049520.234944:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.26@tcp, seq: 194 00000100:00100000:0.0:1789049520.245474:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.26@tcp (source: 12345-192.168.206.26@tcp) 00000100:00100000:3.0:1789049520.245604:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954089674880 00000100:00100000:3.0:1789049520.245614:0:5852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954089674880 00000100:00100000:3.0:1789049520.245667:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.26@tcp, seq: 195 00000100:00100000:3.0:1789049520.245677:0:5852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb7c7138e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e823b53a-3591-475c-8624-c682227e5c13+34:11529:x1875954089674880:12345-192.168.206.26@tcp:54:lfs.0 00010000:00010000:3.0:1789049520.245744:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c6b35e00/0xf4f48ce5e1bbfaab lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049520.245761:0:5852:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c6b35a00/0xf4f48ce5e1bbfa50 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a363f expref: 34 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049520.245770:0:5852:0:(ldlm_resource.c:1751:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c6b35e00/0xf4f48ce5e1bbfaab lrc: 4/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049520.245813:0:5852:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c6b35a00/0xf4f48ce5e1bbfa50 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a363f expref: 34 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049520.245867:0:5852:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c6b35a00/0xf4f48ce5e1bbfa50 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a363f expref: 34 pid: 5850 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789049520.245881:0:5852:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb9009c2680 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5852:1875954110636544:192.168.206.26@tcp:104: 00000100:00100000:3.0:1789049520.246204:0:5852:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cb8c7c979c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789049520.249186:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.26@tcp (source: 12345-192.168.206.26@tcp) 00000100:00100000:0.0:1789049520.249269:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954089675136 00000100:00100000:0.0:1789049520.249279:0:5853:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954089675136 00000100:00100000:0.0:1789049520.249346:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.26@tcp, seq: 52 00000100:00100000:0.0:1789049520.249356:0:5853:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb7c7146300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e823b53a-3591-475c-8624-c682227e5c13+35:9233:x1875954089675136:12345-192.168.206.26@tcp:35:ldlm_bl.0 00000001:00080000:0.0:1789049520.249608:0:5853:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967483 00000100:00100000:0.0:1789049520.249724:0:5853:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb7c7146300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e823b53a-3591-475c-8624-c682227e5c13+37:9233:x1875954089675136:12345-192.168.206.26@tcp:35:ldlm_bl.0 Request processed in 369us (546us total) trans 4294967484 rc 0/0 00000100:00100000:0.0:1789049520.249732:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.26@tcp, seq: 52 00000020:00080000:0.0:1789049520.249737:0:5853:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1789049520.252470:0:5852:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb9009c2680 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5852:1875954110636544:192.168.206.26@tcp:104: 00010000:00010000:3.0:1789049520.252499:0:5852:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c6b35e00/0xf4f48ce5e1bbfaab lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789049520.252595:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.26@tcp (source: 12345-192.168.206.26@tcp) 00000100:00100000:3.0:1789049520.252692:0:6720:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954089675264 00000100:00100000:3.0:1789049520.252698:0:6720:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954089675264 00010000:00010000:3.0:1789049520.252733:0:6720:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c6b35a00/0xf4f48ce5e1bbfa50 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a363f expref: 37 pid: 5850 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789049520.252829:0:6720:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.26@tcp, seq: 73 00000100:00100000:3.0:1789049520.252839:0:6720:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb7c7138700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e823b53a-3591-475c-8624-c682227e5c13+37:2357:x1875954089675264:12345-192.168.206.26@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789049520.252876:0:6720:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789049520.252883:0:6720:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c6b35a00/0xf4f48ce5e1bbfa50 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a363f expref: 37 pid: 5850 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049520.252895:0:6720:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c6b35a00/0xf4f48ce5e1bbfa50 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a363f expref: 37 pid: 5850 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049520.252917:0:6720:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c6b35a00/0xf4f48ce5e1bbfa50 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a363f expref: 37 pid: 5850 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049520.252950:0:6720:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8cb8c396d300) 00010000:00010000:3.0:1789049520.252955:0:6720:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c6b35e00/0xf4f48ce5e1bbfaab lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049520.252965:0:6720:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c6b35e00/0xf4f48ce5e1bbfaab lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049520.252973:0:6720:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c6b35e00/0xf4f48ce5e1bbfaab lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049520.253005:0:6720:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789049520.253182:0:6720:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb7c7138700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e823b53a-3591-475c-8624-c682227e5c13+36:2357:x1875954089675264:12345-192.168.206.26@tcp:103:ldlm_bl.0 Request processed in 343us (586us total) trans 0 rc 0/0 00000100:00100000:3.0:1789049520.253189:0:6720:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.26@tcp, seq: 73 00010000:00010000:0.0:1789049520.253472:0:5852:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c6b35e00/0xf4f48ce5e1bbfaab lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049520.253480:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c6b35e00/0xf4f48ce5e1bbfaab lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049520.253508:0:5852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c6b35e00/0xf4f48ce5e1bbfaab lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049520.253514:0:5852:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c6b35e00/0xf4f48ce5e1bbfaab lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049520.253522:0:5852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c6b35e00/0xf4f48ce5e1bbfaab lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049520.253528:0:5852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cb8c6b35e00 already unused, calling callback (ffffffffc20ca4f0) 00010000:00010000:0.0:1789049520.253532:0:5852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c6b35e00/0xf4f48ce5e1bbfaab lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049520.253539:0:5852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c6b35e00/0xf4f48ce5e1bbfaab lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049520.253549:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8cb8c396d300) 00010000:00010000:0.0:1789049520.253560:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1789049520.253564:0:5852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c6b35e00/0xf4f48ce5e1bbfaab lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049520.253570:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c6b35e00/0xf4f48ce5e1bbfaab lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789049520.253610:0:5852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb7c7138e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e823b53a-3591-475c-8624-c682227e5c13+35:11529:x1875954089674880:12345-192.168.206.26@tcp:54:lfs.0 Request processed in 7935us (8145us total) trans 0 rc 0/0 00000100:00100000:0.0:1789049520.253617:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.26@tcp, seq: 195 00000100:00100000:2.0:1789049520.256660:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.26@tcp (source: 12345-192.168.206.26@tcp) 00000100:00100000:0.0:1789049520.256750:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954089675520 00000100:00100000:0.0:1789049520.256759:0:5853:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954089675520 00000100:00100000:0.0:1789049520.256879:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.26@tcp, seq: 53 00000100:00100000:0.0:1789049520.256889:0:5853:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb900e95f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e823b53a-3591-475c-8624-c682227e5c13+35:11529:x1875954089675520:12345-192.168.206.26@tcp:35:lfs.0 00000100:00100000:0.0:1789049520.257121:0:5853:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb900e95f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e823b53a-3591-475c-8624-c682227e5c13+36:11529:x1875954089675520:12345-192.168.206.26@tcp:35:lfs.0 Request processed in 233us (470us total) trans 4294967485 rc 0/0 00000100:00100000:0.0:1789049520.257129:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.26@tcp, seq: 53 00000100:00100000:1.0:1789049520.383712:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.26@tcp (source: 12345-192.168.206.26@tcp) 00000100:00100000:0.0:1789049520.383916:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954089675776 00000100:00100000:0.0:1789049520.383926:0:5850:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954089675776 00000100:00100000:0.0:1789049520.383995:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.26@tcp, seq: 196 00000100:00100000:0.0:1789049520.384005:0:5850:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb7c7146a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e823b53a-3591-475c-8624-c682227e5c13+36:11540:x1875954089675776:12345-192.168.206.26@tcp:101:cat.0 00010000:00010000:0.0:1789049520.384028:0:5850:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789049520.384059:0:5850:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb7c4c38800/0xf4f48ce5e1bbfab2 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7fc5e358805a365b expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049520.384419:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb7c4c39400/0xf4f48ce5e1bbfab9 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049520.384434:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cb7c4c39400/0xf4f48ce5e1bbfab9 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049520.384457:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb7c4c39400/0xf4f48ce5e1bbfab9 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049520.384471:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb7c4c38000/0xf4f48ce5e1bbfac0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049520.384478:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cb7c4c38000/0xf4f48ce5e1bbfac0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049520.384484:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb7c4c38000/0xf4f48ce5e1bbfac0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049520.384747:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb7c4c39a00/0xf4f48ce5e1bbfac7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049520.384757:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cb7c4c39a00/0xf4f48ce5e1bbfac7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049520.384764:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb7c4c39a00/0xf4f48ce5e1bbfac7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789049520.384775:0:5850:0:(mdt_handler.c:922:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 8 00010000:00010000:0.0:1789049520.384924:0:5850:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb7c4c39400/0xf4f48ce5e1bbfab9 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049520.384932:0:5850:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cb7c4c39400/0xf4f48ce5e1bbfab9 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049520.385561:0:5850:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cb7c4c39400/0xf4f48ce5e1bbfab9 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049520.385572:0:5850:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cb7c4c39400 already unused, calling callback (ffffffffc20ca4f0) 00010000:00010000:0.0:1789049520.385586:0:5850:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb7c4c39400/0xf4f48ce5e1bbfab9 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049520.385595:0:5850:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb7c4c39400/0xf4f48ce5e1bbfab9 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049520.385608:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8cb8e0130100) 00010000:00010000:0.0:1789049520.385611:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789049520.385615:0:5850:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cb7c4c39400/0xf4f48ce5e1bbfab9 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049520.385621:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb7c4c39400/0xf4f48ce5e1bbfab9 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049520.385634:0:5850:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb7c4c38000/0xf4f48ce5e1bbfac0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049520.385641:0:5850:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cb7c4c38000/0xf4f48ce5e1bbfac0 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049520.385647:0:5850:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cb7c4c38000/0xf4f48ce5e1bbfac0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049520.385652:0:5850:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cb7c4c38000 already unused, calling callback (ffffffffc20ca4f0) 00010000:00010000:0.0:1789049520.385655:0:5850:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb7c4c38000/0xf4f48ce5e1bbfac0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049520.385660:0:5850:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb7c4c38000/0xf4f48ce5e1bbfac0 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049520.385666:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8cb8ce751c00) 00010000:00010000:0.0:1789049520.385669:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789049520.385676:0:5850:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cb7c4c38000/0xf4f48ce5e1bbfac0 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049520.385682:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb7c4c38000/0xf4f48ce5e1bbfac0 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049520.385732:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb7c4c38800/0xf4f48ce5e1bbfab2 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a365b expref: 39 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049520.385748:0:5850:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb7c4c39a00/0xf4f48ce5e1bbfac7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a365b expref: 38 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049520.385756:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8cb8c396d300) 00010000:00010000:0.0:1789049520.385758:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789049520.385760:0:5850:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cb7c4c39a00, rc 0) 00000100:00100000:0.0:1789049520.385947:0:5850:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb7c7146a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e823b53a-3591-475c-8624-c682227e5c13+38:11540:x1875954089675776:12345-192.168.206.26@tcp:101:cat.0 Request processed in 1935us (2235us total) trans 4294967486 rc 0/0 00000100:00100000:0.0:1789049520.385956:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.26@tcp, seq: 196 00000100:00100000:0.0:1789049520.391905:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.26@tcp (source: 12345-192.168.206.26@tcp) 00000100:00100000:1.0:1789049520.392332:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954089676032 00000100:00100000:1.0:1789049520.392344:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954089676032 00000100:00100000:1.0:1789049520.392442:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.26@tcp, seq: 54 00000100:00100000:1.0:1789049520.392455:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb7c7139500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e823b53a-3591-475c-8624-c682227e5c13+38:11540:x1875954089676032:12345-192.168.206.26@tcp:35:cat.0 00000100:00100000:1.0:1789049520.392705:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb7c7139500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e823b53a-3591-475c-8624-c682227e5c13+39:11540:x1875954089676032:12345-192.168.206.26@tcp:35:cat.0 Request processed in 253us (810us total) trans 4294967487 rc 0/0 00000100:00100000:1.0:1789049520.392726:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.26@tcp, seq: 54 00000100:00100000:2.0:1789049520.421883:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.26@tcp (source: 12345-192.168.206.26@tcp) 00000100:00100000:3.0:1789049520.422018:0:6841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954089676288 00000100:00100000:3.0:1789049520.422027:0:6841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954089676288 00000100:00100000:3.0:1789049520.422091:0:6841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.26@tcp, seq: 197 00000100:00100000:3.0:1789049520.422112:0:6841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb900e95880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e823b53a-3591-475c-8624-c682227e5c13+39:11541:x1875954089676288:12345-192.168.206.26@tcp:36:rm.0 00010000:00010000:3.0:1789049520.422181:0:6841:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:3.0:1789049520.422206:0:6841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb7c4c39a00/0xf4f48ce5e1bbfac7 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a365b expref: 39 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049520.422229:0:6841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6714a00/0xf4f48ce5e1bbfa9d lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a3654 expref: 38 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049520.422242:0:6841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6715c00/0xf4f48ce5e1bbfa65 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a3646 expref: 37 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049520.422283:0:6841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8cb8c396d300) 00010000:00010000:3.0:1789049520.422294:0:6841:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789049520.422314:0:6841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c6b35800/0xf4f48ce5e1bbfad5 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049520.422327:0:6841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c6b35800/0xf4f48ce5e1bbfad5 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049520.422336:0:6841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c6b35800/0xf4f48ce5e1bbfad5 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049520.422350:0:6841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c6b35a00/0xf4f48ce5e1bbfadc lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049520.422357:0:6841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c6b35a00/0xf4f48ce5e1bbfadc lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049520.422363:0:6841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c6b35a00/0xf4f48ce5e1bbfadc lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049520.422597:0:6841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c6b35400/0xf4f48ce5e1bbfae3 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049520.422606:0:6841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c6b35400/0xf4f48ce5e1bbfae3 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049520.422613:0:6841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c6b35400/0xf4f48ce5e1bbfae3 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6841 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1789049520.423228:0:6841:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].7, 64 off8712 00000004:00080000:3.0:1789049520.423239:0:6841:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 346475394799ns, next at 347475392647ns, rc = 0 00010000:00010000:3.0:1789049520.423302:0:6841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c6b34200/0xf4f48ce5e1bbfaea lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049520.423312:0:6841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c6b34200/0xf4f48ce5e1bbfaea lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049520.423319:0:6841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c6b34200/0xf4f48ce5e1bbfaea lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049520.423326:0:6841:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c6b34200/0xf4f48ce5e1bbfaea lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049520.423332:0:6841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c6b34200/0xf4f48ce5e1bbfaea lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049520.423338:0:6841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c6b34200/0xf4f48ce5e1bbfaea lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049520.423352:0:6841:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789049520.423371:0:6841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c6b35400/0xf4f48ce5e1bbfae3 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049520.423378:0:6841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c6b35400/0xf4f48ce5e1bbfae3 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049520.423383:0:6841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c6b35400/0xf4f48ce5e1bbfae3 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049520.423390:0:6841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cb8c6b35400 already unused, calling callback (ffffffffc20ca4f0) 00010000:00010000:3.0:1789049520.423394:0:6841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c6b35400/0xf4f48ce5e1bbfae3 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049520.423402:0:6841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c6b35400/0xf4f48ce5e1bbfae3 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049520.423418:0:6841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8cb8c687d800) 00010000:00010000:3.0:1789049520.423420:0:6841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1789049520.423425:0:6841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c6b35400/0xf4f48ce5e1bbfae3 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049520.423430:0:6841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c6b35400/0xf4f48ce5e1bbfae3 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049520.423446:0:6841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c6b35800/0xf4f48ce5e1bbfad5 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049520.423451:0:6841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c6b35800/0xf4f48ce5e1bbfad5 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049520.423456:0:6841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c6b35800/0xf4f48ce5e1bbfad5 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049520.423460:0:6841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cb8c6b35800 already unused, calling callback (ffffffffc20ca4f0) 00010000:00010000:3.0:1789049520.423462:0:6841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c6b35800/0xf4f48ce5e1bbfad5 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049520.423467:0:6841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c6b35800/0xf4f48ce5e1bbfad5 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049520.423473:0:6841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8cb8e0130100) 00010000:00010000:3.0:1789049520.423475:0:6841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789049520.423478:0:6841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c6b35800/0xf4f48ce5e1bbfad5 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049520.423482:0:6841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c6b35800/0xf4f48ce5e1bbfad5 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6841 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789049520.423502:0:6841:0:(mdt_handler.c:4507:mdt_save_lock()) ### save lock request 00000000a2a9b49d reply state 0000000026f719bf transno 4294967488 ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c6b35a00/0xf4f48ce5e1bbfadc lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6841 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789049520.423510:0:6841:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1789049520.423595:0:6841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb900e95880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e823b53a-3591-475c-8624-c682227e5c13+38:11541:x1875954089676288:12345-192.168.206.26@tcp:36:rm.0 Request processed in 1483us (1719us total) trans 4294967488 rc 0/0 00000100:00100000:3.0:1789049520.423603:0:6841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.26@tcp, seq: 197 00010000:00010000:1.0:1789049520.424641:0:6719:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789049520.424651:0:6719:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c6b34200/0xf4f48ce5e1bbfaea lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 6841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049520.424659:0:6719:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cb8c6b34200 already unused, calling callback (ffffffffc166a8f0) 00010000:00010000:1.0:1789049520.424663:0:6719:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c6b34200/0xf4f48ce5e1bbfaea lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 6841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049520.424671:0:6719:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c6b34200/0xf4f48ce5e1bbfaea lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 6841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049520.424683:0:6719:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8cb8c687d800) 00010000:00010000:1.0:1789049520.424685:0:6719:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1789049520.424689:0:6719:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c6b34200/0xf4f48ce5e1bbfaea lrc: 1/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 6841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049520.424695:0:6719:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c6b34200/0xf4f48ce5e1bbfaea lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 6841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049520.424712:0:6719:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789049520.424714:0:6719:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789049520.424716:0:6719:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789049520.430712:0:3295:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c6b35a00/0xf4f48ce5e1bbfadc lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049520.430728:0:3295:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c6b35a00/0xf4f48ce5e1bbfadc lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049520.430735:0:3295:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c6b35a00/0xf4f48ce5e1bbfadc lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049520.430740:0:3295:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cb8c6b35a00 already unused, calling callback (ffffffffc20ca4f0) 00010000:00010000:0.0:1789049520.430745:0:3295:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c6b35a00/0xf4f48ce5e1bbfadc lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049520.430766:0:3295:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c6b35a00/0xf4f48ce5e1bbfadc lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049520.430781:0:3295:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8cb8c687d200) 00010000:00010000:0.0:1789049520.430784:0:3295:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789049520.430798:0:3295:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c6b35a00/0xf4f48ce5e1bbfadc lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049520.430806:0:3295:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c6b35a00/0xf4f48ce5e1bbfadc lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6841 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789049520.523380:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.26@tcp (source: 12345-192.168.206.26@tcp) 00000100:00100000:1.0:1789049520.523525:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954089676544 00000100:00100000:1.0:1789049520.523536:0:5851:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954089676544 00000100:00100000:1.0:1789049520.523595:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.26@tcp, seq: 198 00000100:00100000:1.0:1789049520.523604:0:5851:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb900e97100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e823b53a-3591-475c-8624-c682227e5c13+37:11547:x1875954089676544:12345-192.168.206.26@tcp:101:bash.0 00010000:00010000:1.0:1789049520.523629:0:5851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789049520.523650:0:5851:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c2000/0xf4f48ce5e1bbfaf1 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7fc5e358805a3662 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049520.523775:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c2c00/0xf4f48ce5e1bbfaf8 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049520.523799:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c2c00/0xf4f48ce5e1bbfaf8 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049520.523811:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c2c00/0xf4f48ce5e1bbfaf8 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049520.523826:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c3800/0xf4f48ce5e1bbfaff lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049520.523833:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c3800/0xf4f48ce5e1bbfaff lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049520.523839:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c3800/0xf4f48ce5e1bbfaff lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1789049520.524442:0:5851:0:(osp_object.c:1667:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x5:0x0], index 1: 0 00010000:00010000:1.0:1789049520.524609:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c2800/0xf4f48ce5e1bbfb06 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049520.524620:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c2800/0xf4f48ce5e1bbfb06 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049520.524628:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c2800/0xf4f48ce5e1bbfb06 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049520.524661:0:5851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c2c00/0xf4f48ce5e1bbfaf8 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049520.524679:0:5851:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c2c00/0xf4f48ce5e1bbfaf8 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049520.524685:0:5851:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c2c00/0xf4f48ce5e1bbfaf8 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049520.524691:0:5851:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cb8c28c2c00 already unused, calling callback (ffffffffc20ca4f0) 00010000:00010000:1.0:1789049520.524695:0:5851:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c2c00/0xf4f48ce5e1bbfaf8 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049520.524702:0:5851:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c2c00/0xf4f48ce5e1bbfaf8 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049520.524713:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8cb8e0130100) 00010000:00010000:1.0:1789049520.524716:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789049520.524720:0:5851:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c2c00/0xf4f48ce5e1bbfaf8 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049520.524725:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c2c00/0xf4f48ce5e1bbfaf8 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789049520.524738:0:5851:0:(mdt_handler.c:4507:mdt_save_lock()) ### save lock request 0000000043db6310 reply state 00000000764687ca transno 4294967489 ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c3800/0xf4f48ce5e1bbfaff lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789049520.524748:0:5851:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1789049520.524775:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c2000/0xf4f48ce5e1bbfaf1 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a3662 expref: 40 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049520.524804:0:5851:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c2800/0xf4f48ce5e1bbfb06 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a3662 expref: 39 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049520.524822:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8cb8c396d800) 00010000:00010000:1.0:1789049520.524824:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789049520.524827:0:5851:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cb8c28c2800, rc 0) 00000100:00100000:1.0:1789049520.524932:0:5851:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb900e97100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e823b53a-3591-475c-8624-c682227e5c13+40:11547:x1875954089676544:12345-192.168.206.26@tcp:101:bash.0 Request processed in 1328us (1560us total) trans 4294967489 rc 0/0 00000100:00100000:1.0:1789049520.524939:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.26@tcp, seq: 198 00010000:00010000:1.0:1789049520.529528:0:3294:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c3800/0xf4f48ce5e1bbfaff lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049520.529546:0:3294:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c3800/0xf4f48ce5e1bbfaff lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049520.529554:0:3294:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c3800/0xf4f48ce5e1bbfaff lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049520.529560:0:3294:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cb8c28c3800 already unused, calling callback (ffffffffc20ca4f0) 00010000:00010000:1.0:1789049520.529565:0:3294:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c3800/0xf4f48ce5e1bbfaff lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049520.529572:0:3294:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c3800/0xf4f48ce5e1bbfaff lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049520.529587:0:3294:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8cb8c396d000) 00010000:00010000:1.0:1789049520.529590:0:3294:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789049520.529595:0:3294:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c3800/0xf4f48ce5e1bbfaff lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049520.529602:0:3294:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c3800/0xf4f48ce5e1bbfaff lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789049520.535131:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.26@tcp (source: 12345-192.168.206.26@tcp) 00000100:00100000:0.0:1789049520.535378:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954089676672 00000100:00100000:0.0:1789049520.535388:0:6704:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954089676672 00000100:00100000:0.0:1789049520.535462:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.26@tcp, seq: 59 00000100:00100000:0.0:1789049520.535473:0:6704:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb900e96680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e823b53a-3591-475c-8624-c682227e5c13+5:2357:x1875954089676672:12345-192.168.206.26@tcp:101:bash.0 00010000:00010000:0.0:1789049520.535492:0:6704:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789049520.535515:0:6704:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ea604f9c/0xf4f48ce5e1bbfb14 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x7fc5e358805a3669 expref: -99 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789049520.535543:0:6704:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1789049520.535562:0:6704:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=346s v=(0 0) 00010000:00010000:0.0:1789049520.535566:0:6704:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789049520.535576:0:6704:0:(ldlm_resource.c:1751:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ea604f9c/0xf4f48ce5e1bbfb14 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a3669 expref: 6 pid: 6704 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049520.535596:0:6704:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000ea604f9c/0xf4f48ce5e1bbfb14 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a3669 expref: 6 pid: 6704 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049520.535629:0:6704:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cb7c4c38800, rc 0) 00000100:00100000:0.0:1789049520.535678:0:6704:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb900e96680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e823b53a-3591-475c-8624-c682227e5c13+6:2357:x1875954089676672:12345-192.168.206.26@tcp:101:bash.0 Request processed in 207us (565us total) trans 0 rc 0/0 00000100:00100000:0.0:1789049520.535685:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.26@tcp, seq: 59 00000100:00080000:1.0:1789049520.536465:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789049520.541510:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.26@tcp (source: 12345-192.168.206.26@tcp) 00000100:00100000:1.0:1789049520.541746:0:6705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954089676800 00000100:00100000:1.0:1789049520.541756:0:6705:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954089676800 00000100:00100000:1.0:1789049520.541821:0:6705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.26@tcp, seq: 60 00000100:00100000:1.0:1789049520.541829:0:6705:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb9009c2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e823b53a-3591-475c-8624-c682227e5c13+6:11547:x1875954089676800:12345-192.168.206.26@tcp:101:bash.0 00010000:00010000:1.0:1789049520.541883:0:6705:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789049520.541901:0:6705:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001870f5eb/0xf4f48ce5e1bbfb1b lrc: 2/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x7fc5e358805a3670 expref: -99 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049520.541931:0:6705:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000ea604f9c/0xf4f48ce5e1bbfb14 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a3669 expref: 7 pid: 6704 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049520.541940:0:6705:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789049520.541944:0:6705:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789049520.541949:0:6705:0:(ldlm_resource.c:1751:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001870f5eb/0xf4f48ce5e1bbfb1b lrc: 4/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a3670 expref: 7 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049520.541982:0:6705:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000ea604f9c/0xf4f48ce5e1bbfb14 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a3669 expref: 7 pid: 6704 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049520.541995:0:6705:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000ea604f9c/0xf4f48ce5e1bbfb14 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a3669 expref: 7 pid: 6704 timeout: 446 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789049520.542009:0:6705:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb7c7147480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6705:1875954110636672:192.168.206.26@tcp:104: 00000100:00100000:1.0:1789049520.542103:0:6705:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cb8c687cf00 going to sleep for 11 seconds 00000100:00100000:3.0:1789049520.546500:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.26@tcp (source: 12345-192.168.206.26@tcp) 00000100:00100000:2.0:1789049520.546598:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954089676928 00000100:00100000:2.0:1789049520.546608:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954089676928 00010000:00010000:2.0:1789049520.546650:0:5836:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000ea604f9c/0xf4f48ce5e1bbfb14 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a3669 expref: 8 pid: 6704 timeout: 446 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789049520.546698:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.26@tcp, seq: 74 00000100:00100000:2.0:1789049520.546708:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb9009c2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e823b53a-3591-475c-8624-c682227e5c13+8:2357:x1875954089676928:12345-192.168.206.26@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789049520.546737:0:5836:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789049520.546760:0:5836:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000ea604f9c/0xf4f48ce5e1bbfb14 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a3669 expref: 8 pid: 6704 timeout: 446 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049520.546775:0:5836:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000ea604f9c/0xf4f48ce5e1bbfb14 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a3669 expref: 8 pid: 6704 timeout: 446 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049520.546811:0:5836:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789049520.546816:0:5836:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789049520.546824:0:5836:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000001870f5eb/0xf4f48ce5e1bbfb1b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a3670 expref: 8 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049520.546835:0:5836:0:(ldlm_resource.c:1751:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001870f5eb/0xf4f48ce5e1bbfb1b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a3670 expref: 8 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049520.546911:0:5836:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000001870f5eb/0xf4f48ce5e1bbfb1b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a3670 expref: 8 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789049520.546926:0:5836:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb900e97b80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5836:1875954110636800:192.168.206.26@tcp:105: 00000100:00100000:2.0:1789049520.546995:0:5836:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cb8fc9b60c0 going to sleep for 11 seconds 00010000:00010000:1.0:1789049520.547989:0:6705:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ea604f9c/0xf4f48ce5e1bbfb14 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a3669 expref: 8 pid: 6704 timeout: 446 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789049520.548007:0:6705:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb7c7147480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6705:1875954110636672:192.168.206.26@tcp:104: 00010000:00010000:1.0:1789049520.548051:0:6705:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000001870f5eb/0xf4f48ce5e1bbfb1b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a3670 expref: 7 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049520.548062:0:6705:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cb8c28c3800, rc 0) 00000100:00100000:1.0:1789049520.548113:0:6705:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb9009c2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e823b53a-3591-475c-8624-c682227e5c13+7:11547:x1875954089676800:12345-192.168.206.26@tcp:101:bash.0 Request processed in 6284us (6611us total) trans 0 rc 0/0 00000100:00100000:1.0:1789049520.548362:0:6705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.26@tcp, seq: 60 00000100:00100000:0.0:1789049520.560288:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.26@tcp (source: 12345-192.168.206.26@tcp) 00000100:00100000:2.0:1789049520.560617:0:5836:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb900e97b80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5836:1875954110636800:192.168.206.26@tcp:105: 00010000:00010000:2.0:1789049520.560641:0:5836:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789049520.560699:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb9009c2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e823b53a-3591-475c-8624-c682227e5c13+6:2357:x1875954089676928:12345-192.168.206.26@tcp:103:ldlm_bl.0 Request processed in 13991us (14208us total) trans 0 rc 0/0 00000100:00100000:2.0:1789049520.560709:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.26@tcp, seq: 74 00000100:00100000:3.0:1789049520.561145:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954089677184 00000100:00100000:3.0:1789049520.561153:0:5853:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954089677184 00000100:00100000:3.0:1789049520.561200:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.26@tcp, seq: 55 00000100:00100000:3.0:1789049520.561210:0:5853:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb7c7139180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e823b53a-3591-475c-8624-c682227e5c13+39:11547:x1875954089677184:12345-192.168.206.26@tcp:35:bash.0 00000001:00080000:3.0:1789049520.561481:0:5853:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967490 00000100:00100000:3.0:1789049520.561570:0:5853:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb7c7139180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e823b53a-3591-475c-8624-c682227e5c13+41:11547:x1875954089677184:12345-192.168.206.26@tcp:35:bash.0 Request processed in 361us (1289us total) trans 4294967491 rc 0/0 00000100:00100000:3.0:1789049520.561577:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.26@tcp, seq: 55 00000020:00080000:3.0:1789049520.561582:0:5853:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1789049520.802562:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.26@tcp (source: 12345-192.168.206.26@tcp) 00000100:00100000:3.0:1789049520.802702:0:6841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954089677312 00000100:00100000:3.0:1789049520.802716:0:6841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954089677312 00000100:00100000:3.0:1789049520.802818:0:6841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.26@tcp, seq: 199 00000100:00100000:3.0:1789049520.802828:0:6841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb7c713b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e823b53a-3591-475c-8624-c682227e5c13+41:11563:x1875954089677312:12345-192.168.206.26@tcp:101:lfs.0 00010000:00010000:3.0:1789049520.802883:0:6841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789049520.802904:0:6841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c6b35800/0xf4f48ce5e1bbfb22 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7fc5e358805a3677 expref: -99 pid: 6841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049520.802982:0:6841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c6b35400/0xf4f48ce5e1bbfb29 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049520.802995:0:6841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c6b35400/0xf4f48ce5e1bbfb29 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049520.803005:0:6841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c6b35400/0xf4f48ce5e1bbfb29 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6841 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789049520.803036:0:6841:0:(mdt_handler.c:922:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00000004:00200000:3.0:1789049520.803039:0:6841:0:(mdt_handler.c:1587:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1789049520.803055:0:6841:0:(mdt_handler.c:2522:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c6b35400/0xf4f48ce5e1bbfb29 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049520.803078:0:6841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c6b35800/0xf4f48ce5e1bbfb22 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a3677 expref: 43 pid: 6841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049520.803105:0:6841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c6b35400/0xf4f48ce5e1bbfb29 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a3677 expref: 42 pid: 6841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049520.803121:0:6841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8cb8e0130100) 00010000:00010000:3.0:1789049520.803124:0:6841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1789049520.803128:0:6841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cb8c6b35400, rc 0) 00000100:00100000:3.0:1789049520.803190:0:6841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb7c713b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e823b53a-3591-475c-8624-c682227e5c13+42:11563:x1875954089677312:12345-192.168.206.26@tcp:101:lfs.0 Request processed in 364us (637us total) trans 0 rc 0/0 00000100:00100000:3.0:1789049520.803197:0:6841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.26@tcp, seq: 199 00000100:00100000:2.0:1789049520.808096:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.26@tcp (source: 12345-192.168.206.26@tcp) 00000100:00100000:1.0:1789049520.808703:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954089677568 00000100:00100000:1.0:1789049520.808715:0:5851:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954089677568 00000100:00100000:1.0:1789049520.809928:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.26@tcp, seq: 200 00000100:00100000:1.0:1789049520.809946:0:5851:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb900e97b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e823b53a-3591-475c-8624-c682227e5c13+42:11563:x1875954089677568:12345-192.168.206.26@tcp:101:lfs.0 00010000:00010000:1.0:1789049520.809966:0:5851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789049520.809988:0:5851:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c2600/0xf4f48ce5e1bbfb30 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7fc5e358805a367e expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049520.810082:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c2400/0xf4f48ce5e1bbfb37 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049520.810097:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c2400/0xf4f48ce5e1bbfb37 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049520.810109:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c2400/0xf4f48ce5e1bbfb37 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789049520.810253:0:5851:0:(mdt_handler.c:922:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:1.0:1789049520.810660:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c2600/0xf4f48ce5e1bbfb30 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a367e expref: 45 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049520.810681:0:5851:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c2400/0xf4f48ce5e1bbfb37 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a367e expref: 44 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049520.810689:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8cb8c396d800) 00010000:00010000:1.0:1789049520.810692:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789049520.810696:0:5851:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cb8c28c2400, rc 0) 00000100:00100000:1.0:1789049520.811064:0:5851:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb900e97b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e823b53a-3591-475c-8624-c682227e5c13+44:11563:x1875954089677568:12345-192.168.206.26@tcp:101:lfs.0 Request processed in 1124us (2979us total) trans 4294967492 rc 0/0 00000100:00100000:1.0:1789049520.811073:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.26@tcp, seq: 200 00000100:00100000:3.0:1789049520.815330:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.26@tcp (source: 12345-192.168.206.26@tcp) 00000100:00100000:0.0:1789049520.815411:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954089677824 00000100:00100000:0.0:1789049520.815420:0:5852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954089677824 00000100:00100000:0.0:1789049520.815478:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.26@tcp, seq: 201 00000100:00100000:0.0:1789049520.815487:0:5852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb9009c3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e823b53a-3591-475c-8624-c682227e5c13+44:11563:x1875954089677824:12345-192.168.206.26@tcp:101:lfs.0 00010000:00010000:0.0:1789049520.815512:0:5852:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789049520.815533:0:5852:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb7c4c38000/0xf4f48ce5e1bbfb45 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7fc5e358805a3685 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049520.815628:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb7c4c39400/0xf4f48ce5e1bbfb4c lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049520.815645:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cb7c4c39400/0xf4f48ce5e1bbfb4c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049520.815656:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb7c4c39400/0xf4f48ce5e1bbfb4c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789049520.815668:0:5852:0:(mdt_handler.c:922:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:0.0:1789049520.815784:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb7c4c38000/0xf4f48ce5e1bbfb45 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a3685 expref: 47 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049520.815829:0:5852:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb7c4c39400/0xf4f48ce5e1bbfb4c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a3685 expref: 46 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049520.815837:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8cb8c396d800) 00010000:00010000:0.0:1789049520.815839:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1789049520.815873:0:5852:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cb7c4c39400, rc 0) 00000100:00100000:0.0:1789049520.815942:0:5852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb9009c3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e823b53a-3591-475c-8624-c682227e5c13+46:11563:x1875954089677824:12345-192.168.206.26@tcp:101:lfs.0 Request processed in 455us (620us total) trans 4294967493 rc 0/0 00000100:00100000:0.0:1789049520.815950:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.26@tcp, seq: 201 00000100:00100000:1.0:1789049520.826587:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.26@tcp (source: 12345-192.168.206.26@tcp) 00000100:00100000:2.0:1789049520.826698:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954089677952 00000100:00100000:2.0:1789049520.826707:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954089677952 00000100:00100000:2.0:1789049520.826784:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.26@tcp, seq: 14 00000100:00100000:2.0:1789049520.826803:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb7c7147480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e823b53a-3591-475c-8624-c682227e5c13+46:2356:x1875954089677952:12345-192.168.206.26@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789049520.826817:0:5837:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789049520.826840:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c2400/0xf4f48ce5e1bbfb37 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a367e expref: 46 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049520.826887:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8cb8c396d800) 00010000:00010000:2.0:1789049520.826892:0:5837:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789049520.826945:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb7c7147480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e823b53a-3591-475c-8624-c682227e5c13+45:2356:x1875954089677952:12345-192.168.206.26@tcp:103:ldlm_bl.0 Request processed in 144us (367us total) trans 0 rc 0/0 00000100:00100000:2.0:1789049520.826952:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.26@tcp, seq: 14 00000100:00100000:2.0:1789049520.833064:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.26@tcp (source: 12345-192.168.206.26@tcp) 00000100:00100000:0.0:1789049520.833295:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954089678080 00000100:00100000:0.0:1789049520.833305:0:6704:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954089678080 00000100:00100000:0.0:1789049520.833370:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.26@tcp, seq: 61 00000100:00100000:0.0:1789049520.833380:0:6704:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb900e94380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e823b53a-3591-475c-8624-c682227e5c13+6:2358:x1875954089678080:12345-192.168.206.26@tcp:1:lfs.0 00010000:00010000:0.0:1789049520.833421:0:6704:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e3341081/0xf4f48ce5e1bbfb5a lrc: 3/0,1 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049520.833440:0:6704:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000001870f5eb/0xf4f48ce5e1bbfb1b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a3670 expref: 6 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049520.833449:0:6704:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789049520.833454:0:6704:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1789049520.833458:0:6704:0:(ldlm_resource.c:1751:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e3341081/0xf4f48ce5e1bbfb5a lrc: 4/0,1 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049520.833490:0:6704:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000001870f5eb/0xf4f48ce5e1bbfb1b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a3670 expref: 6 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049520.833516:0:6704:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000001870f5eb/0xf4f48ce5e1bbfb1b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a3670 expref: 6 pid: 6705 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789049520.833531:0:6704:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb7c7138380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6704:1875954110636928:192.168.206.26@tcp:104: 00000100:00100000:0.0:1789049520.833620:0:6704:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cb8c799fc00 going to sleep for 11 seconds 00000100:00100000:0.0:1789049520.838135:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.26@tcp (source: 12345-192.168.206.26@tcp) 00000100:00100000:2.0:1789049520.838273:0:6710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954089678208 00000100:00100000:2.0:1789049520.838282:0:6710:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954089678208 00002000:00100000:2.0:1789049520.838329:0:6710:0:(ofd_dev.c:2725:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x5:0x0] (0->8) req@ffff8cb7c7138000 x1875954089678208/t0(0) o4->e823b53a-3591-475c-8624-c682227e5c13@192.168.206.26@tcp:21/0 lens 504/0 e 0 to 0 dl 1789049531 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789049520.838340:0:6710:0:(ofd_dev.c:2581:ofd_prolong_extent_locks()) Prolong locks for req ffff8cb7c7138000 with x1875954089678208 ext(0->8) 00010000:00010000:2.0:1789049520.838358:0:6710:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000001870f5eb/0xf4f48ce5e1bbfb1b lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a3670 expref: 7 pid: 6705 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049520.838375:0:6710:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000001870f5eb/0xf4f48ce5e1bbfb1b lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a3670 expref: 7 pid: 6705 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789049520.838383:0:6710:0:(ofd_dev.c:2730:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8cb7c7138000 00000100:00100000:2.0:1789049520.838429:0:6710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.26@tcp, seq: 3 00000100:00100000:2.0:1789049520.838438:0:6710:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb7c7138000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e823b53a-3591-475c-8624-c682227e5c13+7:2357:x1875954089678208:12345-192.168.206.26@tcp:4:lfs.0 00000100:00100000:2.0:1789049520.838927:0:6710:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb7c7138000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e823b53a-3591-475c-8624-c682227e5c13+9:2357:x1875954089678208:12345-192.168.206.26@tcp:4:lfs.0 Request processed in 488us (797us total) trans 4294967308 rc 0/0 00000100:00100000:2.0:1789049520.838935:0:6710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.26@tcp, seq: 3 00002000:00100000:2.0:1789049520.838943:0:6710:0:(ofd_dev.c:2725:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x5:0x0] (0->8) req@ffff8cb7c7138000 x1875954089678208/t4294967308(0) o4->e823b53a-3591-475c-8624-c682227e5c13@192.168.206.26@tcp:21/0 lens 504/448 e 0 to 0 dl 1789049531 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789049520.838951:0:6710:0:(ofd_dev.c:2581:ofd_prolong_extent_locks()) Prolong locks for req ffff8cb7c7138000 with x1875954089678208 ext(0->8) 00010000:00010000:2.0:1789049520.838957:0:6710:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000001870f5eb/0xf4f48ce5e1bbfb1b lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a3670 expref: 9 pid: 6705 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049520.838968:0:6710:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000001870f5eb/0xf4f48ce5e1bbfb1b lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a3670 expref: 9 pid: 6705 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789049520.838975:0:6710:0:(ofd_dev.c:2730:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8cb7c7138000 00000100:00100000:3.0:1789049520.839770:0:6704:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb7c7138380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6704:1875954110636928:192.168.206.26@tcp:104: 00010000:00010000:3.0:1789049520.839812:0:6704:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000e3341081/0xf4f48ce5e1bbfb5a lrc: 3/0,1 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789049520.844161:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.26@tcp (source: 12345-192.168.206.26@tcp) 00000100:00100000:0.0:1789049520.844338:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954089678336 00000100:00100000:0.0:1789049520.844355:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954089678336 00010000:00010000:0.0:1789049520.844395:0:5835:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000001870f5eb/0xf4f48ce5e1bbfb1b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a3670 expref: 9 pid: 6705 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789049520.844438:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.26@tcp, seq: 75 00000100:00100000:0.0:1789049520.844447:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8c7ded050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e823b53a-3591-475c-8624-c682227e5c13+9:2355:x1875954089678336:12345-192.168.206.26@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789049520.844462:0:5835:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:0.0:1789049520.844480:0:5835:0:(ofd_lvb.c:321:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:0.0:1789049520.844483:0:5835:0:(ofd_lvb.c:328:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb mtime from disk: 0 -> 1789049519872906627 00002000:00010000:0.0:1789049520.844486:0:5835:0:(ofd_lvb.c:334:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb atime from disk: 0 -> 1789049520147220562 00002000:00010000:0.0:1789049520.844487:0:5835:0:(ofd_lvb.c:340:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb ctime from disk: 0 -> 1789049519872906627 00010000:00010000:0.0:1789049520.844494:0:5835:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000001870f5eb/0xf4f48ce5e1bbfb1b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a3670 expref: 9 pid: 6705 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049520.844507:0:5835:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000001870f5eb/0xf4f48ce5e1bbfb1b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a3670 expref: 9 pid: 6705 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049520.844551:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001870f5eb/0xf4f48ce5e1bbfb1b lrc: 0/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a3670 expref: 9 pid: 6705 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049520.844567:0:5835:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1789049520.844571:0:5835:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1789049520.844576:0:5835:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000e3341081/0xf4f48ce5e1bbfb5a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049520.844584:0:5835:0:(ldlm_resource.c:1751:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e3341081/0xf4f48ce5e1bbfb5a lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049520.844615:0:5835:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789049520.844669:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8c7ded050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e823b53a-3591-475c-8624-c682227e5c13+8:2355:x1875954089678336:12345-192.168.206.26@tcp:103:ldlm_bl.0 Request processed in 223us (516us total) trans 0 rc 0/0 00000100:00100000:0.0:1789049520.844676:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.26@tcp, seq: 75 00010000:00010000:3.0:1789049520.844779:0:6704:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000e3341081/0xf4f48ce5e1bbfb5a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049520.844797:0:6704:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e3341081/0xf4f48ce5e1bbfb5a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049520.844819:0:6704:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e3341081/0xf4f48ce5e1bbfb5a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049520.844827:0:6704:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e3341081/0xf4f48ce5e1bbfb5a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049520.844835:0:6704:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e3341081/0xf4f48ce5e1bbfb5a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049520.844881:0:6704:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cb7c4c38a00 already unused, calling callback (ffffffffc166a8f0) 00010000:00010000:3.0:1789049520.844885:0:6704:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e3341081/0xf4f48ce5e1bbfb5a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049520.844894:0:6704:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e3341081/0xf4f48ce5e1bbfb5a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049520.844906:0:6704:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e3341081/0xf4f48ce5e1bbfb5a lrc: 2/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049520.844919:0:6704:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e3341081/0xf4f48ce5e1bbfb5a lrc: 0/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789049520.844965:0:6704:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb900e94380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e823b53a-3591-475c-8624-c682227e5c13+7:2358:x1875954089678080:12345-192.168.206.26@tcp:1:lfs.0 Request processed in 11587us (11909us total) trans 0 rc 0/0 00000100:00100000:3.0:1789049520.844972:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.26@tcp, seq: 61 00000100:00100000:0.0:1789049520.849333:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.26@tcp (source: 12345-192.168.206.26@tcp) 00000100:00100000:3.0:1789049520.850079:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954089678592 00000100:00100000:3.0:1789049520.850090:0:5853:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954089678592 00000100:00100000:3.0:1789049520.850158:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.26@tcp, seq: 56 00000100:00100000:3.0:1789049520.850168:0:5853:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8d1d2b850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e823b53a-3591-475c-8624-c682227e5c13+45:11563:x1875954089678592:12345-192.168.206.26@tcp:35:lfs.0 00000004:00010000:3.0:1789049520.850227:0:5853:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0xe:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8cb7c4c39400/0xf4f48ce5e1bbfb4c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a3685 expref: 45 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789049520.850496:0:5853:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967494 00000001:00080000:3.0:1789049520.850542:0:5853:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967495 00000001:00080000:2.0:1789049520.851450:0:5853:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967496 00010000:00010000:2.0:1789049520.851511:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6715200/0xf4f48ce5e1bbfb61 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049520.851529:0:5853:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c2800/0xf4f48ce5e1bbfb06 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a3662 expref: 49 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049520.851538:0:5853:0:(ldlm_resource.c:1751:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6715200/0xf4f48ce5e1bbfb61 lrc: 4/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049520.851571:0:5853:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c2800/0xf4f48ce5e1bbfb06 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a3662 expref: 49 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049520.851601:0:5853:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c2800/0xf4f48ce5e1bbfb06 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a3662 expref: 49 pid: 5851 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789049520.851616:0:5853:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb900e96300 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5853:1875954110637056:192.168.206.26@tcp:104: 00000100:00100000:2.0:1789049520.851700:0:5853:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cb8fc9b6f00 going to sleep for 11 seconds 00000100:00100000:2.0:1789049520.854592:0:5853:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb900e96300 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5853:1875954110637056:192.168.206.26@tcp:104: 00010000:00010000:2.0:1789049520.854620:0:5853:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6715200/0xf4f48ce5e1bbfb61 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789049520.856336:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.26@tcp (source: 12345-192.168.206.26@tcp) 00000100:00100000:2.0:1789049520.856631:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954089678720 00000100:00100000:2.0:1789049520.856641:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954089678720 00010000:00010000:2.0:1789049520.856680:0:5837:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c2800/0xf4f48ce5e1bbfb06 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a3662 expref: 50 pid: 5851 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789049520.856720:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.26@tcp, seq: 76 00000100:00100000:2.0:1789049520.856729:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb7c713bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e823b53a-3591-475c-8624-c682227e5c13+50:2357:x1875954089678720:12345-192.168.206.26@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789049520.856743:0:5837:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789049520.856750:0:5837:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c2800/0xf4f48ce5e1bbfb06 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a3662 expref: 50 pid: 5851 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049520.856764:0:5837:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c2800/0xf4f48ce5e1bbfb06 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a3662 expref: 50 pid: 5851 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049520.856797:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c2800/0xf4f48ce5e1bbfb06 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a3662 expref: 50 pid: 5851 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049520.856831:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8cb8c396d800) 00010000:00010000:2.0:1789049520.856837:0:5837:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6715200/0xf4f48ce5e1bbfb61 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049520.856895:0:5837:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6715200/0xf4f48ce5e1bbfb61 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049520.856903:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6715200/0xf4f48ce5e1bbfb61 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049520.856935:0:5837:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789049520.856978:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb7c713bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e823b53a-3591-475c-8624-c682227e5c13+49:2357:x1875954089678720:12345-192.168.206.26@tcp:103:ldlm_bl.0 Request processed in 250us (651us total) trans 0 rc 0/0 00000100:00100000:2.0:1789049520.856986:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.26@tcp, seq: 76 00010000:00010000:1.0:1789049520.857210:0:5853:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6715200/0xf4f48ce5e1bbfb61 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049520.857219:0:5853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6715200/0xf4f48ce5e1bbfb61 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789049520.857337:0:5853:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967497 00000001:00080000:1.0:1789049520.857544:0:5853:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967498 00000100:00100000:1.0:1789049520.857655:0:5853:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb7c7145c00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5853:1875954110637184:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1789049520.857702:0:5853:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789049520.857785:0:5853:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cb8c687c540 going to sleep for 11 seconds 00010000:00010000:3.0:1789049520.858945:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789049520.860401:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954110637184 00000100:00100000:0.0:1789049520.860414:0:5855:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954110637184 00000100:00100000:0.0:1789049520.860523:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1789049520.860534:0:5855:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb7c7144a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5853:x1875954110637184:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1789049520.860661:0:5855:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb7c7144a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5853:x1875954110637184:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 130us (2959us total) trans 0 rc 0/0 00000100:00100000:0.0:1789049520.860668:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1789049520.860751:0:5853:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb7c7145c00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5853:1875954110637184:0@lo:1000:mdt_rdpg00_000.0 00000100:00080000:1.0:1789049520.861284:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000001:00080000:3.0:1789049520.861706:0:5853:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967499 00000100:00100000:3.0:1789049520.861795:0:5853:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb9009c2a00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5853:1875954110637312:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1789049520.861866:0:5853:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789049520.862643:0:5853:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cb8c7c97480 going to sleep for 11 seconds 00000100:00100000:2.0:1789049520.862688:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954110637312 00000100:00100000:2.0:1789049520.862696:0:5856:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954110637312 00000100:00100000:2.0:1789049520.862734:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1789049520.862743:0:5856:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8df4d1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5853:x1875954110637312:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1789049520.863125:0:5856:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8df4d1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:5853:x1875954110637312:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 382us (1282us total) trans 4294967309 rc 0/0 00000100:00100000:2.0:1789049520.863140:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1789049520.863410:0:5853:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb9009c2a00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5853:1875954110637312:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:3.0:1789049520.863469:0:5853:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967500 00010000:00010000:3.0:1789049520.863511:0:5853:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6715200/0xf4f48ce5e1bbfb61 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049520.863527:0:5853:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6715200/0xf4f48ce5e1bbfb61 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049520.863534:0:5853:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6715200/0xf4f48ce5e1bbfb61 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049520.863540:0:5853:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cb8d6715200 already unused, calling callback (ffffffffc20ca4f0) 00010000:00010000:3.0:1789049520.863545:0:5853:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6715200/0xf4f48ce5e1bbfb61 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049520.863552:0:5853:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6715200/0xf4f48ce5e1bbfb61 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049520.863568:0:5853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8cb8c396d800) 00010000:00010000:3.0:1789049520.863572:0:5853:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:3.0:1789049520.863577:0:5853:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6715200/0xf4f48ce5e1bbfb61 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049520.863582:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6715200/0xf4f48ce5e1bbfb61 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5853 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1789049520.863752:0:5853:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0xf:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:2.0:1789049520.864406:0:5853:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].5, 64 off8512 00000004:00080000:2.0:1789049520.864419:0:5853:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 346916574698ns, next at 347916572394ns, rc = 0 00000001:00080000:2.0:1789049520.864426:0:5853:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967501 00010000:00010000:2.0:1789049520.864465:0:5853:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8cb8c396d800) 00010000:00010000:2.0:1789049520.864469:0:5853:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1789049520.864477:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb7c4c39400/0xf4f48ce5e1bbfb4c lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a3685 expref: 53 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789049520.864623:0:5853:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8d1d2b850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e823b53a-3591-475c-8624-c682227e5c13+52:11563:x1875954089678592:12345-192.168.206.26@tcp:35:lfs.0 Request processed in 14456us (15297us total) trans 4294967502 rc 0/0 00000100:00100000:2.0:1789049520.864643:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.26@tcp, seq: 56 00000020:00080000:2.0:1789049520.864648:0:5853:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:0.0:1789049520.867439:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.26@tcp (source: 12345-192.168.206.26@tcp) 00000100:00100000:3.0:1789049520.867531:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954089678848 00000100:00100000:3.0:1789049520.867540:0:5850:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954089678848 00000100:00100000:3.0:1789049520.867624:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.26@tcp, seq: 202 00000100:00100000:3.0:1789049520.867635:0:5850:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb7c7138700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e823b53a-3591-475c-8624-c682227e5c13+52:11563:x1875954089678848:12345-192.168.206.26@tcp:101:lfs.0 00010000:00010000:3.0:1789049520.867657:0:5850:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789049520.867677:0:5850:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c6b34e00/0xf4f48ce5e1bbfb68 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7fc5e358805a368c expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049520.867744:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c6b34e00/0xf4f48ce5e1bbfb68 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a368c expref: 53 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049520.867760:0:5850:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c6b34e00/0xf4f48ce5e1bbfb68 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a368c expref: 53 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049520.867779:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8cb8c687d300) 00010000:00010000:3.0:1789049520.867782:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1789049520.867785:0:5850:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cb8c6b34e00, rc 0) 00000100:00100000:3.0:1789049520.867876:0:5850:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb7c7138700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e823b53a-3591-475c-8624-c682227e5c13+53:11563:x1875954089678848:12345-192.168.206.26@tcp:101:lfs.0 Request processed in 242us (443us total) trans 0 rc 0/0 00000100:00100000:3.0:1789049520.867883:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.26@tcp, seq: 202 00000100:00100000:1.0:1789049520.872596:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.26@tcp (source: 12345-192.168.206.26@tcp) 00000100:00100000:2.0:1789049520.872693:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954089679104 00000100:00100000:2.0:1789049520.872703:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954089679104 00000100:00100000:2.0:1789049520.872796:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.26@tcp, seq: 57 00000100:00100000:2.0:1789049520.872807:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb7c7144e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e823b53a-3591-475c-8624-c682227e5c13+53:11563:x1875954089679104:12345-192.168.206.26@tcp:35:lfs.0 00000100:00100000:2.0:1789049520.875734:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb7c7144e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e823b53a-3591-475c-8624-c682227e5c13+54:11563:x1875954089679104:12345-192.168.206.26@tcp:35:lfs.0 Request processed in 2920us (3139us total) trans 4294967503 rc 0/0 00000100:00100000:2.0:1789049520.875747:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.26@tcp, seq: 57 00000100:00100000:0.0:1789049521.002424:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.26@tcp (source: 12345-192.168.206.26@tcp) 00000100:00100000:3.0:1789049521.002563:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954089679232 00000100:00100000:3.0:1789049521.002573:0:5852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954089679232 00000100:00100000:3.0:1789049521.002656:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.26@tcp, seq: 203 00000100:00100000:3.0:1789049521.002668:0:5852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb7c7139500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e823b53a-3591-475c-8624-c682227e5c13+54:11573:x1875954089679232:12345-192.168.206.26@tcp:34:lfs.0 00010000:00010000:3.0:1789049521.002736:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c6b35800/0xf4f48ce5e1bbfb6f lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049521.002753:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c6b35800/0xf4f48ce5e1bbfb6f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049521.002766:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c6b35800/0xf4f48ce5e1bbfb6f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049521.002781:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c6b34000/0xf4f48ce5e1bbfb76 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049521.002825:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c6b34000/0xf4f48ce5e1bbfb76 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049521.002832:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c6b34000/0xf4f48ce5e1bbfb76 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049521.002949:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c6b35a00/0xf4f48ce5e1bbfb7d lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049521.002958:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c6b35a00/0xf4f48ce5e1bbfb7d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049521.002965:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c6b35a00/0xf4f48ce5e1bbfb7d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789049521.003004:0:5852:0:(mdt_handler.c:2522:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c6b35a00/0xf4f48ce5e1bbfb7d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049521.003015:0:5852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c6b35800/0xf4f48ce5e1bbfb6f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049521.003022:0:5852:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c6b35800/0xf4f48ce5e1bbfb6f lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049521.003028:0:5852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c6b35800/0xf4f48ce5e1bbfb6f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049521.003034:0:5852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cb8c6b35800 already unused, calling callback (ffffffffc20ca4f0) 00010000:00010000:3.0:1789049521.003038:0:5852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c6b35800/0xf4f48ce5e1bbfb6f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049521.003044:0:5852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c6b35800/0xf4f48ce5e1bbfb6f lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049521.003062:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8cb8e0130100) 00010000:00010000:3.0:1789049521.003064:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789049521.003069:0:5852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c6b35800/0xf4f48ce5e1bbfb6f lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049521.003075:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c6b35800/0xf4f48ce5e1bbfb6f lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049521.003088:0:5852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c6b34000/0xf4f48ce5e1bbfb76 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049521.003095:0:5852:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c6b34000/0xf4f48ce5e1bbfb76 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049521.003101:0:5852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c6b34000/0xf4f48ce5e1bbfb76 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049521.003105:0:5852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cb8c6b34000 already unused, calling callback (ffffffffc20ca4f0) 00010000:00010000:3.0:1789049521.003108:0:5852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c6b34000/0xf4f48ce5e1bbfb76 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049521.003113:0:5852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c6b34000/0xf4f48ce5e1bbfb76 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049521.003120:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8cb8c687d400) 00010000:00010000:3.0:1789049521.003122:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789049521.003125:0:5852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c6b34000/0xf4f48ce5e1bbfb76 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:1.0:1789049521.003479:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1789049521.003506:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c6b34000/0xf4f48ce5e1bbfb76 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049521.003532:0:5852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c6b35a00/0xf4f48ce5e1bbfb7d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049521.003538:0:5852:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c6b35a00/0xf4f48ce5e1bbfb7d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049521.003543:0:5852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c6b35a00/0xf4f48ce5e1bbfb7d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049521.003548:0:5852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cb8c6b35a00 already unused, calling callback (ffffffffc20ca4f0) 00010000:00010000:3.0:1789049521.003550:0:5852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c6b35a00/0xf4f48ce5e1bbfb7d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049521.003556:0:5852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c6b35a00/0xf4f48ce5e1bbfb7d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049521.003563:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8cb8c687d300) 00010000:00010000:3.0:1789049521.003565:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789049521.003569:0:5852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c6b35a00/0xf4f48ce5e1bbfb7d lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049521.003575:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c6b35a00/0xf4f48ce5e1bbfb7d lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789049521.003688:0:5852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb7c7139500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e823b53a-3591-475c-8624-c682227e5c13+54:11573:x1875954089679232:12345-192.168.206.26@tcp:34:lfs.0 Request processed in 1022us (1271us total) trans 0 rc 0/0 00000100:00100000:3.0:1789049521.003697:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.26@tcp, seq: 203 00000100:00100000:0.0:1789049521.070341:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.26@tcp (source: 12345-192.168.206.26@tcp) 00000100:00100000:1.0:1789049521.070484:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954089679488 00000100:00100000:1.0:1789049521.070494:0:5851:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954089679488 00000100:00100000:1.0:1789049521.070552:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.26@tcp, seq: 204 00000100:00100000:1.0:1789049521.070562:0:5851:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb7c7139180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e823b53a-3591-475c-8624-c682227e5c13+54:11576:x1875954089679488:12345-192.168.206.26@tcp:101:lfs.0 00010000:00010000:1.0:1789049521.070585:0:5851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789049521.070606:0:5851:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c2c00/0xf4f48ce5e1bbfb84 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7fc5e358805a3693 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049521.070690:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c2000/0xf4f48ce5e1bbfb8b lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049521.070705:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c2000/0xf4f48ce5e1bbfb8b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049521.070718:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c2000/0xf4f48ce5e1bbfb8b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049521.070734:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c2200/0xf4f48ce5e1bbfb92 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049521.070741:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c2200/0xf4f48ce5e1bbfb92 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049521.070748:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c2200/0xf4f48ce5e1bbfb92 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049521.071456:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6714c00/0xf4f48ce5e1bbfb99 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049521.071466:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6714c00/0xf4f48ce5e1bbfb99 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049521.071474:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6714c00/0xf4f48ce5e1bbfb99 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789049521.071484:0:5851:0:(mdt_handler.c:922:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:2.0:1789049521.071572:0:5851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c2000/0xf4f48ce5e1bbfb8b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049521.071580:0:5851:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c2000/0xf4f48ce5e1bbfb8b lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049521.071587:0:5851:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c2000/0xf4f48ce5e1bbfb8b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049521.071605:0:5851:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cb8c28c2000 already unused, calling callback (ffffffffc20ca4f0) 00010000:00010000:2.0:1789049521.071670:0:5851:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c2000/0xf4f48ce5e1bbfb8b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049521.071679:0:5851:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c2000/0xf4f48ce5e1bbfb8b lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049521.071692:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8cb8e0130100) 00010000:00010000:2.0:1789049521.071694:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789049521.071699:0:5851:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c2000/0xf4f48ce5e1bbfb8b lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049521.071706:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c2000/0xf4f48ce5e1bbfb8b lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049521.071721:0:5851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c2200/0xf4f48ce5e1bbfb92 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049521.071727:0:5851:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c2200/0xf4f48ce5e1bbfb92 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049521.071733:0:5851:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c2200/0xf4f48ce5e1bbfb92 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049521.071737:0:5851:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cb8c28c2200 already unused, calling callback (ffffffffc20ca4f0) 00010000:00010000:2.0:1789049521.071740:0:5851:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c2200/0xf4f48ce5e1bbfb92 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049521.071746:0:5851:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c2200/0xf4f48ce5e1bbfb92 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049521.071837:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8cb8c396d000) 00010000:00010000:2.0:1789049521.071839:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789049521.071925:0:5851:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c2200/0xf4f48ce5e1bbfb92 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049521.071933:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c2200/0xf4f48ce5e1bbfb92 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049521.071978:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c2c00/0xf4f48ce5e1bbfb84 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a3693 expref: 57 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049521.071992:0:5851:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6714c00/0xf4f48ce5e1bbfb99 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a3693 expref: 56 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049521.072000:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8cb8c687d300) 00010000:00010000:2.0:1789049521.072002:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789049521.072004:0:5851:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cb8d6714c00, rc 0) 00000100:00100000:2.0:1789049521.072073:0:5851:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb7c7139180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e823b53a-3591-475c-8624-c682227e5c13+56:11576:x1875954089679488:12345-192.168.206.26@tcp:101:lfs.0 Request processed in 1511us (1742us total) trans 4294967504 rc 0/0 00000100:00100000:2.0:1789049521.072081:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.26@tcp, seq: 204 00000100:00100000:1.0:1789049521.077019:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.26@tcp (source: 12345-192.168.206.26@tcp) 00000100:00100000:2.0:1789049521.077087:0:6841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954089679616 00000100:00100000:2.0:1789049521.077102:0:6841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954089679616 00000100:00100000:2.0:1789049521.077171:0:6841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.26@tcp, seq: 205 00000100:00100000:2.0:1789049521.077182:0:6841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb7c7144700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e823b53a-3591-475c-8624-c682227e5c13+56:11576:x1875954089679616:12345-192.168.206.26@tcp:54:lfs.0 00010000:00010000:2.0:1789049521.077245:0:6841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6715200/0xf4f48ce5e1bbfba7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049521.077271:0:6841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6715200/0xf4f48ce5e1bbfba7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049521.077296:0:6841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6715200/0xf4f48ce5e1bbfba7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049521.077323:0:6841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6715200/0xf4f48ce5e1bbfba7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049521.077329:0:6841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6715200/0xf4f48ce5e1bbfba7 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049521.077336:0:6841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6715200/0xf4f48ce5e1bbfba7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049521.077342:0:6841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cb8d6715200 already unused, calling callback (ffffffffc20ca4f0) 00010000:00010000:2.0:1789049521.077347:0:6841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6715200/0xf4f48ce5e1bbfba7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049521.077354:0:6841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6715200/0xf4f48ce5e1bbfba7 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049521.077364:0:6841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8cb8c687d300) 00010000:00010000:2.0:1789049521.077367:0:6841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1789049521.077371:0:6841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6715200/0xf4f48ce5e1bbfba7 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049521.077377:0:6841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6715200/0xf4f48ce5e1bbfba7 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6841 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789049521.077447:0:6841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb7c7144700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e823b53a-3591-475c-8624-c682227e5c13+56:11576:x1875954089679616:12345-192.168.206.26@tcp:54:lfs.0 Request processed in 267us (436us total) trans 0 rc 0/0 00000100:00100000:2.0:1789049521.077455:0:6841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.26@tcp, seq: 205 00000100:00100000:1.0:1789049521.082147:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.26@tcp (source: 12345-192.168.206.26@tcp) 00000100:00100000:2.0:1789049521.082270:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954089679872 00000100:00100000:2.0:1789049521.082296:0:5853:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954089679872 00000100:00100000:2.0:1789049521.082352:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.26@tcp, seq: 58 00000100:00100000:2.0:1789049521.082362:0:5853:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb7c7145500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e823b53a-3591-475c-8624-c682227e5c13+56:11576:x1875954089679872:12345-192.168.206.26@tcp:35:lfs.0 00000100:00100000:2.0:1789049521.082580:0:5853:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb7c7145500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e823b53a-3591-475c-8624-c682227e5c13+57:11576:x1875954089679872:12345-192.168.206.26@tcp:35:lfs.0 Request processed in 219us (447us total) trans 4294967505 rc 0/0 00000100:00100000:2.0:1789049521.082587:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.26@tcp, seq: 58 00000100:00100000:0.0:1789049521.197460:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.26@tcp (source: 12345-192.168.206.26@tcp) 00000100:00100000:3.0:1789049521.197572:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954089680128 00000100:00100000:3.0:1789049521.197582:0:5850:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954089680128 00000100:00100000:3.0:1789049521.197640:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.26@tcp, seq: 206 00000100:00100000:3.0:1789049521.198029:0:5850:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb7c7138380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e823b53a-3591-475c-8624-c682227e5c13+57:11586:x1875954089680128:12345-192.168.206.26@tcp:101:bash.0 00010000:00010000:3.0:1789049521.198052:0:5850:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789049521.198055:0:5850:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1789049521.198081:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c6b35400/0xf4f48ce5e1bbfb29 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a3677 expref: 57 pid: 6841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049521.198617:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8cb8e0130100) 00010000:00010000:3.0:1789049521.198623:0:5850:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789049521.198641:0:5850:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c6b35a00/0xf4f48ce5e1bbfbae lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7fc5e358805a369a expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049521.199090:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c6b34000/0xf4f48ce5e1bbfbb5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049521.199115:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c6b34000/0xf4f48ce5e1bbfbb5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049521.199126:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c6b34000/0xf4f48ce5e1bbfbb5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789049521.199148:0:5850:0:(mdt_handler.c:922:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:3.0:1789049521.199431:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c6b35a00/0xf4f48ce5e1bbfbae lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a369a expref: 59 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049521.199447:0:5850:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c6b34000/0xf4f48ce5e1bbfbb5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a369a expref: 58 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049521.199454:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8cb8c687d300) 00010000:00010000:3.0:1789049521.199456:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789049521.199470:0:5850:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cb8c6b34000, rc 0) 00000100:00100000:3.0:1789049521.199536:0:5850:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb7c7138380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e823b53a-3591-475c-8624-c682227e5c13+58:11586:x1875954089680128:12345-192.168.206.26@tcp:101:bash.0 Request processed in 1875us (2447us total) trans 4294967506 rc 0/0 00000100:00100000:3.0:1789049521.199544:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.26@tcp, seq: 206 00000100:00100000:0.0:1789049521.204607:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.26@tcp (source: 12345-192.168.206.26@tcp) 00000100:00100000:2.0:1789049521.205236:0:6841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954089680384 00000100:00100000:2.0:1789049521.205247:0:6841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954089680384 00000100:00100000:2.0:1789049521.205316:0:6841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.26@tcp, seq: 207 00000100:00100000:2.0:1789049521.205327:0:6841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8df260380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e823b53a-3591-475c-8624-c682227e5c13+58:11586:x1875954089680384:12345-192.168.206.26@tcp:36:bash.0 00010000:00010000:2.0:1789049521.205531:0:6841:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:2.0:1789049521.205558:0:6841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c6b34000/0xf4f48ce5e1bbfbb5 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a369a expref: 58 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049521.205580:0:6841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6714c00/0xf4f48ce5e1bbfb99 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a3693 expref: 57 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049521.205590:0:6841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8cb8c687d300) 00010000:00010000:2.0:1789049521.205595:0:6841:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789049521.205814:0:6841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6715200/0xf4f48ce5e1bbfbc3 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049521.205829:0:6841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6715200/0xf4f48ce5e1bbfbc3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049521.205838:0:6841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6715200/0xf4f48ce5e1bbfbc3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6841 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789049521.206131:0:6841:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967507 00000004:00010000:2.0:1789049521.206241:0:6841:0:(mdt_handler.c:4507:mdt_save_lock()) ### save lock request 00000000a3ed3161 reply state 0000000087a3f284 transno 4294967508 ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6715200/0xf4f48ce5e1bbfbc3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6841 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789049521.206249:0:6841:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1789049521.206578:0:6841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8df260380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e823b53a-3591-475c-8624-c682227e5c13+59:11586:x1875954089680384:12345-192.168.206.26@tcp:36:bash.0 Request processed in 1250us (1979us total) trans 4294967508 rc 0/0 00000100:00100000:2.0:1789049521.206586:0:6841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.26@tcp, seq: 207 00000020:00080000:2.0:1789049521.206591:0:6841:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1789049521.211109:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.26@tcp (source: 12345-192.168.206.26@tcp) 00000100:00100000:2.0:1789049521.211243:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954089680512 00000100:00100000:2.0:1789049521.211253:0:5851:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954089680512 00000100:00100000:2.0:1789049521.211315:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.26@tcp, seq: 208 00000100:00100000:2.0:1789049521.211326:0:5851:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb7c7145180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e823b53a-3591-475c-8624-c682227e5c13+59:11586:x1875954089680512:12345-192.168.206.26@tcp:101:bash.0 00010000:00010000:2.0:1789049521.211358:0:5851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789049521.211378:0:5851:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6714a00/0xf4f48ce5e1bbfbca lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7fc5e358805a36a1 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049521.211458:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6715c00/0xf4f48ce5e1bbfbd1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049521.211470:0:5851:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6715200/0xf4f48ce5e1bbfbc3 lrc: 2/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049521.211478:0:5851:0:(ldlm_resource.c:1751:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6715c00/0xf4f48ce5e1bbfbd1 lrc: 4/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049521.211496:0:5851:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6715200/0xf4f48ce5e1bbfbc3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 6841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049521.211506:0:5851:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6715c00/0xf4f48ce5e1bbfbd1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049521.213553:0:3295:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6715200/0xf4f48ce5e1bbfbc3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 6841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049521.213568:0:3295:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6715200/0xf4f48ce5e1bbfbc3 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 6841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049521.213575:0:3295:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6715200/0xf4f48ce5e1bbfbc3 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 6841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049521.213580:0:3295:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cb8d6715200 already unused, calling callback (ffffffffc20ca4f0) 00010000:00010000:3.0:1789049521.213584:0:3295:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6715200/0xf4f48ce5e1bbfbc3 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 6841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049521.213591:0:3295:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6715200/0xf4f48ce5e1bbfbc3 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 6841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049521.213605:0:3295:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8cb8c687d300) 00010000:00010000:3.0:1789049521.213608:0:3295:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789049521.213611:0:3295:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6715c00/0xf4f48ce5e1bbfbd1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049521.213620:0:3295:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6715c00/0xf4f48ce5e1bbfbd1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049521.213628:0:3295:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6715c00/0xf4f48ce5e1bbfbd1 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049521.213670:0:3295:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6715200/0xf4f48ce5e1bbfbc3 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 6841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049521.213689:0:3295:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6715200/0xf4f48ce5e1bbfbc3 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 6841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049521.213920:0:5851:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6715c00/0xf4f48ce5e1bbfbd1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049521.213929:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6715c00/0xf4f48ce5e1bbfbd1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789049521.213972:0:5851:0:(mdt_handler.c:922:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:2.0:1789049521.213977:0:5851:0:(mdt_handler.c:1587:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1789049521.213997:0:5851:0:(mdt_handler.c:2522:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6715c00/0xf4f48ce5e1bbfbd1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049521.214030:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6714a00/0xf4f48ce5e1bbfbca lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a36a1 expref: 60 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049521.214046:0:5851:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6715c00/0xf4f48ce5e1bbfbd1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a36a1 expref: 59 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049521.214053:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8cb8c687d300) 00010000:00010000:2.0:1789049521.214056:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789049521.214058:0:5851:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cb8d6715c00, rc 0) 00000100:00100000:2.0:1789049521.214126:0:5851:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb7c7145180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e823b53a-3591-475c-8624-c682227e5c13+59:11586:x1875954089680512:12345-192.168.206.26@tcp:101:bash.0 Request processed in 2801us (3034us total) trans 0 rc 0/0 00000100:00100000:2.0:1789049521.214135:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.26@tcp, seq: 208 00000100:00100000:0.0:1789049521.223378:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.26@tcp (source: 12345-192.168.206.26@tcp) 00000100:00100000:2.0:1789049521.223575:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954089680768 00000100:00100000:2.0:1789049521.223585:0:5853:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954089680768 00000100:00100000:2.0:1789049521.223641:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.26@tcp, seq: 59 00000100:00100000:2.0:1789049521.223651:0:5853:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8df284380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e823b53a-3591-475c-8624-c682227e5c13+59:11586:x1875954089680768:12345-192.168.206.26@tcp:35:bash.0 00000100:00100000:2.0:1789049521.223911:0:5853:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8df284380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e823b53a-3591-475c-8624-c682227e5c13+60:11586:x1875954089680768:12345-192.168.206.26@tcp:35:bash.0 Request processed in 261us (543us total) trans 4294967509 rc 0/0 00000100:00100000:2.0:1789049521.223930:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.26@tcp, seq: 59 00000100:00100000:0.0:1789049521.337823:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.26@tcp (source: 12345-192.168.206.26@tcp) 00000100:00100000:3.0:1789049521.339923:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954089680896 00000100:00100000:3.0:1789049521.339938:0:5852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954089680896 00000100:00100000:3.0:1789049521.340022:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.26@tcp, seq: 209 00000100:00100000:3.0:1789049521.340033:0:5852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8df284a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e823b53a-3591-475c-8624-c682227e5c13+60:11592:x1875954089680896:12345-192.168.206.26@tcp:101:lfs.0 00010000:00010000:3.0:1789049521.340058:0:5852:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789049521.340078:0:5852:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c6b35a00/0xf4f48ce5e1bbfbd8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7fc5e358805a36a8 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049521.340157:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c6b35400/0xf4f48ce5e1bbfbdf lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049521.340171:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c6b35400/0xf4f48ce5e1bbfbdf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049521.340183:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c6b35400/0xf4f48ce5e1bbfbdf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789049521.340225:0:5852:0:(mdt_handler.c:922:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00000004:00200000:3.0:1789049521.340229:0:5852:0:(mdt_handler.c:1587:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1789049521.340245:0:5852:0:(mdt_handler.c:2522:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c6b35400/0xf4f48ce5e1bbfbdf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049521.340267:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c6b35a00/0xf4f48ce5e1bbfbd8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a36a8 expref: 62 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049521.340285:0:5852:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c6b35400/0xf4f48ce5e1bbfbdf lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a36a8 expref: 61 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049521.340307:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8cb8e0130100) 00010000:00010000:3.0:1789049521.340310:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1789049521.340314:0:5852:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cb8c6b35400, rc 0) 00000100:00100000:3.0:1789049521.340712:0:5852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8df284a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e823b53a-3591-475c-8624-c682227e5c13+61:11592:x1875954089680896:12345-192.168.206.26@tcp:101:lfs.0 Request processed in 680us (3390us total) trans 0 rc 0/0 00000100:00100000:3.0:1789049521.340720:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.26@tcp, seq: 209 00000100:00100000:0.0:1789049521.343625:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.26@tcp (source: 12345-192.168.206.26@tcp) 00000100:00100000:3.0:1789049521.347019:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954089681024 00000100:00100000:3.0:1789049521.347044:0:5850:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954089681024 00000100:00100000:3.0:1789049521.347112:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.26@tcp, seq: 210 00000100:00100000:3.0:1789049521.347122:0:5850:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8f7b92680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e823b53a-3591-475c-8624-c682227e5c13+61:11592:x1875954089681024:12345-192.168.206.26@tcp:101:lfs.0 00010000:00010000:3.0:1789049521.347141:0:5850:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789049521.347158:0:5850:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c6b35a00/0xf4f48ce5e1bbfbe6 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7fc5e358805a36af expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049521.347223:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c6b35800/0xf4f48ce5e1bbfbed lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049521.347237:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c6b35800/0xf4f48ce5e1bbfbed lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049521.347248:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c6b35800/0xf4f48ce5e1bbfbed lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049521.347261:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c6b34200/0xf4f48ce5e1bbfbf4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049521.347268:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c6b34200/0xf4f48ce5e1bbfbf4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049521.347293:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c6b34200/0xf4f48ce5e1bbfbf4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049521.348018:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c6b35e00/0xf4f48ce5e1bbfbfb lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049521.348042:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c6b35e00/0xf4f48ce5e1bbfbfb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049521.348050:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c6b35e00/0xf4f48ce5e1bbfbfb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789049521.348084:0:5850:0:(mdt_handler.c:922:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:3.0:1789049521.348087:0:5850:0:(mdt_handler.c:1587:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1789049521.348105:0:5850:0:(mdt_handler.c:2522:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c6b35e00/0xf4f48ce5e1bbfbfb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049521.348116:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c6b35e00/0xf4f48ce5e1bbfbfb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049521.348125:0:5850:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c6b35800/0xf4f48ce5e1bbfbed lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049521.348132:0:5850:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c6b35800/0xf4f48ce5e1bbfbed lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049521.348138:0:5850:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c6b35800/0xf4f48ce5e1bbfbed lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049521.348143:0:5850:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cb8c6b35800 already unused, calling callback (ffffffffc20ca4f0) 00010000:00010000:3.0:1789049521.348147:0:5850:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c6b35800/0xf4f48ce5e1bbfbed lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049521.348163:0:5850:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c6b35800/0xf4f48ce5e1bbfbed lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049521.348175:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8cb8e0130100) 00010000:00010000:3.0:1789049521.348178:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789049521.348182:0:5850:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c6b35800/0xf4f48ce5e1bbfbed lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049521.348197:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c6b35800/0xf4f48ce5e1bbfbed lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049521.348210:0:5850:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c6b34200/0xf4f48ce5e1bbfbf4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049521.348215:0:5850:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c6b34200/0xf4f48ce5e1bbfbf4 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049521.348220:0:5850:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c6b34200/0xf4f48ce5e1bbfbf4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049521.348226:0:5850:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cb8c6b34200 already unused, calling callback (ffffffffc20ca4f0) 00010000:00010000:3.0:1789049521.348229:0:5850:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c6b34200/0xf4f48ce5e1bbfbf4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049521.348235:0:5850:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c6b34200/0xf4f48ce5e1bbfbf4 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049521.348242:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8cb8c687d400) 00010000:00010000:3.0:1789049521.348245:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789049521.348248:0:5850:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c6b34200/0xf4f48ce5e1bbfbf4 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049521.348262:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c6b34200/0xf4f48ce5e1bbfbf4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049521.348293:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c6b35a00/0xf4f48ce5e1bbfbe6 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a36af expref: 63 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049521.348304:0:5850:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c6b35e00/0xf4f48ce5e1bbfbfb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a36af expref: 62 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049521.348311:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8cb8c687d300) 00010000:00010000:3.0:1789049521.348313:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789049521.348315:0:5850:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cb8c6b35e00, rc 0) 00000100:00100000:3.0:1789049521.348395:0:5850:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8f7b92680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e823b53a-3591-475c-8624-c682227e5c13+62:11592:x1875954089681024:12345-192.168.206.26@tcp:101:lfs.0 Request processed in 1273us (4778us total) trans 0 rc 0/0 00000100:00100000:3.0:1789049521.348403:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.26@tcp, seq: 210 00000100:00100000:0.0:1789049521.356596:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.26@tcp (source: 12345-192.168.206.26@tcp) 00000100:00100000:1.0:1789049521.356692:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954089681152 00000100:00100000:1.0:1789049521.356702:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954089681152 00000100:00100000:1.0:1789049521.356780:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.26@tcp, seq: 15 00000100:00100000:1.0:1789049521.356800:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8f7b93b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e823b53a-3591-475c-8624-c682227e5c13+62:2355:x1875954089681152:12345-192.168.206.26@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789049521.356817:0:5835:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789049521.356863:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c6b35e00/0xf4f48ce5e1bbfbfb lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a36af expref: 62 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049521.356881:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8cb8c687d300) 00010000:00010000:1.0:1789049521.356885:0:5835:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789049521.356940:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8f7b93b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e823b53a-3591-475c-8624-c682227e5c13+61:2355:x1875954089681152:12345-192.168.206.26@tcp:103:ldlm_bl.0 Request processed in 142us (353us total) trans 0 rc 0/0 00000100:00100000:1.0:1789049521.356946:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.26@tcp, seq: 15 00000100:00100000:1.0:1789049521.358601:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.26@tcp (source: 12345-192.168.206.26@tcp) 00000100:00100000:3.0:1789049521.358706:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954089681408 00000100:00100000:3.0:1789049521.358717:0:5852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954089681408 00000100:00100000:3.0:1789049521.358796:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.26@tcp, seq: 211 00000100:00100000:3.0:1789049521.358809:0:5852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb7c7147800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e823b53a-3591-475c-8624-c682227e5c13+61:11592:x1875954089681408:12345-192.168.206.26@tcp:101:lfs.0 00010000:00010000:3.0:1789049521.358834:0:5852:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789049521.358910:0:5852:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c6b35a00/0xf4f48ce5e1bbfc02 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7fc5e358805a36b6 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049521.359405:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6714a00/0xf4f48ce5e1bbfc09 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049521.359429:0:5852:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6715c00/0xf4f48ce5e1bbfbd1 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a36a1 expref: 62 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049521.359439:0:5852:0:(ldlm_resource.c:1751:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6714a00/0xf4f48ce5e1bbfc09 lrc: 4/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049521.359479:0:5852:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6715c00/0xf4f48ce5e1bbfbd1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a36a1 expref: 62 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049521.359495:0:5852:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6715c00/0xf4f48ce5e1bbfbd1 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a36a1 expref: 62 pid: 5851 timeout: 447 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789049521.359514:0:5852:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb900e95f80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5852:1875954110637440:192.168.206.26@tcp:104: 00000100:00100000:2.0:1789049521.359611:0:5852:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cb8fc9b6780 going to sleep for 11 seconds 00000100:00100000:0.0:1789049521.369616:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.26@tcp (source: 12345-192.168.206.26@tcp) 00000100:00100000:1.0:1789049521.369767:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954089681536 00000100:00100000:1.0:1789049521.369781:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954089681536 00010000:00010000:1.0:1789049521.369874:0:5837:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6715c00/0xf4f48ce5e1bbfbd1 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a36a1 expref: 63 pid: 5851 timeout: 447 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789049521.369925:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.26@tcp, seq: 77 00000100:00100000:1.0:1789049521.369938:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8f7b90380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e823b53a-3591-475c-8624-c682227e5c13+63:2357:x1875954089681536:12345-192.168.206.26@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789049521.369956:0:5837:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789049521.369963:0:5837:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6715c00/0xf4f48ce5e1bbfbd1 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a36a1 expref: 63 pid: 5851 timeout: 447 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049521.369979:0:5837:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6715c00/0xf4f48ce5e1bbfbd1 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a36a1 expref: 63 pid: 5851 timeout: 447 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049521.370031:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8cb8c687d300) 00010000:00010000:1.0:1789049521.370037:0:5837:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6714a00/0xf4f48ce5e1bbfc09 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049521.370048:0:5837:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6714a00/0xf4f48ce5e1bbfc09 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049521.370056:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6714a00/0xf4f48ce5e1bbfc09 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049521.370081:0:5837:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789049521.370169:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8f7b90380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e823b53a-3591-475c-8624-c682227e5c13+63:2357:x1875954089681536:12345-192.168.206.26@tcp:103:ldlm_bl.0 Request processed in 233us (565us total) trans 0 rc 0/0 00000100:00100000:1.0:1789049521.370177:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.26@tcp, seq: 77 00010000:00010000:2.0:1789049521.370494:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6715c00/0xf4f48ce5e1bbfbd1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a36a1 expref: 62 pid: 5851 timeout: 447 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789049521.370512:0:5852:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb900e95f80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5852:1875954110637440:192.168.206.26@tcp:104: 00010000:00010000:2.0:1789049521.370541:0:5852:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6714a00/0xf4f48ce5e1bbfc09 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049521.370551:0:5852:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6714a00/0xf4f48ce5e1bbfc09 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049521.370569:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6714a00/0xf4f48ce5e1bbfc09 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789049521.370596:0:5852:0:(mdt_handler.c:922:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:2.0:1789049521.370781:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c6b35a00/0xf4f48ce5e1bbfc02 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a36b6 expref: 63 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049521.370808:0:5852:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6714a00/0xf4f48ce5e1bbfc09 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a36b6 expref: 62 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049521.370816:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8cb8c687d300) 00010000:00010000:2.0:1789049521.370819:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1789049521.370822:0:5852:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cb8d6714a00, rc 0) 00000100:00100000:2.0:1789049521.370922:0:5852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb7c7147800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e823b53a-3591-475c-8624-c682227e5c13+62:11592:x1875954089681408:12345-192.168.206.26@tcp:101:lfs.0 Request processed in 12115us (12333us total) trans 4294967510 rc 0/0 00000100:00100000:2.0:1789049521.370931:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.26@tcp, seq: 211 00000100:00100000:0.0:1789049521.376139:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.26@tcp (source: 12345-192.168.206.26@tcp) 00000100:00100000:1.0:1789049521.376250:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954089681792 00000100:00100000:1.0:1789049521.376265:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954089681792 00000100:00100000:1.0:1789049521.376350:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.26@tcp, seq: 16 00000100:00100000:1.0:1789049521.376361:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8f7b92300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e823b53a-3591-475c-8624-c682227e5c13+62:11592:x1875954089681792:12345-192.168.206.26@tcp:103:lfs.0 00010000:00010000:1.0:1789049521.376380:0:5835:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789049521.376411:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c6b34e00/0xf4f48ce5e1bbfb68 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a368c expref: 62 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049521.376432:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8cb8c687d300) 00010000:00010000:1.0:1789049521.376437:0:5835:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789049521.376509:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8f7b92300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e823b53a-3591-475c-8624-c682227e5c13+61:11592:x1875954089681792:12345-192.168.206.26@tcp:103:lfs.0 Request processed in 149us (386us total) trans 0 rc 0/0 00000100:00100000:1.0:1789049521.376517:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.26@tcp, seq: 16 00000100:00100000:0.0:1789049521.386531:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.26@tcp (source: 12345-192.168.206.26@tcp) 00000100:00100000:2.0:1789049521.386650:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954089681920 00000100:00100000:2.0:1789049521.386663:0:5851:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954089681920 00000100:00100000:2.0:1789049521.386737:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.26@tcp, seq: 212 00000100:00100000:2.0:1789049521.386749:0:5851:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8f7b92a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e823b53a-3591-475c-8624-c682227e5c13+61:11592:x1875954089681920:12345-192.168.206.26@tcp:58:lfs.0 00010000:00010000:2.0:1789049521.386944:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6715c00/0xf4f48ce5e1bbfc17 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049521.386966:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6715c00/0xf4f48ce5e1bbfc17 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049521.386981:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6715c00/0xf4f48ce5e1bbfc17 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1789049521.387461:0:5851:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].5, 136 off8872 00000100:00100000:2.0:1789049521.387579:0:5851:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8f7b92a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e823b53a-3591-475c-8624-c682227e5c13+61:11592:x1875954089681920:12345-192.168.206.26@tcp:58:lfs.0 Request processed in 827us (1057us total) trans 0 rc 0/0 00000100:00100000:2.0:1789049521.387591:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.26@tcp, seq: 212 00000100:00100000:0.0:1789049521.392380:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.26@tcp (source: 12345-192.168.206.26@tcp) 00000100:00100000:2.0:1789049521.392638:0:6841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954089682048 00000100:00100000:2.0:1789049521.392652:0:6841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954089682048 00000100:00100000:2.0:1789049521.392739:0:6841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.26@tcp, seq: 213 00000100:00100000:2.0:1789049521.392751:0:6841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8f7b93480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e823b53a-3591-475c-8624-c682227e5c13+61:11592:x1875954089682048:12345-192.168.206.26@tcp:101:lfs.0 00010000:00010000:2.0:1789049521.392779:0:6841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789049521.392824:0:6841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6714c00/0xf4f48ce5e1bbfc1e lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7fc5e358805a36bd expref: -99 pid: 6841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049521.392949:0:6841:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6715c00/0xf4f48ce5e1bbfc17 lrc: 2/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049521.392961:0:6841:0:(ldlm_resource.c:1751:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6714c00/0xf4f48ce5e1bbfc1e lrc: 4/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a36bd expref: 62 pid: 6841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049521.392984:0:6841:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6715c00/0xf4f48ce5e1bbfc17 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049521.393003:0:6841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6714c00/0xf4f48ce5e1bbfc1e lrc: 3/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a36bd expref: 62 pid: 6841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049521.393018:0:6841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8cb8c687d300) 00010000:00010000:2.0:1789049521.393021:0:6841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1789049521.393026:0:6841:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6714c00/0xf4f48ce5e1bbfc1e lrc: 3/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a36bd expref: 62 pid: 6841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049521.393052:0:6841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cb8d6714c00, rc 0) 00000100:00100000:2.0:1789049521.393137:0:6841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8f7b93480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e823b53a-3591-475c-8624-c682227e5c13+62:11592:x1875954089682048:12345-192.168.206.26@tcp:101:lfs.0 Request processed in 388us (771us total) trans 0 rc 0/0 00000100:00100000:2.0:1789049521.395429:0:6841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.26@tcp, seq: 213 00000004:00080000:2.0:1789049521.564862:0:6840:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 347617014666ns, next at 348616995399ns, rc = 0 00000100:00100000:3.0:1789049521.565126:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb900e95f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3311:1875954110637568:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789049521.565248:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789049521.565520:0:6707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954110637568 00000100:00100000:1.0:1789049521.565531:0:6707:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954110637568 00000100:00100000:1.0:1789049521.565631:0:6707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1789049521.565643:0:6707:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8c12aa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3311:x1875954110637568:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789049521.565711:0:6707:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789049521.565772:0:6707:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8c12aa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3311:x1875954110637568:12345-0@lo:13:osp-pre-0-0.0 Request processed in 131us (524us total) trans 0 rc 0/0 00000100:00100000:1.0:1789049521.565781:0:6707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00080000:3.0:1789049521.566418:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789049521.566492:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb900e95f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3311:1875954110637568:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1789049521.883181:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1789049522.139438:0:11704:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1789049522.139452:0:11704:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1789049522.139500:0:11704:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 6 count 3 00000040:00080000:0.0:1789049522.139509:0:11704:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1789049522.139677:0:11704:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb8f7b91c00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11704:1875954110637696:192.168.206.26@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1789049522.139829:0:11704:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cb8c799f240 going to sleep for 11 seconds 00000100:00100000:3.0:1789049522.142950:0:11704:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb8f7b91c00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11704:1875954110637696:192.168.206.26@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1789049522.157123:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.26@tcp (source: 12345-192.168.206.26@tcp) 00000100:00100000:2.0:1789049522.157800:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954089682176 00000100:00100000:2.0:1789049522.157817:0:5851:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954089682176 00000100:00100000:2.0:1789049522.157967:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.26@tcp, seq: 214 00000100:00100000:2.0:1789049522.157979:0:5851:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8c12aa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e823b53a-3591-475c-8624-c682227e5c13+62:11593:x1875954089682176:12345-192.168.206.26@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1789049522.158022:0:5851:0:(mdt_handler.c:7990:mdt_fid2path()) path get [0x200000401:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1789049522.158184:0:5851:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8c12aa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e823b53a-3591-475c-8624-c682227e5c13+62:11593:x1875954089682176:12345-192.168.206.26@tcp:53:lhsmtool_posix.0 Request processed in 207us (1070us total) trans 0 rc 0/0 00000100:00100000:2.0:1789049522.158192:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.26@tcp, seq: 214 00000100:00100000:0.0:1789049522.182006:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.26@tcp (source: 12345-192.168.206.26@tcp) 00000100:00100000:2.0:1789049522.182107:0:6841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954089682304 00000100:00100000:2.0:1789049522.182121:0:6841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954089682304 00000100:00100000:2.0:1789049522.182201:0:6841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.26@tcp, seq: 215 00000100:00100000:2.0:1789049522.182213:0:6841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8f7b90a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e823b53a-3591-475c-8624-c682227e5c13+62:11593:x1875954089682304:12345-192.168.206.26@tcp:34:lhsmtool_posix.0 00010000:00010000:2.0:1789049522.182314:0:6841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6715a00/0xf4f48ce5e1bbfc25 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049522.182336:0:6841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6715a00/0xf4f48ce5e1bbfc25 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049522.182353:0:6841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6715a00/0xf4f48ce5e1bbfc25 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049522.182397:0:6841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6715200/0xf4f48ce5e1bbfc2c lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049522.182404:0:6841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6715200/0xf4f48ce5e1bbfc2c lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049522.182411:0:6841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6715200/0xf4f48ce5e1bbfc2c lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049522.182444:0:6841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d776e200/0xf4f48ce5e1bbfc33 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049522.182455:0:6841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d776e200/0xf4f48ce5e1bbfc33 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049522.182461:0:6841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d776e200/0xf4f48ce5e1bbfc33 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6841 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789049522.182512:0:6841:0:(mdt_handler.c:922:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:2.0:1789049522.182517:0:6841:0:(mdt_handler.c:1587:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1789049522.182533:0:6841:0:(mdt_handler.c:2522:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d776e200/0xf4f48ce5e1bbfc33 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049522.182545:0:6841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6715a00/0xf4f48ce5e1bbfc25 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049522.182552:0:6841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6715a00/0xf4f48ce5e1bbfc25 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049522.182559:0:6841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6715a00/0xf4f48ce5e1bbfc25 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049522.182576:0:6841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cb8d6715a00 already unused, calling callback (ffffffffc20ca4f0) 00010000:00010000:2.0:1789049522.182581:0:6841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6715a00/0xf4f48ce5e1bbfc25 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049522.182589:0:6841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6715a00/0xf4f48ce5e1bbfc25 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049522.182605:0:6841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8cb8e0130a00) 00010000:00010000:2.0:1789049522.182608:0:6841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789049522.182614:0:6841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6715a00/0xf4f48ce5e1bbfc25 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049522.182621:0:6841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6715a00/0xf4f48ce5e1bbfc25 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049522.182639:0:6841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6715200/0xf4f48ce5e1bbfc2c lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049522.182645:0:6841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6715200/0xf4f48ce5e1bbfc2c lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049522.182652:0:6841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6715200/0xf4f48ce5e1bbfc2c lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049522.182658:0:6841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cb8d6715200 already unused, calling callback (ffffffffc20ca4f0) 00010000:00010000:2.0:1789049522.182660:0:6841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6715200/0xf4f48ce5e1bbfc2c lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049522.182666:0:6841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6715200/0xf4f48ce5e1bbfc2c lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049522.182685:0:6841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0xafd4eada (ffff8cb8e0130300) 00010000:00010000:2.0:1789049522.182688:0:6841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789049522.182691:0:6841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6715200/0xf4f48ce5e1bbfc2c lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049522.182698:0:6841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6715200/0xf4f48ce5e1bbfc2c lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049522.182716:0:6841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d776e200/0xf4f48ce5e1bbfc33 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049522.182723:0:6841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d776e200/0xf4f48ce5e1bbfc33 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049522.182728:0:6841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d776e200/0xf4f48ce5e1bbfc33 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049522.182734:0:6841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cb8d776e200 already unused, calling callback (ffffffffc20ca4f0) 00010000:00010000:2.0:1789049522.182737:0:6841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d776e200/0xf4f48ce5e1bbfc33 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049522.182743:0:6841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d776e200/0xf4f48ce5e1bbfc33 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049522.182751:0:6841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8cb8c687d300) 00010000:00010000:2.0:1789049522.182753:0:6841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789049522.182756:0:6841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d776e200/0xf4f48ce5e1bbfc33 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049522.182763:0:6841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d776e200/0xf4f48ce5e1bbfc33 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6841 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789049522.182941:0:6841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8f7b90a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e823b53a-3591-475c-8624-c682227e5c13+62:11593:x1875954089682304:12345-192.168.206.26@tcp:34:lhsmtool_posix.0 Request processed in 728us (950us total) trans 0 rc 0/0 00000100:00100000:2.0:1789049522.182950:0:6841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.26@tcp, seq: 215 00000100:00100000:1.0:1789049522.208273:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.26@tcp (source: 12345-192.168.206.26@tcp) 00000100:00100000:2.0:1789049522.208499:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954089682560 00000100:00100000:2.0:1789049522.208512:0:5851:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954089682560 00000100:00100000:2.0:1789049522.208605:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.26@tcp, seq: 216 00000100:00100000:2.0:1789049522.208618:0:5851:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb7c7146300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e823b53a-3591-475c-8624-c682227e5c13+62:11593:x1875954089682560:12345-192.168.206.26@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789049522.208650:0:5851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789049522.208681:0:5851:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d776e200/0xf4f48ce5e1bbfc3a lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7fc5e358805a36c4 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049522.208832:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6715200/0xf4f48ce5e1bbfc41 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049522.208899:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6715200/0xf4f48ce5e1bbfc41 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049522.208913:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6715200/0xf4f48ce5e1bbfc41 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789049522.208928:0:5851:0:(mdt_handler.c:922:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:2.0:1789049522.209062:0:5851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6715200/0xf4f48ce5e1bbfc41 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049522.209071:0:5851:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6715200/0xf4f48ce5e1bbfc41 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049522.209077:0:5851:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6715200/0xf4f48ce5e1bbfc41 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049522.209106:0:5851:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cb8d6715200 already unused, calling callback (ffffffffc20ca4f0) 00010000:00010000:2.0:1789049522.209111:0:5851:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6715200/0xf4f48ce5e1bbfc41 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049522.209119:0:5851:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6715200/0xf4f48ce5e1bbfc41 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049522.209133:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8cb8c687d300) 00010000:00010000:2.0:1789049522.209137:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1789049522.209143:0:5851:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6715200/0xf4f48ce5e1bbfc41 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049522.209148:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6715200/0xf4f48ce5e1bbfc41 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049522.209204:0:5851:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d776e200/0xf4f48ce5e1bbfc3a lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a36c4 expref: 64 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049522.209215:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8cb8e0130a00) 00010000:00010000:2.0:1789049522.209217:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1789049522.209221:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d776e200/0xf4f48ce5e1bbfc3a lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a36c4 expref: 64 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049522.209233:0:5851:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cb8d776e200, rc 0) 00000100:00100000:2.0:1789049522.209310:0:5851:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb7c7146300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e823b53a-3591-475c-8624-c682227e5c13+63:11593:x1875954089682560:12345-192.168.206.26@tcp:101:lhsmtool_posix.0 Request processed in 694us (1050us total) trans 4294967511 rc 301/301 00000100:00100000:2.0:1789049522.209319:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.26@tcp, seq: 216 00000100:00100000:3.0:1789049522.221262:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.26@tcp (source: 12345-192.168.206.26@tcp) 00000100:00100000:0.0:1789049522.222180:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954089682688 00000100:00100000:0.0:1789049522.222198:0:5852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954089682688 00000100:00100000:0.0:1789049522.222279:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.26@tcp, seq: 217 00000100:00100000:0.0:1789049522.222291:0:5852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8c12a8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e823b53a-3591-475c-8624-c682227e5c13+63:11593:x1875954089682688:12345-192.168.206.26@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1789049522.222337:0:5852:0:(mdt_handler.c:7990:mdt_fid2path()) path get [0x200000401:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1789049522.222471:0:5852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8c12a8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e823b53a-3591-475c-8624-c682227e5c13+63:11593:x1875954089682688:12345-192.168.206.26@tcp:53:lhsmtool_posix.0 Request processed in 181us (1215us total) trans 0 rc 0/0 00000100:00100000:0.0:1789049522.222499:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.26@tcp, seq: 217 00000100:00100000:0.0:1789049522.228141:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.26@tcp (source: 12345-192.168.206.26@tcp) 00000100:00100000:2.0:1789049522.228330:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954089682944 00000100:00100000:2.0:1789049522.228362:0:5851:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954089682944 00000100:00100000:2.0:1789049522.228436:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.26@tcp, seq: 218 00000100:00100000:2.0:1789049522.228449:0:5851:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8f7b90e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e823b53a-3591-475c-8624-c682227e5c13+63:11593:x1875954089682944:12345-192.168.206.26@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789049522.228480:0:5851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789049522.228484:0:5851:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1789049522.228522:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c6b35400/0xf4f48ce5e1bbfbdf lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a36a8 expref: 63 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049522.228546:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8cb8e0130100) 00010000:00010000:2.0:1789049522.228565:0:5851:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789049522.228581:0:5851:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6715200/0xf4f48ce5e1bbfc4f lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7fc5e358805a36cb expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1789049522.229320:0:5851:0:(osp_object.c:1667:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x6:0x0], index 0: 0 00010000:00010000:2.0:1789049522.229954:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6715a00/0xf4f48ce5e1bbfc56 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049522.229976:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6715a00/0xf4f48ce5e1bbfc56 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049522.229991:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6715a00/0xf4f48ce5e1bbfc56 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049522.230836:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6715200/0xf4f48ce5e1bbfc4f lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a36cb expref: 65 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049522.230913:0:5851:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6715a00/0xf4f48ce5e1bbfc56 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a36cb expref: 64 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049522.230950:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff8cb8e0130300) 00010000:00010000:2.0:1789049522.230953:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789049522.230957:0:5851:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cb8d6715a00, rc 0) 00000100:00100000:2.0:1789049522.231215:0:5851:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8f7b90e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e823b53a-3591-475c-8624-c682227e5c13+64:11593:x1875954089682944:12345-192.168.206.26@tcp:101:lhsmtool_posix.0 Request processed in 2767us (3086us total) trans 4294967512 rc 0/0 00000100:00100000:2.0:1789049522.231237:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.26@tcp, seq: 218 00000100:00100000:1.0:1789049522.240424:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.26@tcp (source: 12345-192.168.206.26@tcp) 00000100:00100000:0.0:1789049522.240679:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954089683200 00000100:00100000:0.0:1789049522.240705:0:5852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954089683200 00000100:00100000:0.0:1789049522.240797:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.26@tcp, seq: 219 00000100:00100000:0.0:1789049522.240810:0:5852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb7c7145c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e823b53a-3591-475c-8624-c682227e5c13+64:11593:x1875954089683200:12345-192.168.206.26@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1789049522.240926:0:5852:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789049522.240960:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6715a00/0xf4f48ce5e1bbfc56 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a36cb expref: 64 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049522.240987:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff8cb8e0130300) 00010000:00010000:0.0:1789049522.241000:0:5852:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789049522.241028:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb7c4c39a00/0xf4f48ce5e1bbfc64 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049522.241057:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cb7c4c39a00/0xf4f48ce5e1bbfc64 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049522.241069:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb7c4c39a00/0xf4f48ce5e1bbfc64 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049522.241088:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb7c4c38800/0xf4f48ce5e1bbfc6b lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0xaff7aec4 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049522.241095:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cb7c4c38800/0xf4f48ce5e1bbfc6b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0xaff7aec4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049522.241102:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb7c4c38800/0xf4f48ce5e1bbfc6b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0xaff7aec4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049522.241202:0:5852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb7c4c39a00/0xf4f48ce5e1bbfc64 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049522.241210:0:5852:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cb7c4c39a00/0xf4f48ce5e1bbfc64 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049522.241216:0:5852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cb7c4c39a00/0xf4f48ce5e1bbfc64 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049522.241222:0:5852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cb7c4c39a00 already unused, calling callback (ffffffffc20ca4f0) 00010000:00010000:0.0:1789049522.241227:0:5852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb7c4c39a00/0xf4f48ce5e1bbfc64 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049522.241235:0:5852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb7c4c39a00/0xf4f48ce5e1bbfc64 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049522.241244:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8cb8e0130100) 00010000:00010000:0.0:1789049522.241247:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789049522.241251:0:5852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cb7c4c39a00/0xf4f48ce5e1bbfc64 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049522.241258:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb7c4c39a00/0xf4f48ce5e1bbfc64 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049522.241267:0:5852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb7c4c38800/0xf4f48ce5e1bbfc6b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0xaff7aec4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049522.241274:0:5852:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cb7c4c38800/0xf4f48ce5e1bbfc6b lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0xaff7aec4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049522.241279:0:5852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cb7c4c38800/0xf4f48ce5e1bbfc6b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0xaff7aec4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049522.241291:0:5852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cb7c4c38800 already unused, calling callback (ffffffffc20ca4f0) 00010000:00010000:0.0:1789049522.241294:0:5852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb7c4c38800/0xf4f48ce5e1bbfc6b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0xaff7aec4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049522.241301:0:5852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb7c4c38800/0xf4f48ce5e1bbfc6b lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0xaff7aec4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049522.241309:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0xaff7aec4 (ffff8cb8ce751900) 00010000:00010000:0.0:1789049522.241311:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789049522.241314:0:5852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cb7c4c38800/0xf4f48ce5e1bbfc6b lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0xaff7aec4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049522.241319:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb7c4c38800/0xf4f48ce5e1bbfc6b lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0xaff7aec4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789049522.241416:0:5852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb7c7145c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e823b53a-3591-475c-8624-c682227e5c13+63:11593:x1875954089683200:12345-192.168.206.26@tcp:36:lhsmtool_posix.0 Request processed in 608us (999us total) trans 0 rc -2/-2 00000100:00100000:0.0:1789049522.241424:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.26@tcp, seq: 219 00000100:00100000:3.0:1789049522.248645:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.26@tcp (source: 12345-192.168.206.26@tcp) 00000100:00100000:0.0:1789049522.248728:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954089683328 00000100:00100000:0.0:1789049522.248737:0:5850:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954089683328 00000100:00100000:0.0:1789049522.248798:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.26@tcp, seq: 220 00000100:00100000:0.0:1789049522.248808:0:5850:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8f7acb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e823b53a-3591-475c-8624-c682227e5c13+63:11593:x1875954089683328:12345-192.168.206.26@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789049522.248828:0:5850:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789049522.248886:0:5850:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb7c4c38800/0xf4f48ce5e1bbfc72 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7fc5e358805a36d2 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049522.248924:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb7c4c39a00/0xf4f48ce5e1bbfc79 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049522.248953:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cb7c4c39a00/0xf4f48ce5e1bbfc79 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049522.248965:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb7c4c39a00/0xf4f48ce5e1bbfc79 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049522.249056:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb7c4c38800/0xf4f48ce5e1bbfc72 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a36d2 expref: 65 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049522.249073:0:5850:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb7c4c39a00/0xf4f48ce5e1bbfc79 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a36d2 expref: 64 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049522.249081:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff8cb8ce751900) 00010000:00010000:0.0:1789049522.249084:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1789049522.249087:0:5850:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cb7c4c39a00, rc 0) 00000100:00100000:0.0:1789049522.249147:0:5850:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8f7acb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e823b53a-3591-475c-8624-c682227e5c13+64:11593:x1875954089683328:12345-192.168.206.26@tcp:101:lhsmtool_posix.0 Request processed in 340us (509us total) trans 0 rc 0/0 00000100:00100000:0.0:1789049522.249154:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.26@tcp, seq: 220 00000100:00100000:1.0:1789049522.269034:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.26@tcp (source: 12345-192.168.206.26@tcp) 00000100:00100000:0.0:1789049522.269124:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954089683584 00000100:00100000:0.0:1789049522.269138:0:5852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954089683584 00000100:00100000:0.0:1789049522.269192:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.26@tcp, seq: 221 00000100:00100000:0.0:1789049522.269222:0:5852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb7c7147480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e823b53a-3591-475c-8624-c682227e5c13+64:11593:x1875954089683584:12345-192.168.206.26@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1789049522.269304:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb7c4c38800/0xf4f48ce5e1bbfc80 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049522.269321:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cb7c4c38800/0xf4f48ce5e1bbfc80 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049522.269360:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb7c4c38800/0xf4f48ce5e1bbfc80 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1789049522.269594:0:5852:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].8, 88 off8800 00000004:00010000:0.0:1789049522.269673:0:5852:0:(mdt_handler.c:4507:mdt_save_lock()) ### save lock request 00000000c90877d2 reply state 0000000018d193a5 transno 4294967513 ns: mdt-lustre-MDT0000_UUID lock: ffff8cb7c4c38800/0xf4f48ce5e1bbfc80 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789049522.269683:0:5852:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1789049522.269771:0:5852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb7c7147480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e823b53a-3591-475c-8624-c682227e5c13+66:11593:x1875954089683584:12345-192.168.206.26@tcp:36:lhsmtool_posix.0 Request processed in 560us (744us total) trans 4294967513 rc 0/0 00000100:00100000:0.0:1789049522.269778:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.26@tcp, seq: 221 00010000:00010000:3.0:1789049522.271991:0:3294:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb7c4c38800/0xf4f48ce5e1bbfc80 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049522.272006:0:3294:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cb7c4c38800/0xf4f48ce5e1bbfc80 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049522.272013:0:3294:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cb7c4c38800/0xf4f48ce5e1bbfc80 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049522.272019:0:3294:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cb7c4c38800 already unused, calling callback (ffffffffc20ca4f0) 00010000:00010000:3.0:1789049522.272024:0:3294:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb7c4c38800/0xf4f48ce5e1bbfc80 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049522.272030:0:3294:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb7c4c38800/0xf4f48ce5e1bbfc80 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049522.272044:0:3294:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff8cb8ce751900) 00010000:00010000:3.0:1789049522.272047:0:3294:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1789049522.272051:0:3294:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cb7c4c38800/0xf4f48ce5e1bbfc80 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049522.272057:0:3294:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb7c4c38800/0xf4f48ce5e1bbfc80 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789049522.273135:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.26@tcp (source: 12345-192.168.206.26@tcp) 00000100:00100000:2.0:1789049522.273246:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954089683712 00000100:00100000:2.0:1789049522.273264:0:5851:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954089683712 00000100:00100000:2.0:1789049522.273359:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.26@tcp, seq: 222 00000100:00100000:2.0:1789049522.273372:0:5851:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb7c7147b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e823b53a-3591-475c-8624-c682227e5c13+65:11593:x1875954089683712:12345-192.168.206.26@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789049522.273402:0:5851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789049522.273427:0:5851:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6715200/0xf4f48ce5e1bbfc87 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7fc5e358805a36d9 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049522.273504:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6715200/0xf4f48ce5e1bbfc87 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a36d9 expref: 66 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049522.273522:0:5851:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6715200/0xf4f48ce5e1bbfc87 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a36d9 expref: 66 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049522.273545:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff8cb8ce751900) 00010000:00010000:2.0:1789049522.273548:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1789049522.273563:0:5851:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cb8d6715200, rc 0) 00000100:00100000:2.0:1789049522.273653:0:5851:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb7c7147b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e823b53a-3591-475c-8624-c682227e5c13+66:11593:x1875954089683712:12345-192.168.206.26@tcp:101:lhsmtool_posix.0 Request processed in 284us (524us total) trans 0 rc 0/0 00000100:00100000:2.0:1789049522.273685:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.26@tcp, seq: 222 00000100:00100000:1.0:1789049522.286869:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.26@tcp (source: 12345-192.168.206.26@tcp) 00000100:00100000:3.0:1789049522.287080:0:6703:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954089683840 00000100:00100000:3.0:1789049522.287102:0:6703:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954089683840 00000100:00100000:3.0:1789049522.287216:0:6703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.26@tcp, seq: 62 00000100:00100000:3.0:1789049522.287231:0:6703:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb7c7147100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e823b53a-3591-475c-8624-c682227e5c13+9:2358:x1875954089683840:12345-192.168.206.26@tcp:2:lhsmtool_posix.0 00000100:00100000:3.0:1789049522.287632:0:6703:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb7c7147100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e823b53a-3591-475c-8624-c682227e5c13+10:2358:x1875954089683840:12345-192.168.206.26@tcp:2:lhsmtool_posix.0 Request processed in 403us (790us total) trans 4294967319 rc 0/0 00000100:00100000:3.0:1789049522.287640:0:6703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.26@tcp, seq: 62 00000100:00080000:1.0:1789049522.288306:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789049522.293356:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.26@tcp (source: 12345-192.168.206.26@tcp) 00000100:00100000:2.0:1789049522.293484:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954089684096 00000100:00100000:2.0:1789049522.293499:0:5853:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954089684096 00000100:00100000:2.0:1789049522.293571:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.26@tcp, seq: 60 00000100:00100000:2.0:1789049522.293583:0:5853:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb7c7146d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e823b53a-3591-475c-8624-c682227e5c13+66:11593:x1875954089684096:12345-192.168.206.26@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1789049522.294322:0:5853:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb7c7146d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e823b53a-3591-475c-8624-c682227e5c13+67:11593:x1875954089684096:12345-192.168.206.26@tcp:35:lhsmtool_posix.0 Request processed in 735us (974us total) trans 4294967514 rc 0/0 00000100:00100000:2.0:1789049522.294333:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.26@tcp, seq: 60 00000100:00100000:2.0:1789049522.305061:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.26@tcp (source: 12345-192.168.206.26@tcp) 00000100:00100000:3.0:1789049522.305472:0:6841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954089684352 00000100:00100000:3.0:1789049522.305486:0:6841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954089684352 00000100:00100000:3.0:1789049522.305570:0:6841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.26@tcp, seq: 223 00000100:00100000:3.0:1789049522.305582:0:6841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb900e96300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e823b53a-3591-475c-8624-c682227e5c13+67:11593:x1875954089684352:12345-192.168.206.26@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1789049522.305819:0:6841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb900e96300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e823b53a-3591-475c-8624-c682227e5c13+67:11593:x1875954089684352:12345-192.168.206.26@tcp:57:lhsmtool_posix.0 Request processed in 235us (768us total) trans 0 rc 0/0 00000100:00100000:3.0:1789049522.305828:0:6841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.26@tcp, seq: 223 00000100:00100000:2.0:1789049522.332210:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.26@tcp (source: 12345-192.168.206.26@tcp) 00000100:00100000:0.0:1789049522.332443:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954089684480 00000100:00100000:0.0:1789049522.332457:0:5851:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954089684480 00000100:00100000:0.0:1789049522.332537:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.26@tcp, seq: 224 00000100:00100000:0.0:1789049522.332551:0:5851:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb900e96a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e823b53a-3591-475c-8624-c682227e5c13+67:11593:x1875954089684480:12345-192.168.206.26@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789049522.332579:0:5851:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789049522.332608:0:5851:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb7c4c38400/0xf4f48ce5e1bbfc8e lrc: 2/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7fc5e358805a36e0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049522.332699:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb7c4c38a00/0xf4f48ce5e1bbfc95 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049522.332716:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cb7c4c38a00/0xf4f48ce5e1bbfc95 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049522.332730:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb7c4c38a00/0xf4f48ce5e1bbfc95 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789049522.332789:0:5851:0:(mdt_handler.c:1587:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1789049522.332837:0:5851:0:(mdt_handler.c:2522:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8cb7c4c38a00/0xf4f48ce5e1bbfc95 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049522.332920:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb7c4c38400/0xf4f48ce5e1bbfc8e lrc: 0/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a36e0 expref: 69 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049522.332942:0:5851:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb7c4c38a00/0xf4f48ce5e1bbfc95 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a36e0 expref: 68 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049522.332951:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff8cb8ce751900) 00010000:00010000:0.0:1789049522.332954:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1789049522.332959:0:5851:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cb7c4c38a00, rc 0) 00000100:00100000:0.0:1789049522.333038:0:5851:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb900e96a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e823b53a-3591-475c-8624-c682227e5c13+68:11593:x1875954089684480:12345-192.168.206.26@tcp:101:lhsmtool_posix.0 Request processed in 489us (845us total) trans 0 rc 0/0 00000100:00100000:0.0:1789049522.333047:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.26@tcp, seq: 224 00000100:00100000:0.0:1789049522.337336:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.26@tcp (source: 12345-192.168.206.26@tcp) 00000100:00100000:2.0:1789049522.337531:0:10560:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954089684608 00000100:00100000:2.0:1789049522.337544:0:10560:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954089684608 00000100:00100000:2.0:1789049522.337620:0:10560:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.26@tcp, seq: 63 00000100:00100000:2.0:1789049522.337633:0:10560:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8f7b90700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e823b53a-3591-475c-8624-c682227e5c13+10:2358:x1875954089684608:12345-192.168.206.26@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789049522.337658:0:10560:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789049522.337687:0:10560:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b84a320d/0xf4f48ce5e1bbfc9c lrc: 2/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x7fc5e358805a36e7 expref: -99 pid: 10560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789049522.337722:0:10560:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x18d3fb0fa3003580, blocks: 0x1 00010000:00010000:2.0:1789049522.337747:0:10560:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=348s v=(0 0) 00010000:00010000:2.0:1789049522.337752:0:10560:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789049522.337764:0:10560:0:(ldlm_resource.c:1751:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b84a320d/0xf4f48ce5e1bbfc9c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a36e7 expref: 11 pid: 10560 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049522.337799:0:10560:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000b84a320d/0xf4f48ce5e1bbfc9c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a36e7 expref: 11 pid: 10560 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049522.337837:0:10560:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cb8d6715a00, rc 0) 00000100:00100000:2.0:1789049522.337943:0:10560:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8f7b90700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e823b53a-3591-475c-8624-c682227e5c13+11:2358:x1875954089684608:12345-192.168.206.26@tcp:101:lhsmtool_posix.0 Request processed in 313us (621us total) trans 0 rc 0/0 00000100:00100000:2.0:1789049522.337952:0:10560:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.26@tcp, seq: 63 00000100:00100000:2.0:1789049522.353967:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.26@tcp (source: 12345-192.168.206.26@tcp) 00000100:00100000:3.0:1789049522.354068:0:6841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954089684864 00000100:00100000:3.0:1789049522.354082:0:6841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954089684864 00000100:00100000:3.0:1789049522.354166:0:6841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.26@tcp, seq: 225 00000100:00100000:3.0:1789049522.354178:0:6841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb900e97480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e823b53a-3591-475c-8624-c682227e5c13+68:11593:x1875954089684864:12345-192.168.206.26@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1789049522.354331:0:6841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb900e97480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e823b53a-3591-475c-8624-c682227e5c13+68:11593:x1875954089684864:12345-192.168.206.26@tcp:57:lhsmtool_posix.0 Request processed in 155us (377us total) trans 0 rc 0/0 00000100:00100000:3.0:1789049522.354340:0:6841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.26@tcp, seq: 225 00000100:00100000:0.0:1789049522.360602:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.26@tcp (source: 12345-192.168.206.26@tcp) 00000100:00100000:3.0:1789049522.360809:0:6703:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954089684992 00000100:00100000:3.0:1789049522.360822:0:6703:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954089684992 00000100:00100000:3.0:1789049522.360934:0:6703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.26@tcp, seq: 64 00000100:00100000:3.0:1789049522.360947:0:6703:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8f7b91500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e823b53a-3591-475c-8624-c682227e5c13+11:11593:x1875954089684992:12345-192.168.206.26@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789049522.360969:0:6703:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789049522.360994:0:6703:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009c029bda/0xf4f48ce5e1bbfca3 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x7fc5e358805a36ee expref: -99 pid: 6703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049522.361055:0:6703:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000b84a320d/0xf4f48ce5e1bbfc9c lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a36e7 expref: 12 pid: 10560 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049522.361065:0:6703:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789049522.361070:0:6703:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789049522.361075:0:6703:0:(ldlm_resource.c:1751:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009c029bda/0xf4f48ce5e1bbfca3 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a36ee expref: 12 pid: 6703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049522.361231:0:6703:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000b84a320d/0xf4f48ce5e1bbfc9c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a36e7 expref: 12 pid: 10560 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049522.361248:0:6703:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000b84a320d/0xf4f48ce5e1bbfc9c lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a36e7 expref: 12 pid: 10560 timeout: 448 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789049522.361264:0:6703:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb8f7acad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6703:1875954110637824:192.168.206.26@tcp:104: 00000100:00100000:3.0:1789049522.361458:0:6703:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cb8c5836cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1789049522.377798:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.26@tcp (source: 12345-192.168.206.26@tcp) 00000100:00100000:2.0:1789049522.378078:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954089685120 00000100:00100000:2.0:1789049522.378105:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954089685120 00010000:00010000:2.0:1789049522.378172:0:5837:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000b84a320d/0xf4f48ce5e1bbfc9c lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a36e7 expref: 13 pid: 10560 timeout: 448 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789049522.378233:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.26@tcp, seq: 78 00000100:00100000:2.0:1789049522.378245:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb900e41880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e823b53a-3591-475c-8624-c682227e5c13+13:2358:x1875954089685120:12345-192.168.206.26@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789049522.378263:0:5837:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789049522.378293:0:5837:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000b84a320d/0xf4f48ce5e1bbfc9c lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a36e7 expref: 13 pid: 10560 timeout: 448 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049522.378308:0:5837:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000b84a320d/0xf4f48ce5e1bbfc9c lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a36e7 expref: 13 pid: 10560 timeout: 448 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049522.378344:0:5837:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789049522.378350:0:5837:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789049522.378360:0:5837:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000009c029bda/0xf4f48ce5e1bbfca3 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a36ee expref: 13 pid: 6703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049522.378386:0:5837:0:(ldlm_resource.c:1751:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009c029bda/0xf4f48ce5e1bbfca3 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a36ee expref: 13 pid: 6703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049522.378441:0:5837:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 000000009c029bda/0xf4f48ce5e1bbfca3 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a36ee expref: 13 pid: 6703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789049522.378459:0:5837:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb900e95c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:5837:1875954110637952:192.168.206.26@tcp:105: 00000100:00100000:2.0:1789049522.378582:0:5837:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cb8fc9b6240 going to sleep for 11 seconds 00010000:00010000:3.0:1789049522.379046:0:6703:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b84a320d/0xf4f48ce5e1bbfc9c lrc: 0/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a36e7 expref: 13 pid: 10560 timeout: 448 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789049522.379066:0:6703:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb8f7acad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6703:1875954110637824:192.168.206.26@tcp:104: 00010000:00010000:3.0:1789049522.379097:0:6703:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000009c029bda/0xf4f48ce5e1bbfca3 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a36ee expref: 12 pid: 6703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049522.379109:0:6703:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cb8c6b34200, rc 0) 00000100:00100000:3.0:1789049522.379406:0:6703:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8f7b91500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e823b53a-3591-475c-8624-c682227e5c13+12:11593:x1875954089684992:12345-192.168.206.26@tcp:101:lhsmtool_posix.0 Request processed in 18461us (18817us total) trans 0 rc 0/0 00000100:00100000:3.0:1789049522.379416:0:6703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.26@tcp, seq: 64 00000100:00100000:1.0:1789049522.383327:0:5837:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb900e95c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:5837:1875954110637952:192.168.206.26@tcp:105: 00010000:00010000:1.0:1789049522.383367:0:5837:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789049522.383444:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb900e41880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e823b53a-3591-475c-8624-c682227e5c13+11:2358:x1875954089685120:12345-192.168.206.26@tcp:103:ldlm_bl.0 Request processed in 5200us (5669us total) trans 0 rc 0/0 00000100:00100000:1.0:1789049522.383457:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.26@tcp, seq: 78 00000100:00100000:1.0:1789049522.403193:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.26@tcp (source: 12345-192.168.206.26@tcp) 00000100:00100000:0.0:1789049522.403357:0:6709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954089685248 00000100:00100000:0.0:1789049522.403370:0:6709:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954089685248 00002000:00100000:0.0:1789049522.403438:0:6709:0:(ofd_dev.c:2725:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x6:0x0] (0->12) req@ffff8cb900e43100 x1875954089685248/t0(0) o4->e823b53a-3591-475c-8624-c682227e5c13@192.168.206.26@tcp:23/0 lens 504/0 e 0 to 0 dl 1789049533 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789049522.403450:0:6709:0:(ofd_dev.c:2581:ofd_prolong_extent_locks()) Prolong locks for req ffff8cb900e43100 with x1875954089685248 ext(0->12) 00002000:00010000:0.0:1789049522.403457:0:6709:0:(ofd_dev.c:2730:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8cb900e43100 00000100:00100000:0.0:1789049522.403497:0:6709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.26@tcp, seq: 6 00000100:00100000:0.0:1789049522.403509:0:6709:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb900e43100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:e823b53a-3591-475c-8624-c682227e5c13+11:2357:x1875954089685248:12345-192.168.206.26@tcp:4:lhsmtool_posix.0 00000100:00100000:0.0:1789049522.404256:0:6709:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb900e43100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:e823b53a-3591-475c-8624-c682227e5c13+13:2357:x1875954089685248:12345-192.168.206.26@tcp:4:lhsmtool_posix.0 Request processed in 743us (1072us total) trans 4294967320 rc 0/0 00000100:00100000:0.0:1789049522.404280:0:6709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.26@tcp, seq: 6 00002000:00100000:0.0:1789049522.404290:0:6709:0:(ofd_dev.c:2725:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x6:0x0] (0->12) req@ffff8cb900e43100 x1875954089685248/t4294967320(0) o4->e823b53a-3591-475c-8624-c682227e5c13@192.168.206.26@tcp:23/0 lens 504/448 e 0 to 0 dl 1789049533 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789049522.404298:0:6709:0:(ofd_dev.c:2581:ofd_prolong_extent_locks()) Prolong locks for req ffff8cb900e43100 with x1875954089685248 ext(0->12) 00002000:00010000:0.0:1789049522.404303:0:6709:0:(ofd_dev.c:2730:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8cb900e43100 00000100:00100000:0.0:1789049522.421545:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.26@tcp (source: 12345-192.168.206.26@tcp) 00000100:00100000:2.0:1789049522.421666:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954089685376 00000100:00100000:2.0:1789049522.421679:0:5851:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954089685376 00000100:00100000:2.0:1789049522.421806:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.26@tcp, seq: 226 00000100:00100000:2.0:1789049522.421819:0:5851:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8f7b91180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e823b53a-3591-475c-8624-c682227e5c13+68:11593:x1875954089685376:12345-192.168.206.26@tcp:44:lhsmtool_posix.0 00000001:00080000:3.0:1789049522.479704:0:5872:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967513 is committed 00000001:00080000:3.0:1789049522.479804:0:5872:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967514 is committed 00000004:00080000:3.0:1789049522.479818:0:5872:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 9 committed 00000004:00080000:3.0:1789049522.479917:0:5872:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 6 committed 00000020:00080000:3.0:1789049522.479941:0:5872:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8cb8c7c97300 refcount 2 committed 0 result 0 batchid 7 00000020:00080000:3.0:1789049522.479948:0:5872:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8cb8e0145c00 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8cb8c7c97d80 00000020:00080000:3.0:1789049522.479952:0:5872:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8cb8c5a48f00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8cb900a30800 00000004:00080000:3.0:1789049522.479982:0:5872:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 8 committed 00000020:00080000:3.0:1789049522.479999:0:5872:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8cb8dbb6bf00 refcount 2 committed 0 result 0 batchid 6 00000020:00080000:3.0:1789049522.480002:0:5872:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8cb8fc9b9500 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8cb8dbb6b480 00000020:00080000:3.0:1789049522.480006:0:5872:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8cb8fc9b9800 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8cb900d76400 00000020:00080000:3.0:1789049522.480147:0:5883:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 7 committed batchid 5 00000020:00080000:3.0:1789049522.480562:0:5883:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 5 00000100:00100000:3.0:1789049522.480683:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb900e94a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1875954110638080:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1789049522.480821:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789049522.480916:0:10560:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954110638080 00000100:00100000:2.0:1789049522.480928:0:10560:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954110638080 00000100:00100000:3.0:1789049522.480951:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789049522.480963:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb8f7acad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1875954110638208:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1789049522.481000:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789049522.481010:0:10560:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1789049522.481040:0:10560:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb7c5c35880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3308:x1875954110638080:12345-0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1789049522.481055:0:6705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954110638208 00000100:00100000:3.0:1789049522.481064:0:6705:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954110638208 00002000:00080000:2.0:1789049522.481079:0:10560:0:(ofd_dev.c:1868:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:5 count 1 00010000:00010000:2.0:1789049522.481109:0:10560:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005641f1fd/0xf4f48ce5e1bbfcaa lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 10560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789049522.481123:0:6705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00010000:00010000:2.0:1789049522.481135:0:10560:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000006146009f/0xf4f48ce5e1bbfa6c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a364d expref: 12 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049522.481146:0:10560:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x5:0x0].0x0 since=2s v=(0 0) 00010000:00010000:2.0:1789049522.481165:0:10560:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1789049522.481171:0:10560:0:(ldlm_resource.c:1751:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005641f1fd/0xf4f48ce5e1bbfcaa lrc: 4/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 10560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049522.481205:0:10560:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000006146009f/0xf4f48ce5e1bbfa6c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a364d expref: 12 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049522.481223:0:10560:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000006146009f/0xf4f48ce5e1bbfa6c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a364d expref: 12 pid: 6705 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789049522.481253:0:10560:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb900e94e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10560:1875954110638336:192.168.206.26@tcp:104: 00000100:00100000:2.0:1789049522.481344:0:10560:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cb8fc9b6240 going to sleep for 11 seconds 00000100:00100000:1.0:1789049522.481397:0:5851:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8f7b91180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e823b53a-3591-475c-8624-c682227e5c13+20:11593:x1875954089685376:12345-192.168.206.26@tcp:44:lhsmtool_posix.0 Request processed in 59575us (59861us total) trans 0 rc 0/0 00000100:00100000:1.0:1789049522.481410:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.26@tcp, seq: 226 00000100:00100000:3.0:1789049522.482197:0:6705:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb7c5c37100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3308:x1875954110638208:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:3.0:1789049522.482240:0:6705:0:(ofd_dev.c:1868:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:5 count 1 00002000:00010000:3.0:1789049522.482310:0:6705:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x5:0x0] initial LVB size: 9, mtime: 0x18d3fb0f3d9b9583, atime: 0x18d3fb0f4df54852, ctime: 0x18d3fb0f3d9b9583, blocks: 0x1 00010000:00010000:3.0:1789049522.482325:0:6705:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000081843886/0xf4f48ce5e1bbfcb1 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049522.482347:0:6705:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=348s v=(0 0) 00010000:00010000:3.0:1789049522.482355:0:6705:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789049522.482363:0:6705:0:(ldlm_resource.c:1751:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000081843886/0xf4f48ce5e1bbfcb1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049522.484620:0:6705:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000081843886/0xf4f48ce5e1bbfcb1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049522.484637:0:6705:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000081843886/0xf4f48ce5e1bbfcb1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049522.484645:0:6705:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000081843886/0xf4f48ce5e1bbfcb1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049522.484677:0:6705:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00080000:2.0:1789049522.485024:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:1.0:1789049522.486439:0:6719:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789049522.486457:0:6719:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000081843886/0xf4f48ce5e1bbfcb1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049522.486491:0:6719:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cb8c6b35800 already unused, calling callback (ffffffffc166a8f0) 00010000:00010000:1.0:1789049522.486498:0:6719:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000081843886/0xf4f48ce5e1bbfcb1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049522.486511:0:6719:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000081843886/0xf4f48ce5e1bbfcb1 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049522.486542:0:6719:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000081843886/0xf4f48ce5e1bbfcb1 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049522.486552:0:6719:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000081843886/0xf4f48ce5e1bbfcb1 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049522.487773:0:6719:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789049522.487789:0:6719:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789049522.487792:0:6719:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789049522.489624:0:6705:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb7c5c37100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+8:3308:x1875954110638208:12345-0@lo:6:osp-syn-1-0.0 Request processed in 7427us (8610us total) trans 4294967310 rc 0/0 00000100:00100000:1.0:1789049522.496034:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.26@tcp (source: 12345-192.168.206.26@tcp) 00000100:00100000:2.0:1789049522.496191:0:10560:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb900e94e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10560:1875954110638336:192.168.206.26@tcp:104: 00010000:00010000:2.0:1789049522.496293:0:10560:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000005641f1fd/0xf4f48ce5e1bbfcaa lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 10560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789049522.496425:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954089685504 00000100:00100000:0.0:1789049522.496437:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954089685504 00010000:00010000:0.0:1789049522.496491:0:5835:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000006146009f/0xf4f48ce5e1bbfa6c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a364d expref: 13 pid: 6705 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789049522.496537:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.26@tcp, seq: 79 00000100:00100000:0.0:1789049522.496558:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb900e42680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e823b53a-3591-475c-8624-c682227e5c13+13:2358:x1875954089685504:12345-192.168.206.26@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789049522.496576:0:5835:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789049522.496583:0:5835:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000006146009f/0xf4f48ce5e1bbfa6c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a364d expref: 13 pid: 6705 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049522.496598:0:5835:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000006146009f/0xf4f48ce5e1bbfa6c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a364d expref: 13 pid: 6705 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049522.496626:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006146009f/0xf4f48ce5e1bbfa6c lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a364d expref: 13 pid: 6705 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049522.496645:0:5835:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1789049522.496667:0:5835:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1789049522.496674:0:5835:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000005641f1fd/0xf4f48ce5e1bbfcaa lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 10560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049522.496685:0:5835:0:(ldlm_resource.c:1751:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005641f1fd/0xf4f48ce5e1bbfcaa lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 10560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049522.496723:0:5835:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789049522.496795:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb900e42680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e823b53a-3591-475c-8624-c682227e5c13+12:2358:x1875954089685504:12345-192.168.206.26@tcp:103:ldlm_bl.0 Request processed in 249us (778us total) trans 0 rc 0/0 00000100:00100000:0.0:1789049522.496804:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.26@tcp, seq: 79 00000100:00100000:0.0:1789049522.496892:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.26@tcp (source: 12345-192.168.206.26@tcp) 00000100:00100000:0.0:1789049522.498679:0:6704:0:(service.c:3467:ptlrpc_start_thread()) ost[0] started 4 min 3 max 116 00000100:00100000:0.0:1789049522.498701:0:6704:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost00_004' 00000100:00100000:0.0:1789049522.498882:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954089685632 00000100:00100000:0.0:1789049522.498894:0:6704:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954089685632 00000100:00100000:0.0:1789049522.499034:0:12489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.26@tcp, seq: 67 00000100:00100000:0.0:1789049522.499244:0:12489:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8f7b93800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:e823b53a-3591-475c-8624-c682227e5c13+12:2357:x1875954089685632:12345-192.168.206.26@tcp:16:lhsmtool_posix.0 00010000:00010000:1.0:1789049522.499423:0:10560:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000005641f1fd/0xf4f48ce5e1bbfcaa lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 10560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049522.499441:0:10560:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005641f1fd/0xf4f48ce5e1bbfcaa lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 10560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049522.499456:0:10560:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005641f1fd/0xf4f48ce5e1bbfcaa lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 10560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049522.499481:0:10560:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005641f1fd/0xf4f48ce5e1bbfcaa lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 10560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049522.499512:0:10560:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1789049522.500419:0:10560:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb7c5c35880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3308:x1875954110638080:12345-0@lo:6:osp-syn-0-0.0 Request processed in 19393us (19595us total) trans 4294967321 rc 0/0 00000100:00100000:1.0:1789049522.500432:0:10560:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00010000:00010000:0.0:1789049522.500965:0:5839:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789049522.500975:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005641f1fd/0xf4f48ce5e1bbfcaa lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 10560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049522.500988:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cb8d776e200 already unused, calling callback (ffffffffc166a8f0) 00010000:00010000:0.0:1789049522.500993:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005641f1fd/0xf4f48ce5e1bbfcaa lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 10560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049522.501004:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005641f1fd/0xf4f48ce5e1bbfcaa lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 10560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789049522.501106:0:6705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000004:00080000:3.0:1789049522.501196:0:3308:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8cb8f7acad80/2, rc 0, transno 4294967310 00000100:00100000:3.0:1789049522.501261:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb8f7acad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1875954110638208:0@lo:6:osp-syn-1-0.0 00000004:00080000:3.0:1789049522.501281:0:3308:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8cb900e94a80/2, rc 0, transno 4294967321 00000100:00100000:3.0:1789049522.501303:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb900e94a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1875954110638080:0@lo:6:osp-syn-0-0.0 00010000:00010000:0.0:1789049522.501346:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005641f1fd/0xf4f48ce5e1bbfcaa lrc: 1/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 10560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049522.501358:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005641f1fd/0xf4f48ce5e1bbfcaa lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 10560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049522.501387:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789049522.501390:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789049522.501392:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0:1789049522.580967:0:6731:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967320 is committed 00000001:00080000:2.0:1789049522.580992:0:6731:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967317 is committed 00000001:00080000:2.0:1789049522.580998:0:6731:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967321 is committed 00000100:00100000:2.0:1789049522.581117:0:12489:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8f7b93800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:e823b53a-3591-475c-8624-c682227e5c13+7:2357:x1875954089685632:12345-192.168.206.26@tcp:16:lhsmtool_posix.0 Request processed in 82069us (84220us total) trans 0 rc 0/0 00000100:00100000:2.0:1789049522.581137:0:12489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.26@tcp, seq: 67 00000100:00100000:0.0:1789049522.583984:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.26@tcp (source: 12345-192.168.206.26@tcp) 00000100:00100000:3.0:1789049522.584072:0:6841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954089685888 00000100:00100000:3.0:1789049522.584081:0:6841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954089685888 00000100:00100000:3.0:1789049522.584144:0:6841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.26@tcp, seq: 227 00000100:00100000:3.0:1789049522.584154:0:6841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8f7b90000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e823b53a-3591-475c-8624-c682227e5c13+20:11593:x1875954089685888:12345-192.168.206.26@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1789049522.584214:0:6841:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789049522.584239:0:6841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb7c4c38a00/0xf4f48ce5e1bbfc95 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a36e0 expref: 20 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049522.584259:0:6841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff8cb8ce751900) 00010000:00010000:3.0:1789049522.584264:0:6841:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789049522.584292:0:6841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c6b35800/0xf4f48ce5e1bbfcb8 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049522.584304:0:6841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c6b35800/0xf4f48ce5e1bbfcb8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049522.584313:0:6841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c6b35800/0xf4f48ce5e1bbfcb8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6841 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789049522.584524:0:6841:0:(mdt_handler.c:4507:mdt_save_lock()) ### save lock request 00000000e0eb14be reply state 000000002e5199c8 transno 4294967515 ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c6b35800/0xf4f48ce5e1bbfcb8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6841 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789049522.584535:0:6841:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1789049522.584631:0:6841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8f7b90000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e823b53a-3591-475c-8624-c682227e5c13+21:11593:x1875954089685888:12345-192.168.206.26@tcp:36:lhsmtool_posix.0 Request processed in 477us (654us total) trans 4294967515 rc 0/0 00000100:00100000:3.0:1789049522.584638:0:6841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.26@tcp, seq: 227 00000100:00100000:3.0:1789049522.588104:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789049522.588125:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb7c5c36680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3311:1875954110638464:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789049522.588189:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789049522.588337:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.26@tcp (source: 12345-192.168.206.26@tcp) 00010000:00010000:3.0:1789049522.588364:0:3295:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c6b35800/0xf4f48ce5e1bbfcb8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049522.588374:0:3295:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c6b35800/0xf4f48ce5e1bbfcb8 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049522.588381:0:3295:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c6b35800/0xf4f48ce5e1bbfcb8 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049522.588387:0:3295:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cb8c6b35800 already unused, calling callback (ffffffffc20ca4f0) 00010000:00010000:3.0:1789049522.588391:0:3295:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c6b35800/0xf4f48ce5e1bbfcb8 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049522.588399:0:3295:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c6b35800/0xf4f48ce5e1bbfcb8 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049522.588414:0:3295:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff8cb8ce751900) 00010000:00010000:3.0:1789049522.588417:0:3295:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789049522.588422:0:3295:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c6b35800/0xf4f48ce5e1bbfcb8 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049522.588428:0:3295:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c6b35800/0xf4f48ce5e1bbfcb8 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6841 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789049522.588455:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954089686016 00000100:00100000:3.0:1789049522.588462:0:6704:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954089686016 00000100:00100000:3.0:1789049522.588549:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.26@tcp, seq: 68 00000100:00100000:3.0:1789049522.588561:0:6704:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb7c5c37b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e823b53a-3591-475c-8624-c682227e5c13+7:2357:x1875954089686016:12345-192.168.206.26@tcp:2:lhsmtool_posix.0 00002000:00010000:3.0:1789049522.588881:0:6704:0:(ofd_lvb.c:321:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:3.0:1789049522.588885:0:6704:0:(ofd_lvb.c:328:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb mtime from disk: 0 -> 1789049520519000000 00002000:00010000:3.0:1789049522.588894:0:6704:0:(ofd_lvb.c:334:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb atime from disk: 0 -> 1789049520145000000 00002000:00010000:3.0:1789049522.588897:0:6704:0:(ofd_lvb.c:340:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb ctime from disk: 1789049521574000000 -> 1789049520519000000 00002000:00010000:3.0:1789049522.588899:0:6704:0:(ofd_lvb.c:346:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:3.0:1789049522.588947:0:6704:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb7c5c37b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e823b53a-3591-475c-8624-c682227e5c13+8:2357:x1875954089686016:12345-192.168.206.26@tcp:2:lhsmtool_posix.0 Request processed in 388us (610us total) trans 4294967322 rc 0/0 00000100:00100000:3.0:1789049522.588955:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.26@tcp, seq: 68 00000100:00100000:1.0:1789049522.589176:0:6707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954110638464 00000100:00100000:1.0:1789049522.589181:0:6707:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954110638464 00000100:00100000:1.0:1789049522.589211:0:6707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1789049522.589219:0:6707:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8df392450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+8:3311:x1875954110638464:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789049522.589241:0:6707:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 52756480 pending 1703936 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789049522.589281:0:6707:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8df392450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+8:3311:x1875954110638464:12345-0@lo:13:osp-pre-1-0.0 Request processed in 64us (1091us total) trans 0 rc 0/0 00000100:00100000:1.0:1789049522.589287:0:6707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1789049522.589498:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb7c5c36680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3311:1875954110638464:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789049522.589789:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb8f7b91f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3308:1875954110638720:0@lo:400:kworker.0 00000100:00100000:0.0:1789049522.589826:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789049522.589873:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789049522.589879:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb8f7b91880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3308:1875954110638848:0@lo:400:kworker.0 00000100:00100000:0.0:1789049522.589907:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789049522.589939:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954110638720 00000100:00100000:0.0:1789049522.589944:0:5850:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954110638720 00000100:00100000:0.0:1789049522.589971:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954110638848 00000100:00100000:0.0:1789049522.589974:0:5850:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954110638848 00000100:00100000:0.0:1789049522.589999:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:0.0:1789049522.590005:0:5850:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8f7b91c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1875954110638720:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789049522.590039:0:5850:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8f7b91c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1875954110638720:12345-0@lo:400:kworker.0 Request processed in 35us (213us total) trans 0 rc 0/0 00000100:00100000:0.0:1789049522.590045:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:0.0:1789049522.590058:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:0.0:1789049522.590064:0:5850:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8c59c8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1875954110638848:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789049522.590101:0:5850:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8c59c8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1875954110638848:12345-0@lo:400:kworker.0 Request processed in 37us (193us total) trans 0 rc 0/0 00000100:00100000:0.0:1789049522.590108:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00080000:0.0:1789049522.590125:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789049522.590145:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb8f7b91880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3308:1875954110638848:0@lo:400:kworker.0 00000100:00100000:0.0:1789049522.590155:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb8f7b91f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3308:1875954110638720:0@lo:400:kworker.0 00000100:00100000:1.0:1789049522.590533:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb8f7b93100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3310:1875954110638976:0@lo:400:kworker.0 00000100:00100000:1.0:1789049522.590563:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789049522.590589:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789049522.590594:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb8f7b92d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7ef694ec-1ea0-4f02-800c-d1279b4fdf12:3310:1875954110638592:0@lo:400:kworker.0 00000100:00100000:1.0:1789049522.590621:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789049522.590796:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954110638592 00000100:00100000:2.0:1789049522.590801:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954110638592 00000100:00100000:2.0:1789049522.590837:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 294 00000100:00100000:2.0:1789049522.590867:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8c6bed850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7ef694ec-1ea0-4f02-800c-d1279b4fdf12+19:3310:x1875954110638592:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789049522.590911:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8c6bed850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7ef694ec-1ea0-4f02-800c-d1279b4fdf12+19:3310:x1875954110638592:12345-0@lo:400:kworker.0 Request processed in 67us (289us total) trans 0 rc 0/0 00000100:00100000:2.0:1789049522.590917:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 294 00000100:00100000:3.0:1789049522.592064:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954110638976 00000100:00100000:3.0:1789049522.592073:0:5850:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954110638976 00000100:00100000:3.0:1789049522.592122:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:1.0:1789049522.593092:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb8f7b92d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7ef694ec-1ea0-4f02-800c-d1279b4fdf12:3310:1875954110638592:0@lo:400:kworker.0 00000100:00100000:3.0:1789049522.593192:0:5850:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb900e43b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1875954110638976:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789049522.593261:0:5850:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb900e43b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1875954110638976:12345-0@lo:400:kworker.0 Request processed in 76us (2697us total) trans 0 rc 0/0 00000100:00100000:3.0:1789049522.593269:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00080000:3.0:1789049522.593292:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789049522.593819:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb8f7b93100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3310:1875954110638976:0@lo:400:kworker.0 00000100:00100000:0.0:1789049522.594304:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.26@tcp (source: 12345-192.168.206.26@tcp) 00000100:00100000:3.0:1789049522.595546:0:6841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954089686272 00000100:00100000:3.0:1789049522.595557:0:6841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954089686272 00000100:00100000:3.0:1789049522.595607:0:6841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.26@tcp, seq: 228 00000100:00100000:3.0:1789049522.595616:0:6841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8c59c8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e823b53a-3591-475c-8624-c682227e5c13+20:11593:x1875954089686272:12345-192.168.206.26@tcp:55:lhsmtool_posix.0 00010000:00010000:3.0:1789049522.595679:0:6841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c6b35800/0xf4f48ce5e1bbfcbf lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049522.595696:0:6841:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb7c4c39a00/0xf4f48ce5e1bbfc79 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a36d2 expref: 20 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049522.595705:0:6841:0:(ldlm_resource.c:1751:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c6b35800/0xf4f48ce5e1bbfcbf lrc: 4/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049522.595738:0:6841:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8cb7c4c39a00/0xf4f48ce5e1bbfc79 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a36d2 expref: 20 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049522.595759:0:6841:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb7c4c39a00/0xf4f48ce5e1bbfc79 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a36d2 expref: 20 pid: 5850 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789049522.595772:0:6841:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb7c5c34380 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6841:1875954110639104:192.168.206.26@tcp:104: 00000100:00100000:3.0:1789049522.595875:0:6841:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cb900e243c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789049522.604789:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.26@tcp (source: 12345-192.168.206.26@tcp) 00000100:00100000:0.0:1789049522.604816:0:6720:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954089686400 00000100:00100000:0.0:1789049522.604824:0:6720:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954089686400 00010000:00010000:0.0:1789049522.604879:0:6720:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cb7c4c39a00/0xf4f48ce5e1bbfc79 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a36d2 expref: 21 pid: 5850 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789049522.604922:0:6720:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.26@tcp, seq: 80 00000100:00100000:0.0:1789049522.604932:0:6720:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8c7935050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e823b53a-3591-475c-8624-c682227e5c13+21:2358:x1875954089686400:12345-192.168.206.26@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789049522.604946:0:6720:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789049522.604952:0:6720:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8cb7c4c39a00/0xf4f48ce5e1bbfc79 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a36d2 expref: 21 pid: 5850 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049522.604964:0:6720:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8cb7c4c39a00/0xf4f48ce5e1bbfc79 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a36d2 expref: 21 pid: 5850 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049522.604985:0:6720:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff8cb8ce751900) 00010000:00010000:0.0:1789049522.604990:0:6720:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c6b35800/0xf4f48ce5e1bbfcbf lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049522.605014:0:6720:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c6b35800/0xf4f48ce5e1bbfcbf lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049522.605022:0:6720:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c6b35800/0xf4f48ce5e1bbfcbf lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049522.605041:0:6720:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789049522.605088:0:6720:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8c7935050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e823b53a-3591-475c-8624-c682227e5c13+21:2358:x1875954089686400:12345-192.168.206.26@tcp:103:ldlm_bl.0 Request processed in 156us (316us total) trans 0 rc 0/0 00000100:00100000:0.0:1789049522.605096:0:6720:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.26@tcp, seq: 80 00010000:00010000:3.0:1789049522.606501:0:6841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb7c4c39a00/0xf4f48ce5e1bbfc79 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a36d2 expref: 20 pid: 5850 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789049522.606520:0:6841:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb7c5c34380 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6841:1875954110639104:192.168.206.26@tcp:104: 00010000:00010000:3.0:1789049522.606540:0:6841:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c6b35800/0xf4f48ce5e1bbfcbf lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049522.606548:0:6841:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c6b35800/0xf4f48ce5e1bbfcbf lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049522.606555:0:6841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c6b35800/0xf4f48ce5e1bbfcbf lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049522.606759:0:6841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c6b35800/0xf4f48ce5e1bbfcbf lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049522.606768:0:6841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c6b35800/0xf4f48ce5e1bbfcbf lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049522.606774:0:6841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c6b35800/0xf4f48ce5e1bbfcbf lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049522.606793:0:6841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cb8c6b35800 already unused, calling callback (ffffffffc20ca4f0) 00010000:00010000:3.0:1789049522.606806:0:6841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c6b35800/0xf4f48ce5e1bbfcbf lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049522.606815:0:6841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c6b35800/0xf4f48ce5e1bbfcbf lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049522.606828:0:6841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff8cb8ce751900) 00010000:00010000:3.0:1789049522.606831:0:6841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:3.0:1789049522.606836:0:6841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c6b35800/0xf4f48ce5e1bbfcbf lrc: 2/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049522.606870:0:6841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c6b35800/0xf4f48ce5e1bbfcbf lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6841 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789049522.606948:0:6841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8c59c8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e823b53a-3591-475c-8624-c682227e5c13+19:11593:x1875954089686272:12345-192.168.206.26@tcp:55:lhsmtool_posix.0 Request processed in 11332us (12657us total) trans 0 rc -22/-22 00000100:00100000:3.0:1789049522.606957:0:6841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.26@tcp, seq: 228 00000100:00100000:3.0:1789049522.617502:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.26@tcp (source: 12345-192.168.206.26@tcp) 00000100:00100000:1.0:1789049522.617839:0:6705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954089686528 00000100:00100000:1.0:1789049522.617925:0:6705:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954089686528 00000100:00100000:1.0:1789049522.618270:0:6705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.26@tcp, seq: 69 00000100:00100000:1.0:1789049522.618281:0:6705:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb7c5c34380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e823b53a-3591-475c-8624-c682227e5c13+8:2357:x1875954089686528:12345-192.168.206.26@tcp:1:lhsmtool_posix.0 00010000:00010000:1.0:1789049522.618325:0:6705:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000009130cead/0xf4f48ce5e1bbfcc6 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049522.618355:0:6705:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000009c029bda/0xf4f48ce5e1bbfca3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a36ee expref: 8 pid: 6703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049522.618364:0:6705:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789049522.618367:0:6705:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1789049522.618371:0:6705:0:(ldlm_resource.c:1751:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009130cead/0xf4f48ce5e1bbfcc6 lrc: 4/1,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049522.618405:0:6705:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000009c029bda/0xf4f48ce5e1bbfca3 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a36ee expref: 8 pid: 6703 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049522.618418:0:6705:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000009c029bda/0xf4f48ce5e1bbfca3 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a36ee expref: 8 pid: 6703 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789049522.618432:0:6705:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb900e40380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6705:1875954110639232:192.168.206.26@tcp:104: 00000100:00100000:1.0:1789049522.618512:0:6705:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cb8c687c300 going to sleep for 11 seconds 00000001:00080000:3.0:1789049522.621327:0:7663:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967307 is committed 00000001:00080000:3.0:1789049522.621342:0:7663:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967309 is committed 00000001:00080000:3.0:1789049522.621347:0:7663:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967308 is committed 00000001:00080000:3.0:1789049522.621356:0:7663:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967310 is committed 00000100:00100000:1.0:1789049522.622795:0:6705:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb900e40380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6705:1875954110639232:192.168.206.26@tcp:104: 00010000:00010000:1.0:1789049522.622822:0:6705:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000009130cead/0xf4f48ce5e1bbfcc6 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789049522.623275:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.26@tcp (source: 12345-192.168.206.26@tcp) 00000100:00100000:0.0:1789049522.623346:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954089686656 00000100:00100000:0.0:1789049522.623353:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954089686656 00010000:00010000:0.0:1789049522.623399:0:5835:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000009c029bda/0xf4f48ce5e1bbfca3 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a36ee expref: 9 pid: 6703 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789049522.623438:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.26@tcp, seq: 81 00000100:00100000:0.0:1789049522.623446:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb7c5c36300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e823b53a-3591-475c-8624-c682227e5c13+9:2357:x1875954089686656:12345-192.168.206.26@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789049522.623460:0:5835:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789049522.623482:0:5835:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000009c029bda/0xf4f48ce5e1bbfca3 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a36ee expref: 9 pid: 6703 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049522.623495:0:5835:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000009c029bda/0xf4f48ce5e1bbfca3 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a36ee expref: 9 pid: 6703 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049522.623515:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009c029bda/0xf4f48ce5e1bbfca3 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a36ee expref: 9 pid: 6703 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049522.623542:0:5835:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1789049522.623547:0:5835:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1789049522.623552:0:5835:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000009130cead/0xf4f48ce5e1bbfcc6 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049522.623561:0:5835:0:(ldlm_resource.c:1751:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009130cead/0xf4f48ce5e1bbfcc6 lrc: 4/1,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049522.623585:0:5835:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789049522.623634:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb7c5c36300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e823b53a-3591-475c-8624-c682227e5c13+8:2357:x1875954089686656:12345-192.168.206.26@tcp:103:ldlm_bl.0 Request processed in 188us (359us total) trans 0 rc 0/0 00000100:00100000:0.0:1789049522.623641:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.26@tcp, seq: 81 00010000:00010000:1.0:1789049522.623815:0:6705:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000009130cead/0xf4f48ce5e1bbfcc6 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049522.623826:0:6705:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009130cead/0xf4f48ce5e1bbfcc6 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049522.623873:0:6705:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000009130cead/0xf4f48ce5e1bbfcc6 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049522.623882:0:6705:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009130cead/0xf4f48ce5e1bbfcc6 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049522.623891:0:6705:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009130cead/0xf4f48ce5e1bbfcc6 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049522.623898:0:6705:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cb8c28c2800 already unused, calling callback (ffffffffc166a8f0) 00010000:00010000:1.0:1789049522.623903:0:6705:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009130cead/0xf4f48ce5e1bbfcc6 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049522.623912:0:6705:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009130cead/0xf4f48ce5e1bbfcc6 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049522.623924:0:6705:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009130cead/0xf4f48ce5e1bbfcc6 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049522.623943:0:6705:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009130cead/0xf4f48ce5e1bbfcc6 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789049522.623987:0:6705:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb7c5c34380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e823b53a-3591-475c-8624-c682227e5c13+7:2357:x1875954089686528:12345-192.168.206.26@tcp:1:lhsmtool_posix.0 Request processed in 5708us (6494us total) trans 0 rc 0/0 00000100:00100000:1.0:1789049522.623994:0:6705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.26@tcp, seq: 69 00000100:00100000:2.0:1789049522.627479:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.26@tcp (source: 12345-192.168.206.26@tcp) 00000100:00100000:3.0:1789049522.627560:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954089686912 00000100:00100000:3.0:1789049522.627569:0:5850:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954089686912 00000100:00100000:3.0:1789049522.627661:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.26@tcp, seq: 229 00000100:00100000:3.0:1789049522.627671:0:5850:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb900e94e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e823b53a-3591-475c-8624-c682227e5c13+19:11593:x1875954089686912:12345-192.168.206.26@tcp:57:lhsmtool_posix.0 00010000:00010000:3.0:1789049522.627746:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c6b35400/0xf4f48ce5e1bbfccd lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049522.627792:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c6b35400/0xf4f48ce5e1bbfccd lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049522.627803:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c6b35400/0xf4f48ce5e1bbfccd lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049522.628035:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c6b35800/0xf4f48ce5e1bbfcd4 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049522.628047:0:5850:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6715200/0xf4f48ce5e1bbfc87 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a36d9 expref: 20 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049522.628056:0:5850:0:(ldlm_resource.c:1751:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c6b35800/0xf4f48ce5e1bbfcd4 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049522.628093:0:5850:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6715200/0xf4f48ce5e1bbfc87 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a36d9 expref: 20 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049522.628107:0:5850:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6715200/0xf4f48ce5e1bbfc87 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a36d9 expref: 20 pid: 5851 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789049522.628121:0:5850:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb7c5c36a00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5850:1875954110639360:192.168.206.26@tcp:104: 00000100:00100000:3.0:1789049522.628213:0:5850:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cb900e246c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789049522.631926:0:5850:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb7c5c36a00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5850:1875954110639360:192.168.206.26@tcp:104: 00010000:00010000:0.0:1789049522.631955:0:5850:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c6b35800/0xf4f48ce5e1bbfcd4 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789049522.635444:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.26@tcp (source: 12345-192.168.206.26@tcp) 00000100:00100000:0.0:1789049522.635535:0:6720:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954089687040 00000100:00100000:0.0:1789049522.635544:0:6720:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954089687040 00010000:00010000:0.0:1789049522.635583:0:6720:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6715200/0xf4f48ce5e1bbfc87 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a36d9 expref: 21 pid: 5851 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789049522.635622:0:6720:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.26@tcp, seq: 82 00000100:00100000:0.0:1789049522.635631:0:6720:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb900e94700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e823b53a-3591-475c-8624-c682227e5c13+21:2357:x1875954089687040:12345-192.168.206.26@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789049522.635646:0:6720:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789049522.635653:0:6720:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6715200/0xf4f48ce5e1bbfc87 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a36d9 expref: 21 pid: 5851 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049522.635679:0:6720:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6715200/0xf4f48ce5e1bbfc87 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a36d9 expref: 21 pid: 5851 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049522.635701:0:6720:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6715200/0xf4f48ce5e1bbfc87 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a36d9 expref: 21 pid: 5851 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049522.635717:0:6720:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff8cb8ce751900) 00010000:00010000:0.0:1789049522.635722:0:6720:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c6b35800/0xf4f48ce5e1bbfcd4 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049522.635731:0:6720:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c6b35800/0xf4f48ce5e1bbfcd4 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049522.635738:0:6720:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c6b35800/0xf4f48ce5e1bbfcd4 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049522.635769:0:6720:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789049522.635834:0:6720:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb900e94700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e823b53a-3591-475c-8624-c682227e5c13+20:2357:x1875954089687040:12345-192.168.206.26@tcp:103:ldlm_bl.0 Request processed in 204us (399us total) trans 0 rc 0/0 00000100:00100000:0.0:1789049522.635868:0:6720:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.26@tcp, seq: 82 00010000:00010000:3.0:1789049522.637080:0:5850:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c6b35800/0xf4f48ce5e1bbfcd4 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049522.637093:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c6b35800/0xf4f48ce5e1bbfcd4 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789049522.638965:0:5850:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967516 00000001:00080000:3.0:1789049522.639533:0:5850:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967517 00000001:00080000:3.0:1789049522.639590:0:5850:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967518 00000100:00100000:3.0:1789049522.639957:0:5850:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb7c5c37480 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5850:1875954110639488:0@lo:1000:mdt00_000.0 00000100:00100000:3.0:1789049522.640040:0:5850:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789049522.640143:0:5850:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cb900e246c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789049522.640711:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954110639488 00000100:00100000:2.0:1789049522.640721:0:5856:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954110639488 00000100:00100000:2.0:1789049522.640837:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1789049522.640872:0:5856:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb7c5c35c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5850:x1875954110639488:12345-0@lo:1000:mdt00_000.0 00000100:00100000:2.0:1789049522.640989:0:5856:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb7c5c35c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5850:x1875954110639488:12345-0@lo:1000:mdt00_000.0 Request processed in 119us (949us total) trans 0 rc 0/0 00000100:00100000:2.0:1789049522.640996:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1789049522.641083:0:5850:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967321 gen 2 00000004:00080000:3.0:1789049522.641089:0:5850:0:(osp_trans.c:1063:osp_request_commit_cb()) trans no 4294967317 committed transno 4294967321 00000004:00080000:3.0:1789049522.641116:0:5850:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8cb900e94a80, transno 4294967321 00000100:00100000:3.0:1789049522.641213:0:5850:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb7c5c37480 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5850:1875954110639488:0@lo:1000:mdt00_000.0 00000001:00080000:3.0:1789049522.641751:0:5850:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967519 00000100:00100000:3.0:1789049522.641830:0:5850:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb7c5c37480 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5850:1875954110639616:0@lo:1000:mdt00_000.0 00000100:00100000:3.0:1789049522.641899:0:5850:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789049522.641924:0:5850:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cb900e24780 going to sleep for 11 seconds 00000100:00100000:0.0:1789049522.641961:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954110639616 00000100:00100000:0.0:1789049522.641968:0:5855:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954110639616 00000100:00100000:0.0:1789049522.642000:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1789049522.642008:0:5855:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb7c5c34a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5850:x1875954110639616:12345-0@lo:1000:mdt00_000.0 00000100:00100000:0.0:1789049522.642231:0:5855:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb7c5c34a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5850:x1875954110639616:12345-0@lo:1000:mdt00_000.0 Request processed in 223us (331us total) trans 4294967323 rc 0/0 00000100:00100000:0.0:1789049522.642238:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1789049522.644673:0:5850:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb7c5c37480 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5850:1875954110639616:0@lo:1000:mdt00_000.0 00010000:00010000:3.0:1789049522.644719:0:5850:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c6b35800/0xf4f48ce5e1bbfcd4 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049522.644731:0:5850:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c6b35800/0xf4f48ce5e1bbfcd4 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049522.644739:0:5850:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c6b35800/0xf4f48ce5e1bbfcd4 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049522.644746:0:5850:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cb8c6b35800 already unused, calling callback (ffffffffc20ca4f0) 00010000:00010000:3.0:1789049522.644750:0:5850:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c6b35800/0xf4f48ce5e1bbfcd4 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049522.644775:0:5850:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c6b35800/0xf4f48ce5e1bbfcd4 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049522.644802:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff8cb8ce751900) 00010000:00010000:3.0:1789049522.644805:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1789049522.644810:0:5850:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c6b35800/0xf4f48ce5e1bbfcd4 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049522.644817:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c6b35800/0xf4f48ce5e1bbfcd4 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049522.644863:0:5850:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6715c00/0xf4f48ce5e1bbfc17 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049522.644870:0:5850:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6715c00/0xf4f48ce5e1bbfc17 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049522.644876:0:5850:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6715c00/0xf4f48ce5e1bbfc17 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049522.644881:0:5850:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cb8d6715c00 already unused, calling callback (ffffffffc20ca4f0) 00010000:00010000:3.0:1789049522.644883:0:5850:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6715c00/0xf4f48ce5e1bbfc17 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049522.644890:0:5850:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6715c00/0xf4f48ce5e1bbfc17 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049522.644897:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8cb8c687d300) 00010000:00010000:3.0:1789049522.644899:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1789049522.644905:0:5850:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6714c00/0xf4f48ce5e1bbfc1e lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a36bd expref: 23 pid: 6841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049522.644927:0:5850:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6714c00/0xf4f48ce5e1bbfc1e lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a36bd expref: 23 pid: 6841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049522.644936:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6714c00/0xf4f48ce5e1bbfc1e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a36bd expref: 23 pid: 6841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049522.644974:0:5850:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6714c00/0xf4f48ce5e1bbfc1e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a36bd expref: 23 pid: 6841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789049522.644987:0:5850:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb7c5c34e00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5850:1875954110639744:192.168.206.26@tcp:105: 00000100:00100000:3.0:1789049522.645067:0:5850:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cb900e24780 going to sleep for 11 seconds 00000100:00100000:3.0:1789049522.653582:0:5850:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb7c5c34e00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5850:1875954110639744:192.168.206.26@tcp:105: 00010000:00010000:3.0:1789049522.653619:0:5850:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6715c00/0xf4f48ce5e1bbfc17 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049522.653630:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6715c00/0xf4f48ce5e1bbfc17 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049522.653660:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c6b34e00/0xf4f48ce5e1bbfcdb lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049522.653674:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c6b34e00/0xf4f48ce5e1bbfcdb lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049522.653684:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c6b34e00/0xf4f48ce5e1bbfcdb lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049522.653694:0:5850:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c6b34e00/0xf4f48ce5e1bbfcdb lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049522.653712:0:5850:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c6b34e00/0xf4f48ce5e1bbfcdb lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049522.653718:0:5850:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c6b34e00/0xf4f48ce5e1bbfcdb lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049522.653724:0:5850:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cb8c6b34e00 already unused, calling callback (ffffffffc20ca4f0) 00010000:00010000:3.0:1789049522.653728:0:5850:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c6b34e00/0xf4f48ce5e1bbfcdb lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049522.653734:0:5850:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c6b34e00/0xf4f48ce5e1bbfcdb lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049522.653744:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8cb8c687d300) 00010000:00010000:3.0:1789049522.653747:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789049522.653751:0:5850:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c6b34e00/0xf4f48ce5e1bbfcdb lrc: 2/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049522.653757:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c6b34e00/0xf4f48ce5e1bbfcdb lrc: 0/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049522.653765:0:5850:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c6b35400/0xf4f48ce5e1bbfccd lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049522.653771:0:5850:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c6b35400/0xf4f48ce5e1bbfccd lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049522.653792:0:5850:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c6b35400/0xf4f48ce5e1bbfccd lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049522.653797:0:5850:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cb8c6b35400 already unused, calling callback (ffffffffc20ca4f0) 00010000:00010000:3.0:1789049522.653805:0:5850:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c6b35400/0xf4f48ce5e1bbfccd lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049522.653811:0:5850:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c6b35400/0xf4f48ce5e1bbfccd lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049522.653819:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8cb8c687d300) 00010000:00010000:3.0:1789049522.653821:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1789049522.653824:0:5850:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c6b35400/0xf4f48ce5e1bbfccd lrc: 2/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049522.653830:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c6b35400/0xf4f48ce5e1bbfccd lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789049522.654047:0:5850:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb900e94e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e823b53a-3591-475c-8624-c682227e5c13+23:11593:x1875954089686912:12345-192.168.206.26@tcp:57:lhsmtool_posix.0 Request processed in 26377us (26575us total) trans 4294967520 rc 0/0 00000100:00100000:3.0:1789049522.654057:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.26@tcp, seq: 229 00000020:00080000:3.0:1789049522.654062:0:5850:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:0.0:1789049522.654213:0:11704:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1789049522.654218:0:11704:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1789049522.654697:0:11704:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 3 00000040:00080000:0.0:1789049522.654704:0:11704:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1789049522.666088:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.26@tcp (source: 12345-192.168.206.26@tcp) 00000100:00100000:1.0:1789049522.666302:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954089687168 00000100:00100000:1.0:1789049522.666312:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954089687168 00000100:00100000:1.0:1789049522.666459:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.26@tcp, seq: 61 00000100:00100000:1.0:1789049522.666470:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8c59cb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e823b53a-3591-475c-8624-c682227e5c13+23:11592:x1875954089687168:12345-192.168.206.26@tcp:49:lfs.0 00000100:00100000:0.0:1789049522.666633:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.26@tcp (source: 12345-192.168.206.26@tcp) 00000100:00100000:1.0:1789049522.666656:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8c59cb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e823b53a-3591-475c-8624-c682227e5c13+23:11592:x1875954089687168:12345-192.168.206.26@tcp:49:lfs.0 Request processed in 188us (579us total) trans 0 rc 0/0 00000100:00100000:1.0:1789049522.666663:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.26@tcp, seq: 61 00000100:00100000:1.0:1789049522.666679:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954089687424 00000100:00100000:1.0:1789049522.666682:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954089687424 00000100:00100000:1.0:1789049522.666696:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.26@tcp, seq: 62 00000100:00100000:1.0:1789049522.666702:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8d1d28850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e823b53a-3591-475c-8624-c682227e5c13+23:11593:x1875954089687424:12345-192.168.206.26@tcp:35:lhsmtool_posix.0 00000004:00080000:1.0:1789049522.667306:0:5854:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0x10:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:1.0:1789049522.667423:0:5854:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967521 00010000:00010000:1.0:1789049522.667468:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c2800/0xf4f48ce5e1bbfce2 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049522.667484:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c2800/0xf4f48ce5e1bbfce2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049522.667495:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c2800/0xf4f48ce5e1bbfce2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049522.667513:0:5854:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c2800/0xf4f48ce5e1bbfce2 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049522.667519:0:5854:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c2800/0xf4f48ce5e1bbfce2 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049522.667526:0:5854:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c2800/0xf4f48ce5e1bbfce2 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049522.667546:0:5854:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789049522.673821:0:5838:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789049522.673833:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c2800/0xf4f48ce5e1bbfce2 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049522.673874:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cb8c28c2800 already unused, calling callback (ffffffffc166a8f0) 00010000:00010000:0.0:1789049522.673878:0:5838:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c2800/0xf4f48ce5e1bbfce2 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049522.673888:0:5838:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c2800/0xf4f48ce5e1bbfce2 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049522.673905:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff8cb8c396d600) 00010000:00010000:0.0:1789049522.673908:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1789049522.673913:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c2800/0xf4f48ce5e1bbfce2 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049522.673928:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c2800/0xf4f48ce5e1bbfce2 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049522.673949:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789049522.673951:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789049522.673952:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789049522.674805:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8d1d28850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e823b53a-3591-475c-8624-c682227e5c13+25:11593:x1875954089687424:12345-192.168.206.26@tcp:35:lhsmtool_posix.0 Request processed in 8094us (8164us total) trans 4294967522 rc 0/0 00000100:00100000:1.0:1789049522.674818:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.26@tcp, seq: 62 00000020:00080000:1.0:1789049522.674826:0:5854:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1789049522.682661:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.26@tcp (source: 12345-192.168.206.26@tcp) 00000100:00100000:1.0:1789049522.682772:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954089687680 00000100:00100000:1.0:1789049522.682794:0:5851:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954089687680 00000100:00100000:1.0:1789049522.682893:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.26@tcp, seq: 230 00000100:00100000:1.0:1789049522.682908:0:5851:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb7c5c34e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e823b53a-3591-475c-8624-c682227e5c13+25:11592:x1875954089687680:12345-192.168.206.26@tcp:58:lfs.0 00000040:00080000:1.0:1789049522.683171:0:5851:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].6, 136 off9008 00000100:00100000:1.0:1789049522.683263:0:5851:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb7c5c34e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e823b53a-3591-475c-8624-c682227e5c13+25:11592:x1875954089687680:12345-192.168.206.26@tcp:58:lfs.0 Request processed in 345us (601us total) trans 0 rc 0/0 00000100:00100000:1.0:1789049522.683273:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.26@tcp, seq: 230 00000100:00100000:2.0:1789049522.740672:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.26@tcp (source: 12345-192.168.206.26@tcp) 00000100:00100000:0.0:1789049522.740774:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954089687808 00000100:00100000:0.0:1789049522.740799:0:5852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954089687808 00000100:00100000:0.0:1789049522.740910:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.26@tcp, seq: 231 00000100:00100000:0.0:1789049522.740921:0:5852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb900e95500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e823b53a-3591-475c-8624-c682227e5c13+25:11595:x1875954089687808:12345-192.168.206.26@tcp:101:lfs.0 00010000:00010000:0.0:1789049522.740957:0:5852:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789049522.740978:0:5852:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb7c4c39200/0xf4f48ce5e1bbfce9 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7fc5e358805a36f5 expref: -99 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049522.741049:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb7c4c39000/0xf4f48ce5e1bbfcf0 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049522.741062:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cb7c4c39000/0xf4f48ce5e1bbfcf0 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049522.741073:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb7c4c39000/0xf4f48ce5e1bbfcf0 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049522.741086:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb7c4c38e00/0xf4f48ce5e1bbfcf7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049522.741093:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cb7c4c38e00/0xf4f48ce5e1bbfcf7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049522.741099:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb7c4c38e00/0xf4f48ce5e1bbfcf7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049522.741307:0:5852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb7c4c39a00/0xf4f48ce5e1bbfcfe lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049522.741331:0:5852:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6714a00/0xf4f48ce5e1bbfc09 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a36b6 expref: 26 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049522.741340:0:5852:0:(ldlm_resource.c:1751:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cb7c4c39a00/0xf4f48ce5e1bbfcfe lrc: 4/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049522.741500:0:5852:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6714a00/0xf4f48ce5e1bbfc09 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a36b6 expref: 26 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049522.741521:0:5852:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6714a00/0xf4f48ce5e1bbfc09 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a36b6 expref: 26 pid: 5852 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789049522.741535:0:5852:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb8c59c9880 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5852:1875954110639872:192.168.206.26@tcp:104: 00000100:00100000:0.0:1789049522.741632:0:5852:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cb8c799f180 going to sleep for 11 seconds 00000100:00100000:3.0:1789049522.764547:0:5852:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb8c59c9880 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5852:1875954110639872:192.168.206.26@tcp:104: 00010000:00010000:3.0:1789049522.764591:0:5852:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8cb7c4c39a00/0xf4f48ce5e1bbfcfe lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789049522.765596:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.26@tcp (source: 12345-192.168.206.26@tcp) 00000100:00100000:1.0:1789049522.766484:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954089688064 00000100:00100000:1.0:1789049522.766499:0:5853:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954089688064 00000100:00100000:1.0:1789049522.766577:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.26@tcp, seq: 63 00000100:00100000:1.0:1789049522.766589:0:5853:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb900e95180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e823b53a-3591-475c-8624-c682227e5c13+27:9233:x1875954089688064:12345-192.168.206.26@tcp:35:ldlm_bl.0 00000100:00100000:1.0:1789049522.766840:0:5853:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb900e95180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e823b53a-3591-475c-8624-c682227e5c13+28:9233:x1875954089688064:12345-192.168.206.26@tcp:35:ldlm_bl.0 Request processed in 253us (1252us total) trans 4294967523 rc 0/0 00000100:00100000:1.0:1789049522.766905:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.26@tcp, seq: 63 00000100:00100000:0.0:1789049522.770552:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.26@tcp (source: 12345-192.168.206.26@tcp) 00000100:00100000:1.0:1789049522.773374:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954089688192 00000100:00100000:1.0:1789049522.773391:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954089688192 00010000:00010000:1.0:1789049522.773440:0:5835:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6714a00/0xf4f48ce5e1bbfc09 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a36b6 expref: 28 pid: 5852 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789049522.773486:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.26@tcp, seq: 83 00000100:00100000:1.0:1789049522.773496:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8c59cb480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e823b53a-3591-475c-8624-c682227e5c13+28:2357:x1875954089688192:12345-192.168.206.26@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789049522.773510:0:5835:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789049522.773517:0:5835:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6714a00/0xf4f48ce5e1bbfc09 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a36b6 expref: 28 pid: 5852 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049522.773529:0:5835:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6714a00/0xf4f48ce5e1bbfc09 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a36b6 expref: 28 pid: 5852 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049522.773550:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6714a00/0xf4f48ce5e1bbfc09 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a36b6 expref: 28 pid: 5852 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049522.773567:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8cb8c687d300) 00010000:00010000:1.0:1789049522.773573:0:5835:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8cb7c4c39a00/0xf4f48ce5e1bbfcfe lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049522.773582:0:5835:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb7c4c39a00/0xf4f48ce5e1bbfcfe lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049522.773590:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cb7c4c39a00/0xf4f48ce5e1bbfcfe lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049522.773639:0:5835:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789049522.773713:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8c59cb480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e823b53a-3591-475c-8624-c682227e5c13+27:2357:x1875954089688192:12345-192.168.206.26@tcp:103:ldlm_bl.0 Request processed in 218us (3167us total) trans 0 rc 0/0 00000100:00100000:1.0:1789049522.773721:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.26@tcp, seq: 83 00010000:00010000:3.0:1789049522.773727:0:5852:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8cb7c4c39a00/0xf4f48ce5e1bbfcfe lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049522.773745:0:5852:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb7c4c39a00/0xf4f48ce5e1bbfcfe lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789049522.773817:0:5852:0:(mdt_handler.c:922:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:3.0:1789049522.773823:0:5852:0:(mdt_handler.c:1587:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1789049522.773915:0:5852:0:(mdt_handler.c:2522:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8cb7c4c39a00/0xf4f48ce5e1bbfcfe lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049522.773935:0:5852:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cb7c4c39a00/0xf4f48ce5e1bbfcfe lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049522.779884:0:5852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb7c4c39000/0xf4f48ce5e1bbfcf0 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049522.779914:0:5852:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cb7c4c39000/0xf4f48ce5e1bbfcf0 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049522.779923:0:5852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cb7c4c39000/0xf4f48ce5e1bbfcf0 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049522.779930:0:5852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cb7c4c39000 already unused, calling callback (ffffffffc20ca4f0) 00010000:00010000:3.0:1789049522.779936:0:5852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb7c4c39000/0xf4f48ce5e1bbfcf0 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049522.779948:0:5852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb7c4c39000/0xf4f48ce5e1bbfcf0 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049522.779969:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8cb8e0130100) 00010000:00010000:3.0:1789049522.779972:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789049522.779978:0:5852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cb7c4c39000/0xf4f48ce5e1bbfcf0 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049522.779985:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb7c4c39000/0xf4f48ce5e1bbfcf0 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049522.780008:0:5852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb7c4c38e00/0xf4f48ce5e1bbfcf7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049522.780015:0:5852:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cb7c4c38e00/0xf4f48ce5e1bbfcf7 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049522.780045:0:5852:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cb7c4c38e00/0xf4f48ce5e1bbfcf7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049522.780051:0:5852:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cb7c4c38e00 already unused, calling callback (ffffffffc20ca4f0) 00010000:00010000:3.0:1789049522.780055:0:5852:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb7c4c38e00/0xf4f48ce5e1bbfcf7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049522.780062:0:5852:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb7c4c38e00/0xf4f48ce5e1bbfcf7 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049522.780070:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8cb8ce751300) 00010000:00010000:3.0:1789049522.780073:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789049522.780077:0:5852:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cb7c4c38e00/0xf4f48ce5e1bbfcf7 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049522.780083:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb7c4c38e00/0xf4f48ce5e1bbfcf7 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5852 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049522.780712:0:5852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb7c4c39200/0xf4f48ce5e1bbfce9 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a36f5 expref: 27 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049522.780735:0:5852:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb7c4c39a00/0xf4f48ce5e1bbfcfe lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a36f5 expref: 26 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049522.780743:0:5852:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8cb8c687d300) 00010000:00010000:3.0:1789049522.780745:0:5852:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789049522.780748:0:5852:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cb7c4c39a00, rc 0) 00000100:00100000:3.0:1789049522.780958:0:5852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb900e95500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e823b53a-3591-475c-8624-c682227e5c13+26:11595:x1875954089687808:12345-192.168.206.26@tcp:101:lfs.0 Request processed in 40036us (40297us total) trans 0 rc 0/0 00000100:00100000:3.0:1789049522.780984:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.26@tcp, seq: 231 00010000:00010000:1.0:1789049522.907935:0:6719:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789049523.522428:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.26@tcp (source: 12345-192.168.206.26@tcp) 00000100:00100000:3.0:1789049523.522464:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.26@tcp (source: 12345-192.168.206.26@tcp) 00000100:00100000:3.0:1789049523.522487:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.26@tcp (source: 12345-192.168.206.26@tcp) 00000100:00100000:3.0:1789049523.522508:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.26@tcp (source: 12345-192.168.206.26@tcp) 00000100:00100000:3.0:1789049523.522538:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.26@tcp (source: 12345-192.168.206.26@tcp) 00000100:00100000:2.0:1789049523.522548:0:12489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954089688576 00000100:00100000:3.0:1789049523.522566:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954089688832 00000100:00100000:2.0:1789049523.522567:0:12489:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954089688576 00000100:00100000:3.0:1789049523.522578:0:5851:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954089688832 00000100:00100000:3.0:1789049523.522649:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954089688448 00000100:00100000:2.0:1789049523.522652:0:12489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954089688704 00000100:00100000:3.0:1789049523.522654:0:5851:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954089688448 00000100:00100000:2.0:1789049523.522659:0:12489:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954089688704 00000100:00100000:3.0:1789049523.522695:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.26@tcp, seq: 153 00000100:00100000:3.0:1789049523.522715:0:5851:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb7c5c35500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:59d63492-f1ee-4aa5-bf8c-853a603b0252+5:2355:x1875954089688832:12345-192.168.206.26@tcp:400:kworker.0 00000100:00100000:2.0:1789049523.522726:0:12489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.26@tcp, seq: 73 00000100:00100000:2.0:1789049523.522741:0:12489:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb7c5c34700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:e823b53a-3591-475c-8624-c682227e5c13+7:2355:x1875954089688576:12345-192.168.206.26@tcp:400:kworker.0 00000100:00100000:3.0:1789049523.522817:0:5851:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb7c5c35500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:59d63492-f1ee-4aa5-bf8c-853a603b0252+5:2355:x1875954089688832:12345-192.168.206.26@tcp:400:kworker.0 Request processed in 108us (324us total) trans 0 rc 0/0 00000100:00100000:3.0:1789049523.522827:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.26@tcp, seq: 153 00000100:00100000:2.0:1789049523.522835:0:12489:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb7c5c34700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:e823b53a-3591-475c-8624-c682227e5c13+7:2355:x1875954089688576:12345-192.168.206.26@tcp:400:kworker.0 Request processed in 92us (362us total) trans 0 rc 0/0 00000100:00100000:2.0:1789049523.522874:0:12489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.26@tcp, seq: 73 00000100:00100000:2.0:1789049523.522894:0:12489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.26@tcp, seq: 74 00000100:00100000:2.0:1789049523.522902:0:12489:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb7c5c37800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:e823b53a-3591-475c-8624-c682227e5c13+5:2355:x1875954089688704:12345-192.168.206.26@tcp:400:kworker.0 00000100:00100000:2.0:1789049523.522929:0:12489:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb7c5c37800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:e823b53a-3591-475c-8624-c682227e5c13+5:2355:x1875954089688704:12345-192.168.206.26@tcp:400:kworker.0 Request processed in 29us (394us total) trans 0 rc 0/0 00000100:00100000:3.0:1789049523.522958:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.26@tcp, seq: 154 00000100:00100000:2.0:1789049523.522964:0:12489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.26@tcp, seq: 74 00000100:00100000:3.0:1789049523.522979:0:5851:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb7c5c35180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e823b53a-3591-475c-8624-c682227e5c13+26:2355:x1875954089688448:12345-192.168.206.26@tcp:400:kworker.0 00000100:00100000:3.0:1789049523.523023:0:5851:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb7c5c35180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e823b53a-3591-475c-8624-c682227e5c13+26:2355:x1875954089688448:12345-192.168.206.26@tcp:400:kworker.0 Request processed in 51us (512us total) trans 0 rc 0/0 00000100:00100000:3.0:1789049523.523029:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.26@tcp, seq: 154 00000100:00080000:3.0:1789049523.523061:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789049523.523066:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789049523.523249:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954089688320 00000100:00100000:1.0:1789049523.523255:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954089688320 00000100:00100000:1.0:1789049523.523291:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.26@tcp, seq: 295 00000100:00100000:1.0:1789049523.523298:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8c6bed050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:de93d576-ed8d-4d27-ab00-9189a62cea33+13:2355:x1875954089688320:12345-192.168.206.26@tcp:400:kworker.0 00000100:00100000:1.0:1789049523.523332:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8c6bed050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:de93d576-ed8d-4d27-ab00-9189a62cea33+13:2355:x1875954089688320:12345-192.168.206.26@tcp:400:kworker.0 Request processed in 34us (911us total) trans 0 rc 0/0 00000100:00100000:1.0:1789049523.523339:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.26@tcp, seq: 295 00000040:00080000:3.0:1789049523.677899:0:11704:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1789049523.677912:0:11704:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1789049523.677958:0:11704:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:3.0:1789049523.677965:0:11704:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1789049523.678144:0:11704:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb7c5c34000 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11704:1875954110640000:192.168.206.26@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1789049523.678433:0:11704:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cb900e240c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789049523.699304:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.26@tcp (source: 12345-192.168.206.26@tcp) 00000100:00100000:3.0:1789049523.699584:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954089688960 00000100:00100000:3.0:1789049523.699597:0:5851:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954089688960 00000100:00100000:3.0:1789049523.699677:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.26@tcp, seq: 232 00000100:00100000:3.0:1789049523.699693:0:5851:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8c59cbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e823b53a-3591-475c-8624-c682227e5c13+27:11606:x1875954089688960:12345-192.168.206.26@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1789049523.699833:0:5851:0:(mdt_handler.c:7990:mdt_fid2path()) path get [0x200000401:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1789049523.700013:0:5851:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8c59cbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e823b53a-3591-475c-8624-c682227e5c13+27:11606:x1875954089688960:12345-192.168.206.26@tcp:53:lhsmtool_posix.0 Request processed in 325us (723us total) trans 0 rc 0/0 00000100:00100000:3.0:1789049523.700022:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.26@tcp, seq: 232 00000100:00100000:3.0:1789049523.700455:0:11704:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb7c5c34000 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11704:1875954110640000:192.168.206.26@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1789049523.709298:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.26@tcp (source: 12345-192.168.206.26@tcp) 00000100:00100000:3.0:1789049523.709568:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954089689216 00000100:00100000:3.0:1789049523.709580:0:5850:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954089689216 00000100:00100000:3.0:1789049523.709671:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.26@tcp, seq: 233 00000100:00100000:3.0:1789049523.709685:0:5850:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb900e97800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e823b53a-3591-475c-8624-c682227e5c13+26:11606:x1875954089689216:12345-192.168.206.26@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789049523.709708:0:5850:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789049523.709730:0:5850:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c6b34e00/0xf4f48ce5e1bbfd05 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7fc5e358805a36fc expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049523.709834:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c6b35400/0xf4f48ce5e1bbfd0c lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049523.709866:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c6b35400/0xf4f48ce5e1bbfd0c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049523.709880:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c6b35400/0xf4f48ce5e1bbfd0c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789049523.709913:0:5850:0:(mdt_handler.c:922:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:3.0:1789049523.710054:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c6b34e00/0xf4f48ce5e1bbfd05 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a36fc expref: 29 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049523.710073:0:5850:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c6b35400/0xf4f48ce5e1bbfd0c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a36fc expref: 28 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049523.710081:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8cb8c687d300) 00010000:00010000:3.0:1789049523.710084:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789049523.710088:0:5850:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cb8c6b35400, rc 0) 00000100:00100000:3.0:1789049523.710147:0:5850:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb900e97800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e823b53a-3591-475c-8624-c682227e5c13+28:11606:x1875954089689216:12345-192.168.206.26@tcp:101:lhsmtool_posix.0 Request processed in 467us (861us total) trans 4294967524 rc 0/0 00000100:00100000:3.0:1789049523.710154:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.26@tcp, seq: 233 00000100:00100000:3.0:1789049523.717725:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.26@tcp (source: 12345-192.168.206.26@tcp) 00000100:00100000:3.0:1789049523.717786:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.26@tcp (source: 12345-192.168.206.26@tcp) 00000100:00100000:2.0:1789049523.718008:0:6720:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954089689600 00000100:00100000:2.0:1789049523.718019:0:6720:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954089689600 00000100:00100000:2.0:1789049523.718091:0:6720:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.26@tcp, seq: 17 00000100:00100000:2.0:1789049523.718102:0:6720:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb7c5c36d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e823b53a-3591-475c-8624-c682227e5c13+28:2358:x1875954089689600:12345-192.168.206.26@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789049523.718119:0:6720:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789049523.718143:0:6720:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c6b35400/0xf4f48ce5e1bbfd0c lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a36fc expref: 28 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049523.718164:0:6720:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8cb8c687d300) 00010000:00010000:2.0:1789049523.718169:0:6720:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789049523.718223:0:6720:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb7c5c36d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e823b53a-3591-475c-8624-c682227e5c13+27:2358:x1875954089689600:12345-192.168.206.26@tcp:103:ldlm_bl.0 Request processed in 123us (435us total) trans 0 rc 0/0 00000100:00100000:2.0:1789049523.718231:0:6720:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.26@tcp, seq: 17 00000100:00100000:1.0:1789049523.719804:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954089689472 00000100:00100000:1.0:1789049523.719816:0:5851:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954089689472 00000100:00100000:1.0:1789049523.719905:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.26@tcp, seq: 234 00000100:00100000:1.0:1789049523.719915:0:5851:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb7c5c34000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e823b53a-3591-475c-8624-c682227e5c13+27:11606:x1875954089689472:12345-192.168.206.26@tcp:57:lhsmtool_posix.0 00010000:00010000:1.0:1789049523.719991:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c3800/0xf4f48ce5e1bbfd1a lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049523.720009:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c3800/0xf4f48ce5e1bbfd1a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049523.720020:0:5851:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c3800/0xf4f48ce5e1bbfd1a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049523.720200:0:5851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c3800/0xf4f48ce5e1bbfd1a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049523.720243:0:5851:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c3800/0xf4f48ce5e1bbfd1a lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049523.720250:0:5851:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c3800/0xf4f48ce5e1bbfd1a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049523.720255:0:5851:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cb8c28c3800 already unused, calling callback (ffffffffc20ca4f0) 00010000:00010000:1.0:1789049523.720259:0:5851:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c3800/0xf4f48ce5e1bbfd1a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049523.720266:0:5851:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c3800/0xf4f48ce5e1bbfd1a lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049523.720277:0:5851:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8cb8c687d300) 00010000:00010000:1.0:1789049523.720280:0:5851:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1789049523.720285:0:5851:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c3800/0xf4f48ce5e1bbfd1a lrc: 2/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049523.720292:0:5851:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c3800/0xf4f48ce5e1bbfd1a lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5851 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789049523.720437:0:5851:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb7c5c34000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e823b53a-3591-475c-8624-c682227e5c13+28:11606:x1875954089689472:12345-192.168.206.26@tcp:57:lhsmtool_posix.0 Request processed in 523us (2723us total) trans 4294967525 rc 0/0 00000100:00100000:1.0:1789049523.720445:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.26@tcp, seq: 234 00000040:00080000:3.0:1789049523.720519:0:11704:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1789049523.720525:0:11704:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1789049523.720978:0:11704:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:3.0:1789049523.720986:0:11704:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1789049523.734729:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.26@tcp (source: 12345-192.168.206.26@tcp) 00000100:00100000:0.0:1789049523.734811:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954089689856 00000100:00100000:0.0:1789049523.734821:0:5853:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954089689856 00000100:00100000:0.0:1789049523.734893:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.26@tcp, seq: 64 00000100:00100000:0.0:1789049523.734914:0:5853:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8c59c9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e823b53a-3591-475c-8624-c682227e5c13+28:11606:x1875954089689856:12345-192.168.206.26@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1789049523.735366:0:5853:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8c59c9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e823b53a-3591-475c-8624-c682227e5c13+29:11606:x1875954089689856:12345-192.168.206.26@tcp:35:lhsmtool_posix.0 Request processed in 463us (644us total) trans 4294967526 rc 0/0 00000100:00100000:0.0:1789049523.735374:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.26@tcp, seq: 64 00000040:00080000:1.0:1789049523.869597:0:12529:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1789049523.869607:0:12529:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1789049523.869653:0:12529:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:1.0:1789049523.869661:0:12529:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:1.0:1789049523.931145:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789049524.095315:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.26@tcp (source: 12345-192.168.206.26@tcp) 00000100:00100000:3.0:1789049524.095839:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954089690112 00000100:00100000:3.0:1789049524.095864:0:5850:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954089690112 00000100:00100000:3.0:1789049524.095920:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.26@tcp, seq: 235 00000100:00100000:3.0:1789049524.095931:0:5850:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb7c5c35f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e823b53a-3591-475c-8624-c682227e5c13+29:11619:x1875954089690112:12345-192.168.206.26@tcp:101:lfs.0 00010000:00010000:3.0:1789049524.095956:0:5850:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789049524.095975:0:5850:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c6b35800/0xf4f48ce5e1bbfd21 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7fc5e358805a3703 expref: -99 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049524.096076:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c6b34e00/0xf4f48ce5e1bbfd28 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049524.096092:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c6b34e00/0xf4f48ce5e1bbfd28 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049524.096105:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c6b34e00/0xf4f48ce5e1bbfd28 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789049524.097209:0:5850:0:(mdt_handler.c:922:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:3.0:1789049524.097437:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c6b35800/0xf4f48ce5e1bbfd21 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a3703 expref: 32 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049524.097457:0:5850:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c6b34e00/0xf4f48ce5e1bbfd28 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a3703 expref: 31 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049524.097467:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8cb8c687d300) 00010000:00010000:3.0:1789049524.097470:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:3.0:1789049524.097473:0:5850:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cb8c6b34e00, rc 0) 00000100:00100000:3.0:1789049524.097552:0:5850:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb7c5c35f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e823b53a-3591-475c-8624-c682227e5c13+31:11619:x1875954089690112:12345-192.168.206.26@tcp:101:lfs.0 Request processed in 1623us (2244us total) trans 4294967527 rc 0/0 00000100:00100000:3.0:1789049524.097561:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.26@tcp, seq: 235 00000100:00100000:2.0:1789049524.103392:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.26@tcp (source: 12345-192.168.206.26@tcp) 00000100:00100000:1.0:1789049524.104048:0:6841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954089690240 00000100:00100000:1.0:1789049524.104066:0:6841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954089690240 00000100:00100000:1.0:1789049524.104191:0:6841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.26@tcp, seq: 236 00000100:00100000:1.0:1789049524.104203:0:6841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb900e94000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e823b53a-3591-475c-8624-c682227e5c13+31:11619:x1875954089690240:12345-192.168.206.26@tcp:54:lfs.0 00010000:00010000:1.0:1789049524.104375:0:6841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c3400/0xf4f48ce5e1bbfd36 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049524.104651:0:6841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c3400/0xf4f48ce5e1bbfd36 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049524.105010:0:6841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c3400/0xf4f48ce5e1bbfd36 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049524.105039:0:6841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c3400/0xf4f48ce5e1bbfd36 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049524.105046:0:6841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c3400/0xf4f48ce5e1bbfd36 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049524.105053:0:6841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c3400/0xf4f48ce5e1bbfd36 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049524.105059:0:6841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cb8c28c3400 already unused, calling callback (ffffffffc20ca4f0) 00010000:00010000:1.0:1789049524.105064:0:6841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c3400/0xf4f48ce5e1bbfd36 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049524.105071:0:6841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c3400/0xf4f48ce5e1bbfd36 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049524.105083:0:6841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8cb8c687d300) 00010000:00010000:1.0:1789049524.105086:0:6841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1789049524.105090:0:6841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c3400/0xf4f48ce5e1bbfd36 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049524.105108:0:6841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c3400/0xf4f48ce5e1bbfd36 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6841 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789049524.105414:0:6841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb900e94000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e823b53a-3591-475c-8624-c682227e5c13+31:11619:x1875954089690240:12345-192.168.206.26@tcp:54:lfs.0 Request processed in 1210us (2029us total) trans 0 rc 0/0 00000100:00100000:1.0:1789049524.105424:0:6841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.26@tcp, seq: 236 00000100:00100000:2.0:1789049524.247667:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.26@tcp (source: 12345-192.168.206.26@tcp) 00000100:00100000:1.0:1789049524.247785:0:6705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954089690368 00000100:00100000:1.0:1789049524.247796:0:6705:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954089690368 00000100:00100000:1.0:1789049524.247917:0:6705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.26@tcp, seq: 70 00000100:00100000:1.0:1789049524.247928:0:6705:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb900e96d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e823b53a-3591-475c-8624-c682227e5c13+7:2358:x1875954089690368:12345-192.168.206.26@tcp:101:cat.0 00010000:00010000:1.0:1789049524.247947:0:6705:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789049524.247979:0:6705:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006146009f/0xf4f48ce5e1bbfd3d lrc: 2/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x7fc5e358805a370a expref: -99 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1789049524.248009:0:6705:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x6:0x0] initial LVB size: 13, mtime: 0x18d3fb0f641e2fc0, atime: 0x18d3fb0f4dd36640, ctime: 0x18d3fb0f641e2fc0, blocks: 0xb 00010000:00010000:1.0:1789049524.248030:0:6705:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=350s v=(0 0) 00010000:00010000:1.0:1789049524.248034:0:6705:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789049524.248044:0:6705:0:(ldlm_resource.c:1751:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006146009f/0xf4f48ce5e1bbfd3d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a370a expref: 8 pid: 6705 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049524.248075:0:6705:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000006146009f/0xf4f48ce5e1bbfd3d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a370a expref: 8 pid: 6705 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049524.248096:0:6705:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cb8c28c3400, rc 0) 00000100:00100000:1.0:1789049524.248158:0:6705:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb900e96d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e823b53a-3591-475c-8624-c682227e5c13+8:2358:x1875954089690368:12345-192.168.206.26@tcp:101:cat.0 Request processed in 231us (499us total) trans 0 rc 0/0 00000100:00100000:1.0:1789049524.248179:0:6705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.26@tcp, seq: 70 00000100:00080000:3.0:1789049524.250516:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789049524.276384:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.26@tcp (source: 12345-192.168.206.26@tcp) 00000100:00100000:1.0:1789049524.277978:0:6708:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954089690496 00000100:00100000:1.0:1789049524.277994:0:6708:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954089690496 00002000:00100000:1.0:1789049524.278058:0:6708:0:(ofd_dev.c:2725:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x6:0x0] (0->4095) req@ffff8cb7c5c36a00 x1875954089690496/t0(0) o3->e823b53a-3591-475c-8624-c682227e5c13@192.168.206.26@tcp:25/0 lens 488/0 e 0 to 0 dl 1789049535 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789049524.278067:0:6708:0:(ofd_dev.c:2581:ofd_prolong_extent_locks()) Prolong locks for req ffff8cb7c5c36a00 with x1875954089690496 ext(0->4095) 00002000:00010000:1.0:1789049524.278073:0:6708:0:(ofd_dev.c:2730:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8cb7c5c36a00 00000100:00100000:1.0:1789049524.278110:0:6708:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.26@tcp, seq: 7 00000100:00100000:1.0:1789049524.278119:0:6708:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb7c5c36a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:e823b53a-3591-475c-8624-c682227e5c13+8:2355:x1875954089690496:12345-192.168.206.26@tcp:3:cat.0 00000100:00100000:1.0:1789049524.278379:0:6708:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb7c5c36a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:e823b53a-3591-475c-8624-c682227e5c13+8:2355:x1875954089690496:12345-192.168.206.26@tcp:3:cat.0 Request processed in 260us (2004us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1789049524.278387:0:6708:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.26@tcp, seq: 7 00002000:00100000:1.0:1789049524.278395:0:6708:0:(ofd_dev.c:2725:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x6:0x0] (0->4095) req@ffff8cb7c5c36a00 x1875954089690496/t0(0) o3->e823b53a-3591-475c-8624-c682227e5c13@192.168.206.26@tcp:25/0 lens 488/4536 e 0 to 0 dl 1789049535 ref 1 fl Complete:/600/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789049524.278403:0:6708:0:(ofd_dev.c:2581:ofd_prolong_extent_locks()) Prolong locks for req ffff8cb7c5c36a00 with x1875954089690496 ext(0->4095) 00002000:00010000:1.0:1789049524.278406:0:6708:0:(ofd_dev.c:2730:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8cb7c5c36a00 00010000:00010000:0.0:1789049524.955489:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789049525.985854:0:6719:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:2.0:1789049526.683309:0:6840:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 352735463598ns, next at 353735461383ns, rc = 0 00000100:00100000:3.0:1789049526.683371:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789049526.683391:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb900e94a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1875954110640128:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789049526.683455:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789049526.683666:0:6707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954110640128 00000100:00100000:0.0:1789049526.683674:0:6707:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954110640128 00000100:00100000:0.0:1789049526.683736:0:6707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1789049526.683746:0:6707:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb7c5c36680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3310:x1875954110640128:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789049526.683789:0:6707:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00080000:3.0:1789049526.683861:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789049526.683973:0:6707:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb7c5c36680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3310:x1875954110640128:12345-0@lo:13:osp-pre-0-0.0 Request processed in 229us (517us total) trans 0 rc 0/0 00000100:00100000:0.0:1789049526.683981:0:6707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1789049526.687257:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb900e94a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1875954110640128:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1789049527.013572:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789049527.707197:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb9009d7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1875954110640256:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789049527.707263:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789049527.707332:0:6707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954110640256 00000100:00100000:3.0:1789049527.707340:0:6707:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954110640256 00000100:00100000:3.0:1789049527.707406:0:6707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1789049527.707415:0:6707:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb9009d5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1875954110640256:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789049527.707449:0:6707:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 51052544 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789049527.707497:0:6707:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb9009d5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1875954110640256:12345-0@lo:13:osp-pre-1-0.0 Request processed in 83us (233us total) trans 0 rc 0/0 00000100:00100000:3.0:1789049527.707504:0:6707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00080000:3.0:1789049527.707523:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789049527.709281:0:3308:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967310 gen 2 00000004:00080000:0.0:1789049527.709291:0:3308:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8cb8f7ac8380, transno 4294967307 00000004:00080000:0.0:1789049527.709302:0:3308:0:(osp_trans.c:1063:osp_request_commit_cb()) trans no 4294967309 committed transno 4294967310 00000004:00080000:0.0:1789049527.709316:0:3308:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8cb8f7acad80, transno 4294967310 00000100:00100000:0.0:1789049527.709329:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb9009d7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1875954110640256:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789049527.709584:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb9009d7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:7ef694ec-1ea0-4f02-800c-d1279b4fdf12:3309:1875954110640384:0@lo:400:kworker.0 00000100:00100000:3.0:1789049527.709635:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789049527.709665:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb8fcf06680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3309:1875954110640896:0@lo:400:kworker.0 00000100:00100000:3.0:1789049527.709688:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789049527.709706:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789049527.709712:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb900a59180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3309:1875954110640768:0@lo:400:kworker.0 00000100:00100000:3.0:1789049527.709734:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789049527.709776:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954110640896 00000100:00100000:3.0:1789049527.709782:0:5852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954110640896 00000100:00100000:3.0:1789049527.709828:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:3.0:1789049527.709837:0:5852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8fcf06a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1875954110640896:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789049527.709897:0:5852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8fcf06a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1875954110640896:12345-0@lo:400:kworker.0 Request processed in 61us (207us total) trans 0 rc 0/0 00000100:00100000:3.0:1789049527.709903:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:2.0:1789049527.710220:0:6703:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954110640768 00000100:00100000:2.0:1789049527.710226:0:6703:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954110640768 00000100:00100000:2.0:1789049527.710254:0:6703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1789049527.710260:0:6703:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8fcf07480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3309:x1875954110640768:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789049527.710293:0:6703:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8fcf07480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3309:x1875954110640768:12345-0@lo:400:kworker.0 Request processed in 33us (558us total) trans 0 rc 0/0 00000100:00100000:2.0:1789049527.710309:0:6703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:3.0:1789049527.710610:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb900a58700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3310:1875954110640512:0@lo:400:kworker.0 00000100:00100000:3.0:1789049527.710645:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789049527.710712:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789049527.710719:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb900a59500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3310:1875954110640640:0@lo:400:kworker.0 00000100:00100000:3.0:1789049527.710742:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789049527.711096:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954110640384 00000100:00100000:1.0:1789049527.711102:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954110640384 00000100:00100000:1.0:1789049527.711133:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 296 00000100:00100000:1.0:1789049527.711141:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8c6bef850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7ef694ec-1ea0-4f02-800c-d1279b4fdf12+19:3309:x1875954110640384:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789049527.711179:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8c6bef850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7ef694ec-1ea0-4f02-800c-d1279b4fdf12+19:3309:x1875954110640384:12345-0@lo:400:kworker.0 Request processed in 38us (1543us total) trans 0 rc 0/0 00000100:00100000:1.0:1789049527.711185:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 296 00000100:00080000:3.0:1789049527.717216:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789049527.722758:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954110640512 00000100:00100000:2.0:1789049527.722774:0:5851:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954110640512 00000100:00100000:2.0:1789049527.722858:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954110640640 00000100:00100000:2.0:1789049527.722862:0:5851:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954110640640 00000100:00100000:2.0:1789049527.722893:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:2.0:1789049527.722902:0:5851:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8fcf05c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1875954110640512:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789049527.722986:0:5851:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8fcf05c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1875954110640512:12345-0@lo:400:kworker.0 Request processed in 85us (12340us total) trans 0 rc 0/0 00000100:00100000:2.0:1789049527.722994:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:2.0:1789049527.723010:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:2.0:1789049527.723017:0:5851:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8ff3c9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1875954110640640:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789049527.723045:0:5851:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8ff3c9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1875954110640640:12345-0@lo:400:kworker.0 Request processed in 29us (12302us total) trans 0 rc 0/0 00000100:00100000:2.0:1789049527.723050:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00080000:2.0:1789049527.723080:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789049527.726901:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb900a59180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3309:1875954110640768:0@lo:400:kworker.0 00000100:00100000:3.0:1789049527.726918:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb9009d7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:7ef694ec-1ea0-4f02-800c-d1279b4fdf12:3309:1875954110640384:0@lo:400:kworker.0 00000100:00100000:3.0:1789049527.726931:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb8fcf06680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3309:1875954110640896:0@lo:400:kworker.0 00000100:00100000:2.0:1789049527.729007:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb900a59500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3310:1875954110640640:0@lo:400:kworker.0 00000100:00100000:2.0:1789049527.729022:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb900a58700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3310:1875954110640512:0@lo:400:kworker.0 00000001:00080000:2.0:1789049527.877729:0:6731:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967323 is committed 00000001:00080000:2.0:1789049527.877762:0:6731:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967322 is committed 00000001:00080000:3.0:1789049527.885277:0:5872:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967526 is committed 00000004:00080000:3.0:1789049527.885309:0:5872:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 10 committed 00000001:00080000:3.0:1789049527.885322:0:5872:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967527 is committed 00000020:00080000:3.0:1789049527.885336:0:5872:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8cb900e246c0 refcount 2 committed 0 result 0 batchid 8 00000020:00080000:3.0:1789049527.885340:0:5872:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8cb8c6236f00 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8cb900e24840 00000020:00080000:3.0:1789049527.885344:0:5872:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8cb8c6236b00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8cb8fc942800 00000020:00080000:3.0:1789049527.885364:0:5872:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 7 batchid updated 00000020:00080000:3.0:1789049527.885495:0:5883:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 8 committed batchid 7 00000020:00080000:3.0:1789049527.885667:0:5883:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 7 00000100:00100000:3.0:1789049527.885677:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789049527.885696:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb8ff3ca680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3311:1875954110641024:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1789049527.885775:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789049527.885830:0:10560:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954110641024 00000100:00100000:3.0:1789049527.885866:0:10560:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954110641024 00000100:00100000:3.0:1789049527.885908:0:10560:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1789049527.885917:0:10560:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8fcf06680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3311:x1875954110641024:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:3.0:1789049527.886086:0:10560:0:(ofd_lvb.c:321:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb size from disk: 13 -> 13 00002000:00010000:3.0:1789049527.886102:0:10560:0:(ofd_lvb.c:328:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb mtime from disk: 1789049520519000000 -> 1789049520519000000 00002000:00010000:3.0:1789049527.886105:0:10560:0:(ofd_lvb.c:334:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb atime from disk: 1789049520145000000 -> 1789049520145000000 00002000:00010000:3.0:1789049527.886107:0:10560:0:(ofd_lvb.c:340:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb ctime from disk: 1789049520519000000 -> 1789049520519000000 00002000:00010000:3.0:1789049527.886109:0:10560:0:(ofd_lvb.c:346:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb blocks from disk: 11 -> 11 00000100:00100000:3.0:1789049527.886148:0:10560:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8fcf06680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3311:x1875954110641024:12345-0@lo:2:osp-syn-0-0.0 Request processed in 232us (373us total) trans 4294967324 rc 0/0 00000100:00100000:3.0:1789049527.886155:0:10560:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1789049527.886190:0:3311:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967323 gen 2 00000004:00080000:3.0:1789049527.886195:0:3311:0:(osp_trans.c:1063:osp_request_commit_cb()) trans no 4294967323 committed transno 4294967323 00000100:00100000:3.0:1789049527.886214:0:3311:0:(client.c:3170:ptlrpc_free_committed()) @@@ stopping search req@ffff8cb8ff3ca680 x1875954110641024/t4294967324(4294967324) o2->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 440/432 e 0 to 0 dl 1789049543 ref 2 fl Rpc:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000004:00080000:3.0:1789049527.886225:0:3311:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8cb8ff3ca680/2, rc 0, transno 4294967324 00000100:00100000:3.0:1789049527.886229:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb8ff3ca680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3311:1875954110641024:0@lo:2:osp-syn-0-0.0 00010000:00010000:0.0:1789049528.027051:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789049528.644166:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.26@tcp (source: 12345-192.168.206.26@tcp) 00000100:00100000:0.0:1789049528.644211:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.26@tcp (source: 12345-192.168.206.26@tcp) 00000100:00100000:0.0:1789049528.644250:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.26@tcp (source: 12345-192.168.206.26@tcp) 00000100:00100000:0.0:1789049528.644281:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.26@tcp (source: 12345-192.168.206.26@tcp) 00000100:00100000:0.0:1789049528.644324:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.26@tcp (source: 12345-192.168.206.26@tcp) 00000100:00100000:0.0:1789049528.644353:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954089691136 00000100:00100000:0.0:1789049528.644363:0:5852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954089691136 00000100:00100000:2.0:1789049528.644396:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954089690752 00000100:00100000:2.0:1789049528.644404:0:5851:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954089690752 00000100:00100000:0.0:1789049528.644423:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.26@tcp, seq: 158 00000100:00100000:0.0:1789049528.644436:0:5852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8c59c9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:59d63492-f1ee-4aa5-bf8c-853a603b0252+5:2357:x1875954089691136:12345-192.168.206.26@tcp:400:kworker.0 00000100:00100000:2.0:1789049528.644448:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.26@tcp, seq: 159 00000100:00100000:2.0:1789049528.644458:0:5851:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8c59cb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e823b53a-3591-475c-8624-c682227e5c13+18:2357:x1875954089690752:12345-192.168.206.26@tcp:400:kworker.0 00000100:00100000:1.0:1789049528.644544:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954089690624 00000100:00100000:1.0:1789049528.644549:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954089690624 00000100:00100000:1.0:1789049528.644577:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.26@tcp, seq: 297 00000100:00100000:1.0:1789049528.644584:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8c6bec850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:de93d576-ed8d-4d27-ab00-9189a62cea33+13:2357:x1875954089690624:12345-192.168.206.26@tcp:400:kworker.0 00000100:00100000:3.0:1789049528.644640:0:6705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954089690880 00000100:00100000:3.0:1789049528.644644:0:6705:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954089690880 00000100:00100000:3.0:1789049528.644681:0:6705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954089691008 00000100:00100000:3.0:1789049528.644684:0:6705:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954089691008 00000100:00100000:3.0:1789049528.644703:0:6705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.26@tcp, seq: 76 00000100:00100000:3.0:1789049528.644718:0:6705:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8d6a25450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e823b53a-3591-475c-8624-c682227e5c13+7:2357:x1875954089690880:12345-192.168.206.26@tcp:400:kworker.0 00000100:00100000:0.0:1789049528.645319:0:5852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8c59c9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:59d63492-f1ee-4aa5-bf8c-853a603b0252+5:2357:x1875954089691136:12345-192.168.206.26@tcp:400:kworker.0 Request processed in 884us (1064us total) trans 0 rc 0/0 00000100:00100000:0.0:1789049528.645339:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.26@tcp, seq: 158 00000100:00100000:0.0:1789049528.645387:0:6703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.26@tcp, seq: 77 00000100:00100000:0.0:1789049528.645396:0:6703:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8f7ac8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e823b53a-3591-475c-8624-c682227e5c13+5:2357:x1875954089691008:12345-192.168.206.26@tcp:400:kworker.0 00000100:00100000:2.0:1789049528.649565:0:5851:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8c59cb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e823b53a-3591-475c-8624-c682227e5c13+18:2357:x1875954089690752:12345-192.168.206.26@tcp:400:kworker.0 Request processed in 5035us (5208us total) trans 0 rc 0/0 00000100:00100000:2.0:1789049528.649595:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.26@tcp, seq: 159 00000100:00080000:2.0:1789049528.649691:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789049528.649709:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1789049528.649713:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789049528.650957:0:6705:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8d6a25450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e823b53a-3591-475c-8624-c682227e5c13+7:2357:x1875954089690880:12345-192.168.206.26@tcp:400:kworker.0 Request processed in 6244us (6741us total) trans 0 rc 0/0 00000100:00100000:1.0:1789049528.650957:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8c6bec850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:de93d576-ed8d-4d27-ab00-9189a62cea33+13:2357:x1875954089690624:12345-192.168.206.26@tcp:400:kworker.0 Request processed in 6356us (6782us total) trans 0 rc 0/0 00000100:00100000:3.0:1789049528.650969:0:6705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.26@tcp, seq: 76 00000100:00100000:1.0:1789049528.650972:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.26@tcp, seq: 297 00000100:00100000:0.0:1789049528.651537:0:6703:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8f7ac8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e823b53a-3591-475c-8624-c682227e5c13+5:2357:x1875954089691008:12345-192.168.206.26@tcp:400:kworker.0 Request processed in 6138us (7218us total) trans 0 rc 0/0 00000100:00100000:0.0:1789049528.651546:0:6703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.26@tcp, seq: 77 00010000:00010000:1.0:1789049529.051621:0:6719:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789049530.075323:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789049530.232426:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.26@tcp (source: 12345-192.168.206.26@tcp) 00000100:00100000:0.0:1789049530.232517:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954089691264 00000100:00100000:0.0:1789049530.232539:0:5852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954089691264 00000100:00100000:0.0:1789049530.232610:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.26@tcp, seq: 237 00000100:00100000:0.0:1789049530.232620:0:5852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb900e94a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e823b53a-3591-475c-8624-c682227e5c13+18:11280:x1875954089691264:12345-192.168.206.26@tcp:60:lhsmtool_posix.0 00000100:00100000:0.0:1789049530.232748:0:5852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb900e94a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e823b53a-3591-475c-8624-c682227e5c13+18:11280:x1875954089691264:12345-192.168.206.26@tcp:60:lhsmtool_posix.0 Request processed in 120us (321us total) trans 0 rc 0/0 00000100:00100000:0.0:1789049530.232756:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.26@tcp, seq: 237 00000100:00080000:2.0:1789049530.233208:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789049530.245239:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.26@tcp (source: 12345-192.168.206.26@tcp) 00000100:00100000:0.0:1789049530.245326:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954089691520 00000100:00100000:0.0:1789049530.245336:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954089691520 00000100:00100000:0.0:1789049530.245391:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.26@tcp, seq: 65 00000100:00100000:0.0:1789049530.245401:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb900e95c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e823b53a-3591-475c-8624-c682227e5c13+18:11280:x1875954089691520:12345-192.168.206.26@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1789049530.253643:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb900e95c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e823b53a-3591-475c-8624-c682227e5c13+19:11280:x1875954089691520:12345-192.168.206.26@tcp:35:lhsmtool_posix.0 Request processed in 8233us (8402us total) trans 4294967528 rc 0/0 00000100:00100000:3.0:1789049530.253658:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.26@tcp, seq: 65 00000040:00080000:0.0:1789049530.907164:0:11704:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1789049530.907174:0:11704:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1789049530.907468:0:11704:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 3 00000040:00080000:0.0:1789049530.907475:0:11704:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:0.0:1789049531.099101:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789049531.805405:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb900e95f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3311:1875954110641152:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789049531.805483:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789049531.805547:0:6707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954110641152 00000100:00100000:3.0:1789049531.805555:0:6707:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954110641152 00000100:00100000:3.0:1789049531.805603:0:6707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1789049531.805611:0:6707:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8fcf07480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3311:x1875954110641152:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789049531.805643:0:6707:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789049531.805682:0:6707:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8fcf07480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3311:x1875954110641152:12345-0@lo:13:osp-pre-0-0.0 Request processed in 72us (199us total) trans 0 rc 0/0 00000100:00100000:3.0:1789049531.805688:0:6707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00080000:3.0:1789049531.805705:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789049531.805750:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb900e95f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3311:1875954110641152:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1789049532.124063:0:6719:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1789049532.494656:0:12730:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1c: Test automated attach using Project ID with manual HSM restore ========================================================== 10:12:10 (1789049530) 00000100:00100000:3.0:1789049532.827298:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb900e42300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3309:1875954110641408:0@lo:400:kworker.0 00000100:00100000:3.0:1789049532.827409:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789049532.827481:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb900e40a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3309:1875954110641920:0@lo:400:kworker.0 00000100:00100000:3.0:1789049532.827506:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789049532.827548:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:3.0:1789049532.827556:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb900e40380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:7ef694ec-1ea0-4f02-800c-d1279b4fdf12:3309:1875954110641280:0@lo:400:kworker.0 00000100:00100000:3.0:1789049532.827589:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789049532.827962:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb900e41c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3309:1875954110641792:0@lo:400:kworker.0 00000100:00100000:3.0:1789049532.827989:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789049532.828019:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb900e43480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3311:1875954110641664:0@lo:400:kworker.0 00000100:00100000:3.0:1789049532.828041:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789049532.828058:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789049532.828078:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb900e42a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3311:1875954110641536:0@lo:400:kworker.0 00000100:00100000:3.0:1789049532.828104:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789049532.828129:0:6841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954110641408 00000100:00100000:3.0:1789049532.828137:0:6841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954110641408 00000100:00100000:3.0:1789049532.828177:0:6841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954110641792 00000100:00100000:3.0:1789049532.828180:0:6841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954110641792 00000100:00100000:3.0:1789049532.828199:0:6841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954110641536 00000100:00100000:3.0:1789049532.828201:0:6841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954110641536 00000100:00100000:3.0:1789049532.828220:0:6841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:3.0:1789049532.828227:0:6841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8fcf06680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1875954110641408:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789049532.828276:0:6841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8fcf06680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1875954110641408:12345-0@lo:400:kworker.0 Request processed in 49us (868us total) trans 0 rc 0/0 00000100:00100000:3.0:1789049532.828284:0:6841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:3.0:1789049532.828299:0:6841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:3.0:1789049532.828306:0:6841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8ff3c8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1875954110641792:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789049532.828333:0:6841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8ff3c8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1875954110641792:12345-0@lo:400:kworker.0 Request processed in 28us (343us total) trans 0 rc 0/0 00000100:00100000:3.0:1789049532.828338:0:6841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00100000:3.0:1789049532.828348:0:6841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:3.0:1789049532.828355:0:6841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb7c5c35880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1875954110641536:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789049532.828383:0:6841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb7c5c35880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1875954110641536:12345-0@lo:400:kworker.0 Request processed in 29us (278us total) trans 0 rc 0/0 00000100:00100000:3.0:1789049532.828389:0:6841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00100000:3.0:1789049532.828406:0:12489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954110641920 00000100:00100000:3.0:1789049532.828410:0:12489:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954110641920 00000100:00100000:3.0:1789049532.828432:0:12489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954110641664 00000100:00100000:3.0:1789049532.828434:0:12489:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954110641664 00000100:00100000:2.0:1789049532.828818:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:2.0:1789049532.828828:0:6704:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8ff3cbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3309:x1875954110641920:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789049532.828936:0:6704:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8ff3cbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3309:x1875954110641920:12345-0@lo:400:kworker.0 Request processed in 111us (1428us total) trans 0 rc 0/0 00000100:00100000:2.0:1789049532.828943:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00080000:2.0:1789049532.829330:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789049532.829336:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789049532.829352:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954110641280 00000100:00100000:2.0:1789049532.829358:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954110641280 00000100:00100000:2.0:1789049532.829438:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 298 00000100:00100000:2.0:1789049532.829446:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8c6bedc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7ef694ec-1ea0-4f02-800c-d1279b4fdf12+19:3309:x1875954110641280:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789049532.829498:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8c6bedc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7ef694ec-1ea0-4f02-800c-d1279b4fdf12+19:3309:x1875954110641280:12345-0@lo:400:kworker.0 Request processed in 53us (1908us total) trans 0 rc 0/0 00000100:00100000:2.0:1789049532.829505:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 298 00000100:00100000:2.0:1789049532.829880:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb900e40380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:7ef694ec-1ea0-4f02-800c-d1279b4fdf12:3309:1875954110641280:0@lo:400:kworker.0 00000100:00100000:2.0:1789049532.829896:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb900e41c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3309:1875954110641792:0@lo:400:kworker.0 00000100:00100000:2.0:1789049532.829907:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb900e42300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3309:1875954110641408:0@lo:400:kworker.0 00000100:00100000:2.0:1789049532.829946:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb900e40a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3309:1875954110641920:0@lo:400:kworker.0 00000100:00100000:2.0:1789049532.830005:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb900e42a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3311:1875954110641536:0@lo:400:kworker.0 00000100:00100000:3.0:1789049532.832949:0:12489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:3.0:1789049532.832970:0:12489:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8df4d0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+6:3311:x1875954110641664:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789049532.836273:0:12489:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8df4d0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+6:3311:x1875954110641664:12345-0@lo:400:kworker.0 Request processed in 3295us (8221us total) trans 0 rc 0/0 00000100:00100000:3.0:1789049532.836286:0:12489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:3.0:1789049532.837010:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb900e95f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1875954110642048:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789049532.837064:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789049532.838776:0:6707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954110642048 00000100:00100000:2.0:1789049532.838790:0:6707:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954110642048 00000100:00100000:2.0:1789049532.838876:0:6707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1789049532.838887:0:6707:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb7c5c37100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1875954110642048:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1789049532.838920:0:6707:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 51052544 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789049532.838988:0:6707:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb7c5c37100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1875954110642048:12345-0@lo:13:osp-pre-1-0.0 Request processed in 103us (1924us total) trans 0 rc 0/0 00000100:00100000:2.0:1789049532.838994:0:6707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1789049532.839072:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb900e95f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1875954110642048:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789049532.840028:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb900e43480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3311:1875954110641664:0@lo:400:kworker.0 00000001:00080000:0.0:1789049532.861489:0:6731:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967324 is committed 00000001:00080000:3.0:1789049532.915659:0:5872:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967528 is committed 00000020:00080000:3.0:1789049532.915678:0:5872:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 8 batchid updated 00000020:00080000:2.0:1789049532.915742:0:5883:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000020:00080000:2.0:1789049532.915752:0:5883:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00010000:00010000:1.0:1789049533.148006:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789049533.764166:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.26@tcp (source: 12345-192.168.206.26@tcp) 00000100:00100000:1.0:1789049533.764193:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.26@tcp (source: 12345-192.168.206.26@tcp) 00000100:00100000:1.0:1789049533.764239:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.26@tcp (source: 12345-192.168.206.26@tcp) 00000100:00100000:1.0:1789049533.764271:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954089691648 00000100:00100000:1.0:1789049533.764281:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954089691648 00000100:00100000:1.0:1789049533.764344:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.26@tcp, seq: 299 00000100:00100000:1.0:1789049533.764354:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8c6beec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:de93d576-ed8d-4d27-ab00-9189a62cea33+13:2357:x1875954089691648:12345-192.168.206.26@tcp:400:kworker.0 00000100:00100000:1.0:1789049533.764430:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8c6beec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:de93d576-ed8d-4d27-ab00-9189a62cea33+13:2357:x1875954089691648:12345-192.168.206.26@tcp:400:kworker.0 Request processed in 78us (190us total) trans 0 rc 0/0 00000100:00100000:1.0:1789049533.764438:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.26@tcp, seq: 299 00000100:00100000:3.0:1789049533.764948:0:6841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954089691776 00000100:00100000:3.0:1789049533.764953:0:6841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954089691776 00000100:00100000:3.0:1789049533.765005:0:6841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.26@tcp, seq: 163 00000100:00100000:3.0:1789049533.765014:0:6841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb900e43480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e823b53a-3591-475c-8624-c682227e5c13+18:2357:x1875954089691776:12345-192.168.206.26@tcp:400:kworker.0 00000100:00100000:3.0:1789049533.765074:0:6841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb900e43480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e823b53a-3591-475c-8624-c682227e5c13+18:2357:x1875954089691776:12345-192.168.206.26@tcp:400:kworker.0 Request processed in 51us (906us total) trans 0 rc 0/0 00000100:00100000:3.0:1789049533.765081:0:6841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.26@tcp, seq: 163 00000100:00080000:1.0:1789049533.765290:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789049533.765358:0:6703:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954089692032 00000100:00100000:2.0:1789049533.765363:0:6703:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954089692032 00000100:00100000:2.0:1789049533.765412:0:6703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.26@tcp, seq: 80 00000100:00100000:2.0:1789049533.765420:0:6703:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb900e40e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e823b53a-3591-475c-8624-c682227e5c13+5:2357:x1875954089692032:12345-192.168.206.26@tcp:400:kworker.0 00000100:00100000:2.0:1789049533.765456:0:6703:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb900e40e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e823b53a-3591-475c-8624-c682227e5c13+5:2357:x1875954089692032:12345-192.168.206.26@tcp:400:kworker.0 Request processed in 37us (1262us total) trans 0 rc 0/0 00000100:00100000:2.0:1789049533.765462:0:6703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.26@tcp, seq: 80 00000100:00080000:1.0:1789049533.767165:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789049533.769482:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.26@tcp (source: 12345-192.168.206.26@tcp) 00000100:00100000:1.0:1789049533.769512:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.26@tcp (source: 12345-192.168.206.26@tcp) 00000100:00100000:3.0:1789049533.769624:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954089692160 00000100:00100000:3.0:1789049533.769634:0:5851:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954089692160 00000100:00100000:3.0:1789049533.769694:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.26@tcp, seq: 164 00000100:00100000:3.0:1789049533.769703:0:5851:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb900e41500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:59d63492-f1ee-4aa5-bf8c-853a603b0252+5:2357:x1875954089692160:12345-192.168.206.26@tcp:400:kworker.0 00000100:00100000:3.0:1789049533.769773:0:5851:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb900e41500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:59d63492-f1ee-4aa5-bf8c-853a603b0252+5:2357:x1875954089692160:12345-192.168.206.26@tcp:400:kworker.0 Request processed in 70us (259us total) trans 0 rc 0/0 00000100:00100000:3.0:1789049533.769780:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.26@tcp, seq: 164 00000100:00100000:2.0:1789049533.770317:0:10560:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954089691904 00000100:00100000:2.0:1789049533.770338:0:10560:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954089691904 00000100:00100000:2.0:1789049533.770377:0:10560:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.26@tcp, seq: 81 00000100:00100000:2.0:1789049533.770385:0:10560:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb900e40700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e823b53a-3591-475c-8624-c682227e5c13+7:2357:x1875954089691904:12345-192.168.206.26@tcp:400:kworker.0 00000100:00100000:2.0:1789049533.770438:0:10560:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb900e40700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e823b53a-3591-475c-8624-c682227e5c13+7:2357:x1875954089691904:12345-192.168.206.26@tcp:400:kworker.0 Request processed in 55us (965us total) trans 0 rc 0/0 00000100:00100000:2.0:1789049533.770460:0:10560:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.26@tcp, seq: 81 00000100:00080000:1.0:1789049533.771787:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1789049533.771796:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1789049534.172307:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789049535.197184:0:6719:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789049535.210759:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.26@tcp (source: 12345-192.168.206.26@tcp) 00000100:00100000:3.0:1789049535.210937:0:6841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954089692288 00000100:00100000:3.0:1789049535.210946:0:6841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954089692288 00000100:00100000:3.0:1789049535.211028:0:6841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.26@tcp, seq: 238 00000100:00100000:3.0:1789049535.211040:0:6841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb900e41180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:59d63492-f1ee-4aa5-bf8c-853a603b0252+5:12285:x1875954089692288:12345-192.168.206.26@tcp:101:lsof.0 00010000:00010000:3.0:1789049535.211261:0:6841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789049535.211306:0:6841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c6b35a00/0xf4f48ce5e1bbfd44 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7fc5e358805a3711 expref: -99 pid: 6841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049535.211374:0:6841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c6b35800/0xf4f48ce5e1bbfd4b lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049535.211388:0:6841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c6b35800/0xf4f48ce5e1bbfd4b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049535.211398:0:6841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c6b35800/0xf4f48ce5e1bbfd4b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6841 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789049535.211429:0:6841:0:(mdt_handler.c:922:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:3.0:1789049535.211433:0:6841:0:(mdt_handler.c:1587:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1789049535.211466:0:6841:0:(mdt_handler.c:2522:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c6b35800/0xf4f48ce5e1bbfd4b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049535.211486:0:6841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c6b35a00/0xf4f48ce5e1bbfd44 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a3711 expref: 7 pid: 6841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049535.211503:0:6841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c6b35800/0xf4f48ce5e1bbfd4b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a3711 expref: 6 pid: 6841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049535.211511:0:6841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8cb8e0130500) 00010000:00010000:3.0:1789049535.211514:0:6841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1789049535.211518:0:6841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cb8c6b35800, rc 0) 00000100:00100000:3.0:1789049535.211577:0:6841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb900e41180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:59d63492-f1ee-4aa5-bf8c-853a603b0252+6:12285:x1875954089692288:12345-192.168.206.26@tcp:101:lsof.0 Request processed in 541us (827us total) trans 0 rc 0/0 00000100:00100000:3.0:1789049535.211583:0:6841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.26@tcp, seq: 238 00000100:00080000:1.0:1789049535.212340:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1789049536.219215:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789049536.855536:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.26@tcp (source: 12345-192.168.206.26@tcp) 00000100:00100000:3.0:1789049536.855631:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954089692544 00000100:00100000:3.0:1789049536.855641:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954089692544 00000100:00100000:3.0:1789049536.855924:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.26@tcp, seq: 66 00000100:00100000:3.0:1789049536.855937:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb900e43800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e823b53a-3591-475c-8624-c682227e5c13+18:12287:x1875954089692544:12345-192.168.206.26@tcp:35:umount.0 00000100:00100000:3.0:1789049536.856261:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb900e43800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e823b53a-3591-475c-8624-c682227e5c13+19:12287:x1875954089692544:12345-192.168.206.26@tcp:35:umount.0 Request processed in 327us (733us total) trans 4294967529 rc 0/0 00000100:00080000:1.0:1789049536.856310:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789049536.856609:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.26@tcp, seq: 66 00000100:00100000:0.0:1789049536.867537:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.26@tcp (source: 12345-192.168.206.26@tcp) 00000100:00100000:2.0:1789049536.867655:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954089692800 00000100:00100000:2.0:1789049536.867671:0:5853:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954089692800 00000100:00100000:2.0:1789049536.867756:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.26@tcp, seq: 67 00000100:00100000:2.0:1789049536.867768:0:5853:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8f7acad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e823b53a-3591-475c-8624-c682227e5c13+19:12287:x1875954089692800:12345-192.168.206.26@tcp:35:umount.0 00000100:00100000:2.0:1789049536.868247:0:5853:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8f7acad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e823b53a-3591-475c-8624-c682227e5c13+20:12287:x1875954089692800:12345-192.168.206.26@tcp:35:umount.0 Request processed in 481us (722us total) trans 4294967530 rc 0/0 00000100:00100000:2.0:1789049536.868257:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.26@tcp, seq: 67 00000100:00100000:0.0:1789049536.872363:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.26@tcp (source: 12345-192.168.206.26@tcp) 00000100:00100000:2.0:1789049536.879891:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954089693056 00000100:00100000:2.0:1789049536.879904:0:5853:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954089693056 00000100:00100000:2.0:1789049536.879974:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.26@tcp, seq: 68 00000100:00100000:2.0:1789049536.879986:0:5853:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8d1d29c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e823b53a-3591-475c-8624-c682227e5c13+20:12287:x1875954089693056:12345-192.168.206.26@tcp:35:umount.0 00000100:00100000:2.0:1789049536.880258:0:5853:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8d1d29c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e823b53a-3591-475c-8624-c682227e5c13+21:12287:x1875954089693056:12345-192.168.206.26@tcp:35:umount.0 Request processed in 273us (7903us total) trans 4294967531 rc 0/0 00000100:00100000:2.0:1789049536.880266:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.26@tcp, seq: 68 00000100:00100000:1.0:1789049536.888601:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.26@tcp (source: 12345-192.168.206.26@tcp) 00000100:00100000:3.0:1789049536.888744:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954089693312 00000100:00100000:3.0:1789049536.888758:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954089693312 00000100:00100000:3.0:1789049536.888876:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.26@tcp, seq: 69 00000100:00100000:3.0:1789049536.888889:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb900e40000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e823b53a-3591-475c-8624-c682227e5c13+21:12287:x1875954089693312:12345-192.168.206.26@tcp:35:umount.0 00000100:00100000:3.0:1789049536.889711:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb900e40000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e823b53a-3591-475c-8624-c682227e5c13+22:12287:x1875954089693312:12345-192.168.206.26@tcp:35:umount.0 Request processed in 813us (1117us total) trans 4294967532 rc 0/0 00000100:00100000:3.0:1789049536.889722:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.26@tcp, seq: 69 00000100:00100000:0.0:1789049536.895499:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.26@tcp (source: 12345-192.168.206.26@tcp) 00000100:00100000:0.0:1789049536.895686:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.26@tcp (source: 12345-192.168.206.26@tcp) 00000100:00100000:0.0:1789049536.895727:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.26@tcp (source: 12345-192.168.206.26@tcp) 00000100:00100000:0.0:1789049536.895892:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.26@tcp (source: 12345-192.168.206.26@tcp) 00000100:00100000:3.0:1789049536.898203:0:6705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954089693440 00000100:00100000:3.0:1789049536.898225:0:6705:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954089693440 00000100:00100000:3.0:1789049536.898324:0:6705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.26@tcp, seq: 72 00000100:00100000:3.0:1789049536.898337:0:6705:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8f7acad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e823b53a-3591-475c-8624-c682227e5c13+5:2354:x1875954089693440:12345-192.168.206.26@tcp:9:umount.0 00000020:00000080:3.0:1789049536.898380:0:6705:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xf4f48ce5e1bbf0a9 00000100:00080000:3.0:1789049536.898391:0:6705:0:(import.c:65:import_set_state_nolock()) ffff8cb8df3d3000 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1789049536.898436:0:6705:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967310 00000100:00080000:0.0:1789049536.900764:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:0.0:1789049536.900791:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789049536.904465:0:6705:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8f7acad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e823b53a-3591-475c-8624-c682227e5c13+2:2354:x1875954089693440:12345-192.168.206.26@tcp:9:umount.0 Request processed in 6122us (8970us total) trans 0 rc 0/0 00000100:00100000:3.0:1789049536.904479:0:6705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.26@tcp, seq: 72 00000100:00100000:2.0:1789049536.904641:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954089693696 00000100:00100000:2.0:1789049536.904650:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954089693696 00000100:00100000:2.0:1789049536.904723:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954089693568 00000100:00100000:2.0:1789049536.904727:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954089693568 00000100:00100000:2.0:1789049536.904743:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954089693824 00000100:00100000:2.0:1789049536.904745:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954089693824 00000100:00100000:2.0:1789049536.904762:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.26@tcp, seq: 18 00000100:00100000:2.0:1789049536.904772:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8f7aca300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:de93d576-ed8d-4d27-ab00-9189a62cea33+15:2358:x1875954089693696:12345-192.168.206.26@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789049536.904785:0:5836:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789049536.904804:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cb8d776e400/0xf4f48ce5e1bbed37 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a326b expref: 15 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789049536.904817:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.26@tcp, seq: 19 00000100:00100000:3.0:1789049536.904829:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb9009c3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:de93d576-ed8d-4d27-ab00-9189a62cea33+15:2358:x1875954089693568:12345-192.168.206.26@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789049536.904840:0:5836:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789049536.904871:0:5835:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789049536.904884:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cb8d776f200/0xf4f48ce5e1bbed6f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x44801000000000 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a32a3 expref: 14 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049536.904899:0:5835:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789049536.904916:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8f7aca300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:de93d576-ed8d-4d27-ab00-9189a62cea33+13:2358:x1875954089693696:12345-192.168.206.26@tcp:103:ldlm_bl.0 Request processed in 144us (9229us total) trans 0 rc 0/0 00000100:00100000:3.0:1789049536.904927:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb9009c3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:de93d576-ed8d-4d27-ab00-9189a62cea33+13:2358:x1875954089693568:12345-192.168.206.26@tcp:103:ldlm_bl.0 Request processed in 100us (9196us total) trans 0 rc 0/0 00000100:00100000:2.0:1789049536.904928:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.26@tcp, seq: 18 00000100:00100000:3.0:1789049536.904940:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.26@tcp, seq: 19 00000100:00100000:2.0:1789049536.904950:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.26@tcp, seq: 20 00000100:00100000:2.0:1789049536.904960:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8c7937850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:de93d576-ed8d-4d27-ab00-9189a62cea33+11:2358:x1875954089693824:12345-192.168.206.26@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789049536.904969:0:5836:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789049536.904979:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cb8c6b34c00/0xf4f48ce5e1bbefe5 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a336e expref: 11 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049536.904988:0:5836:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789049536.905008:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8c7937850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:de93d576-ed8d-4d27-ab00-9189a62cea33+10:2358:x1875954089693824:12345-192.168.206.26@tcp:103:ldlm_bl.0 Request processed in 50us (9116us total) trans 0 rc 0/0 00000100:00100000:2.0:1789049536.905014:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.26@tcp, seq: 20 00000100:00100000:0.0:1789049536.911686:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.26@tcp (source: 12345-192.168.206.26@tcp) 00000100:00100000:3.0:1789049536.911772:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954089694208 00000100:00100000:3.0:1789049536.911963:0:6704:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954089694208 00000100:00100000:3.0:1789049536.912026:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.26@tcp, seq: 73 00000100:00100000:3.0:1789049536.912036:0:6704:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb9009c1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e823b53a-3591-475c-8624-c682227e5c13+7:2354:x1875954089694208:12345-192.168.206.26@tcp:9:umount.0 00000020:00000080:3.0:1789049536.912064:0:6704:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xf4f48ce5e1bbf311 00000020:00010000:3.0:1789049536.912071:0:6704:0:(genops.c:1920:obd_stale_export_put()) Put export ffff8cb8df3d5000: total 0 00000100:00080000:3.0:1789049536.912075:0:6704:0:(import.c:65:import_set_state_nolock()) ffff8cb8df3d7800 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1789049536.912114:0:6704:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967324 00000020:00010000:1.0:1789049536.912239:0:6719:0:(genops.c:1906:obd_stale_export_get()) Get export ffff8cb8df3d5000: total 0 00010000:00010000:1.0:1789049536.912315:0:6719:0:(ldlm_lock.c:2657:ldlm_export_cancel_blocked_locks()) Export ffff8cb8df3d5000, canceled 0 locks, left on hash table 2. 00000100:00100000:3.0:1789049536.912400:0:6704:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb9009c1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e823b53a-3591-475c-8624-c682227e5c13+5:2354:x1875954089694208:12345-192.168.206.26@tcp:9:umount.0 Request processed in 363us (719us total) trans 0 rc 0/0 00010000:00010000:1.0:1789049536.912407:0:6719:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000059a1f1e5/0xf4f48ce5e1bbf6ad lrc: 0/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a3543 expref: 5 pid: 6703 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789049536.912415:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.26@tcp, seq: 73 00010000:00010000:1.0:1789049536.912467:0:6719:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006146009f/0xf4f48ce5e1bbfd3d lrc: 0/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a370a expref: 3 pid: 6705 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049536.912484:0:6719:0:(ldlm_lock.c:2685:ldlm_export_cancel_locks()) Export ffff8cb8df3d5000, canceled 2 locks, left on hash table 0. 00010000:00010000:1.0:1789049536.912505:0:6719:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789049536.912507:0:6719:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789049536.912509:0:6719:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1789049536.912973:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789049536.923678:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb900e94700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3311:1875954110642176:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789049536.923749:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789049536.923962:0:6707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954110642176 00000100:00100000:2.0:1789049536.923971:0:6707:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954110642176 00000100:00100000:2.0:1789049536.924026:0:6707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1789049536.924034:0:6707:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb900e42d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1875954110642176:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789049536.924064:0:6707:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789049536.924111:0:6707:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb900e42d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1875954110642176:12345-0@lo:13:osp-pre-0-0.0 Request processed in 78us (362us total) trans 0 rc 0/0 00000100:00100000:2.0:1789049536.924118:0:6707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1789049536.924452:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.26@tcp (source: 12345-192.168.206.26@tcp) 00000100:00100000:3.0:1789049536.924515:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954089695232 00000100:00100000:3.0:1789049536.924520:0:5851:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954089695232 00000100:00100000:3.0:1789049536.924559:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.26@tcp, seq: 239 00000100:00100000:3.0:1789049536.924566:0:5851:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb900e95180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e823b53a-3591-475c-8624-c682227e5c13+22:2354:x1875954089695232:12345-192.168.206.26@tcp:39:umount.0 00000020:00000080:3.0:1789049536.924585:0:5851:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xf4f48ce5e1bbed45 00000020:00010000:3.0:1789049536.924598:0:5851:0:(genops.c:1920:obd_stale_export_put()) Put export ffff8cb8c622e000: total 0 00000100:00080000:3.0:1789049536.924602:0:5851:0:(import.c:65:import_set_state_nolock()) ffff8cb8c6229000 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1789049536.924618:0:5851:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967532 00000100:00100000:3.0:1789049536.925017:0:5851:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb900e95180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e823b53a-3591-475c-8624-c682227e5c13+21:2354:x1875954089695232:12345-192.168.206.26@tcp:39:umount.0 Request processed in 450us (565us total) trans 4294967533 rc 0/0 00000100:00100000:3.0:1789049536.925025:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.26@tcp, seq: 239 00000020:00010000:1.0:1789049536.925172:0:5839:0:(genops.c:1906:obd_stale_export_get()) Get export ffff8cb8c622e000: total 0 00010000:00010000:1.0:1789049536.925211:0:5839:0:(ldlm_lock.c:2657:ldlm_export_cancel_blocked_locks()) Export ffff8cb8c622e000, canceled 0 locks, left on hash table 13. 00010000:00010000:1.0:1789049536.925239:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff8cb8c396d700) 00010000:00010000:1.0:1789049536.925243:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1789049536.925251:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c146ca00/0xf4f48ce5e1bbf00f lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a337c expref: 20 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049536.925345:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8cb8c687d300) 00010000:00010000:1.0:1789049536.925348:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789049536.925353:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb7c4c39a00/0xf4f48ce5e1bbfcfe lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a36f5 expref: 19 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049536.925365:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8cb8e0130500) 00010000:00010000:1.0:1789049536.925367:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1789049536.925370:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6714e00/0xf4f48ce5e1bbf701 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a3558 expref: 18 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049536.925381:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8cb8c396df00) 00010000:00010000:1.0:1789049536.925382:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1789049536.925386:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c2a00/0xf4f48ce5e1bbf36c lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a346a expref: 17 pid: 6841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049536.925397:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8cb8ce751200) 00010000:00010000:1.0:1789049536.925399:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1789049536.925402:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6715800/0xf4f48ce5e1bbf58e lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a34f6 expref: 16 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049536.925413:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8cb8c396df00) 00010000:00010000:1.0:1789049536.925415:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:1.0:1789049536.925418:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d776fa00/0xf4f48ce5e1bbf07f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a3398 expref: 15 pid: 6841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049536.925431:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8cb8c687d300) 00010000:00010000:1.0:1789049536.925434:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:1.0:1789049536.925445:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c6b34e00/0xf4f48ce5e1bbfd28 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a3703 expref: 14 pid: 5850 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049536.925460:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8cb8c687d300) 00010000:00010000:1.0:1789049536.925463:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1789049536.925467:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6714c00/0xf4f48ce5e1bbfc1e lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a36bd expref: 13 pid: 6841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049536.925481:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8cb8e0130100) 00010000:00010000:1.0:1789049536.925483:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:1.0:1789049536.925487:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6714000/0xf4f48ce5e1bbf71d lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a355f expref: 12 pid: 6841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049536.925498:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8cb8e0130a00) 00010000:00010000:1.0:1789049536.925500:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789049536.925503:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6715000/0xf4f48ce5e1bbf02b lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a3383 expref: 11 pid: 5852 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049536.925516:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8cb8e0130100) 00010000:00010000:1.0:1789049536.925518:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1789049536.925521:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c3600/0xf4f48ce5e1bbf9fc lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a3631 expref: 10 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049536.925532:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8cb8ce751200) 00010000:00010000:1.0:1789049536.925534:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:1.0:1789049536.925537:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c6b35c00/0xf4f48ce5e1bbf698 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a353c expref: 9 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049536.925546:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8cb8ce751200) 00010000:00010000:1.0:1789049536.925554:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789049536.925558:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c3a00/0xf4f48ce5e1bbf66e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a352e expref: 8 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049536.925570:0:5839:0:(ldlm_lock.c:2685:ldlm_export_cancel_locks()) Export ffff8cb8c622e000, canceled 13 locks, left on hash table 0. 00010000:00010000:1.0:1789049536.925581:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789049536.925583:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789049536.925584:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789049536.925614:0:3311:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967324 gen 2 00000004:00080000:1.0:1789049536.925619:0:3311:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8cb8ff3ca680, transno 4294967324 00000100:00100000:1.0:1789049536.925644:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb900e94700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3311:1875954110642176:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1789049536.925804:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1789049537.243072:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789049537.947185:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb7c5c34700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3310:1875954110642560:0@lo:400:kworker.0 00000100:00100000:1.0:1789049537.947261:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789049537.947333:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789049537.947340:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb7c5c37800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1875954110642688:0@lo:400:kworker.0 00000100:00100000:1.0:1789049537.947365:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789049537.947398:0:12489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954110642688 00000100:00100000:1.0:1789049537.947418:0:12489:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954110642688 00000100:00100000:1.0:1789049537.947465:0:12489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:1.0:1789049537.947474:0:12489:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb900e43800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3310:x1875954110642688:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789049537.947538:0:12489:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb900e43800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3310:x1875954110642688:12345-0@lo:400:kworker.0 Request processed in 65us (171us total) trans 0 rc 0/0 00000100:00100000:1.0:1789049537.947545:0:12489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:1.0:1789049537.947587:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb7c5c37800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1875954110642688:0@lo:400:kworker.0 00000100:00100000:3.0:1789049537.947731:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954110642560 00000100:00100000:3.0:1789049537.947736:0:5850:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954110642560 00000100:00100000:3.0:1789049537.947790:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 165 00000100:00100000:3.0:1789049537.947799:0:5850:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb900e41f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1875954110642560:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789049537.947836:0:5850:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb900e41f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1875954110642560:12345-0@lo:400:kworker.0 Request processed in 40us (575us total) trans 0 rc 0/0 00000100:00100000:3.0:1789049537.947865:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 165 00000100:00100000:2.0:1789049537.948054:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb7c5c37b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7ef694ec-1ea0-4f02-800c-d1279b4fdf12:3308:1875954110642304:0@lo:400:kworker.0 00000100:00100000:2.0:1789049537.948088:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789049537.948127:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb7c5c37480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3308:1875954110642816:0@lo:400:kworker.0 00000100:00100000:2.0:1789049537.948150:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789049537.948169:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1789049537.948174:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb7c5c34380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3308:1875954110642432:0@lo:400:kworker.0 00000100:00100000:2.0:1789049537.948193:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789049537.948209:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb7c5c36300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1875954110642944:0@lo:400:kworker.0 00000100:00100000:2.0:1789049537.948230:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789049537.948270:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954110642304 00000100:00100000:2.0:1789049537.948274:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954110642304 00000100:00100000:2.0:1789049537.948303:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 300 00000100:00100000:2.0:1789049537.948309:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8c6bec450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7ef694ec-1ea0-4f02-800c-d1279b4fdf12+19:3308:x1875954110642304:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789049537.948343:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8c6bec450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7ef694ec-1ea0-4f02-800c-d1279b4fdf12+19:3308:x1875954110642304:12345-0@lo:400:kworker.0 Request processed in 35us (255us total) trans 0 rc 0/0 00000100:00100000:2.0:1789049537.948348:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 300 00000100:00100000:2.0:1789049537.948373:0:6703:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954110642944 00000100:00100000:2.0:1789049537.948376:0:6703:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954110642944 00000100:00100000:2.0:1789049537.948400:0:6703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:2.0:1789049537.948420:0:6703:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb900e96680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3308:x1875954110642944:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789049537.948449:0:6703:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb900e96680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3308:x1875954110642944:12345-0@lo:400:kworker.0 Request processed in 31us (219us total) trans 0 rc 0/0 00000100:00100000:2.0:1789049537.948455:0:6703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:2.0:1789049537.948706:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954110642816 00000100:00100000:2.0:1789049537.948711:0:5852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954110642816 00000100:00100000:2.0:1789049537.948737:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954110642432 00000100:00100000:2.0:1789049537.948740:0:5852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954110642432 00000100:00100000:2.0:1789049537.948760:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 166 00000100:00100000:2.0:1789049537.948766:0:5852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb900e95c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1875954110642816:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789049537.948807:0:5852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb900e95c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1875954110642816:12345-0@lo:400:kworker.0 Request processed in 42us (656us total) trans 0 rc 0/0 00000100:00100000:2.0:1789049537.948815:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 166 00000100:00100000:2.0:1789049537.948826:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 167 00000100:00100000:2.0:1789049537.948832:0:5852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb900e95f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1875954110642432:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789049537.948884:0:5852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb900e95f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1875954110642432:12345-0@lo:400:kworker.0 Request processed in 53us (690us total) trans 0 rc 0/0 00000100:00100000:2.0:1789049537.948889:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 167 00000100:00100000:2.0:1789049537.948923:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb7c5c34380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3308:1875954110642432:0@lo:400:kworker.0 00000100:00100000:2.0:1789049537.948933:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb7c5c36300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1875954110642944:0@lo:400:kworker.0 00000100:00100000:2.0:1789049537.948939:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb7c5c37b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7ef694ec-1ea0-4f02-800c-d1279b4fdf12:3308:1875954110642304:0@lo:400:kworker.0 00000100:00100000:2.0:1789049537.948947:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb7c5c37480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3308:1875954110642816:0@lo:400:kworker.0 00000100:00080000:1.0:1789049537.950417:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789049537.950427:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789049537.950469:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb7c5c34700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3310:1875954110642560:0@lo:400:kworker.0 00000100:00100000:1.0:1789049537.951119:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789049537.951133:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb7c5c36d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3311:1875954110643072:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789049537.951188:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789049537.951228:0:6707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954110643072 00000100:00100000:1.0:1789049537.951235:0:6707:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954110643072 00000100:00100000:1.0:1789049537.951274:0:6707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1789049537.951293:0:6707:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb900e42a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1875954110643072:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789049537.951327:0:6707:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789049537.951370:0:6707:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb900e42a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1875954110643072:12345-0@lo:13:osp-pre-1-0.0 Request processed in 88us (182us total) trans 0 rc 0/0 00000100:00100000:1.0:1789049537.951377:0:6707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1789049537.951426:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb7c5c36d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3311:1875954110643072:0@lo:13:osp-pre-1-0.0 00000001:00100000:1.0:1789049538.019313:0:6731:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of e823b53a-3591-475c-8624-c682227e5c13 00000020:00000080:1.0:1789049538.019322:0:6731:0:(genops.c:885:class_export_put()) final put ffff8cb8df3d5000/e823b53a-3591-475c-8624-c682227e5c13 00000020:00000080:1.0:1789049538.019352:0:12636:0:(genops.c:844:class_export_destroy()) destroying export ffff8cb8df3d5000/e823b53a-3591-475c-8624-c682227e5c13 for lustre-OST0000 00000020:00000080:1.0:1789049538.019410:0:12636:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8cb8df3d7800 for lustre-OST0000 00000001:00080000:0.0:1789049538.033469:0:5872:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967531 is committed 00000001:00100000:0.0:1789049538.033490:0:5872:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of e823b53a-3591-475c-8624-c682227e5c13 00000001:00080000:0.0:1789049538.033494:0:5872:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967533 is committed 00000020:00000080:0.0:1789049538.033501:0:5872:0:(genops.c:885:class_export_put()) final put ffff8cb8c622e000/e823b53a-3591-475c-8624-c682227e5c13 00000020:00000080:0.0:1789049538.033525:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8cb8c622e000/e823b53a-3591-475c-8624-c682227e5c13 for lustre-MDT0000 00000020:00000080:0.0:1789049538.033577:0:8:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8cb8c6229000 for lustre-MDT0000 00000001:00100000:3.0:1789049538.051377:0:7663:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of e823b53a-3591-475c-8624-c682227e5c13 00000020:00000080:3.0:1789049538.051386:0:7663:0:(genops.c:885:class_export_put()) final put ffff8cb8df3d6800/e823b53a-3591-475c-8624-c682227e5c13 00000020:00000080:3.0:1789049538.051425:0:12636:0:(genops.c:844:class_export_destroy()) destroying export ffff8cb8df3d6800/e823b53a-3591-475c-8624-c682227e5c13 for lustre-OST0001 00000020:00000080:3.0:1789049538.051466:0:12636:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8cb8df3d3000 for lustre-OST0001 00010000:00010000:1.0:1789049538.267131:0:6719:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789049538.882613:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.26@tcp (source: 12345-192.168.206.26@tcp) 00000100:00100000:3.0:1789049538.882663:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.26@tcp (source: 12345-192.168.206.26@tcp) 00000100:00100000:2.0:1789049538.882828:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954089695488 00000100:00100000:2.0:1789049538.882837:0:5852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954089695488 00000100:00100000:1.0:1789049538.882889:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954089695360 00000100:00100000:1.0:1789049538.882895:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954089695360 00000100:00100000:1.0:1789049538.882941:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.26@tcp, seq: 301 00000100:00100000:2.0:1789049538.882949:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.26@tcp, seq: 168 00000100:00100000:1.0:1789049538.882954:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8c6bed450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:de93d576-ed8d-4d27-ab00-9189a62cea33+10:2357:x1875954089695360:12345-192.168.206.26@tcp:400:kworker.0 00000100:00100000:2.0:1789049538.882965:0:5852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb7c5c36d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:59d63492-f1ee-4aa5-bf8c-853a603b0252+6:2357:x1875954089695488:12345-192.168.206.26@tcp:400:kworker.0 00000100:00080000:0.0:1789049538.883037:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789049538.883161:0:5852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb7c5c36d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:59d63492-f1ee-4aa5-bf8c-853a603b0252+6:2357:x1875954089695488:12345-192.168.206.26@tcp:400:kworker.0 Request processed in 200us (555us total) trans 0 rc 0/0 00000100:00100000:2.0:1789049538.883169:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.26@tcp, seq: 168 00000100:00100000:1.0:1789049538.892869:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8c6bed450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:de93d576-ed8d-4d27-ab00-9189a62cea33+10:2357:x1875954089695360:12345-192.168.206.26@tcp:400:kworker.0 Request processed in 9894us (10179us total) trans 0 rc 0/0 00000100:00100000:1.0:1789049538.892884:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.26@tcp, seq: 301 00010000:00010000:1.0:1789049539.298694:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789049539.538506:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.26@tcp (source: 12345-192.168.206.26@tcp) 00000100:00100000:0.0:1789049539.538545:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.26@tcp (source: 12345-192.168.206.26@tcp) 00000100:00100000:0.0:1789049539.538577:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.26@tcp (source: 12345-192.168.206.26@tcp) 00000100:00100000:1.0:1789049539.538730:0:6720:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954089695616 00000100:00100000:1.0:1789049539.538751:0:6720:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954089695616 00000100:00100000:1.0:1789049539.538811:0:6720:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954089695872 00000100:00100000:1.0:1789049539.538815:0:6720:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954089695872 00000100:00100000:1.0:1789049539.538828:0:6720:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954089695744 00000100:00100000:1.0:1789049539.538830:0:6720:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954089695744 00000100:00100000:1.0:1789049539.538874:0:6720:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.26@tcp, seq: 21 00000100:00100000:1.0:1789049539.538884:0:6720:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb9009c3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:de93d576-ed8d-4d27-ab00-9189a62cea33+12:2355:x1875954089695616:12345-192.168.206.26@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789049539.538901:0:6720:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789049539.538919:0:6720:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cb8c6b35200/0xf4f48ce5e1bbee17 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801000000000 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a32b8 expref: 12 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049539.538934:0:6720:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789049539.538983:0:6720:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb9009c3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:de93d576-ed8d-4d27-ab00-9189a62cea33+11:2355:x1875954089695616:12345-192.168.206.26@tcp:103:ldlm_bl.0 Request processed in 100us (487us total) trans 0 rc 0/0 00000100:00100000:1.0:1789049539.539001:0:6720:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.26@tcp, seq: 21 00000100:00100000:1.0:1789049539.539019:0:6720:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.26@tcp, seq: 22 00000100:00100000:1.0:1789049539.539026:0:6720:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb9009c2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:de93d576-ed8d-4d27-ab00-9189a62cea33+10:2355:x1875954089695872:12345-192.168.206.26@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789049539.539042:0:6720:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789049539.539051:0:6720:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cb8c6b35600/0xf4f48ce5e1bbefb4 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a3367 expref: 10 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049539.539059:0:6720:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789049539.539077:0:6720:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb9009c2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:de93d576-ed8d-4d27-ab00-9189a62cea33+9:2355:x1875954089695872:12345-192.168.206.26@tcp:103:ldlm_bl.0 Request processed in 52us (532us total) trans 0 rc 0/0 00000100:00100000:1.0:1789049539.539082:0:6720:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.26@tcp, seq: 22 00000100:00100000:1.0:1789049539.539094:0:6720:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.26@tcp, seq: 23 00000100:00100000:1.0:1789049539.539100:0:6720:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb9009c2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:de93d576-ed8d-4d27-ab00-9189a62cea33+8:2355:x1875954089695744:12345-192.168.206.26@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789049539.539117:0:6720:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789049539.539127:0:6720:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cb8d6714400/0xf4f48ce5e1bbee1e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a32e2 expref: 8 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049539.539135:0:6720:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789049539.539153:0:6720:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb9009c2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:de93d576-ed8d-4d27-ab00-9189a62cea33+7:2355:x1875954089695744:12345-192.168.206.26@tcp:103:ldlm_bl.0 Request processed in 53us (576us total) trans 0 rc 0/0 00000100:00100000:1.0:1789049539.539159:0:6720:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.26@tcp, seq: 23 00000100:00100000:0.0:1789049539.561724:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.26@tcp (source: 12345-192.168.206.26@tcp) 00000100:00100000:2.0:1789049539.561997:0:6841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954089696128 00000100:00100000:2.0:1789049539.562007:0:6841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954089696128 00000100:00100000:2.0:1789049539.562079:0:6841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.26@tcp, seq: 240 00000100:00100000:2.0:1789049539.562090:0:6841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb9009c3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:59d63492-f1ee-4aa5-bf8c-853a603b0252+6:2354:x1875954089696128:12345-192.168.206.26@tcp:39:umount.0 00000020:00000080:2.0:1789049539.562144:0:6841:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xf4f48ce5e1bbee2c 00000020:00010000:2.0:1789049539.562153:0:6841:0:(genops.c:1920:obd_stale_export_put()) Put export ffff8cb8c62e0800: total 0 00000100:00080000:2.0:1789049539.562157:0:6841:0:(import.c:65:import_set_state_nolock()) ffff8cb8c62e2000 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1789049539.562185:0:6841:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967533 00000100:00100000:2.0:1789049539.562583:0:6841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb9009c3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:59d63492-f1ee-4aa5-bf8c-853a603b0252+5:2354:x1875954089696128:12345-192.168.206.26@tcp:39:umount.0 Request processed in 493us (866us total) trans 4294967534 rc 0/0 00000100:00100000:2.0:1789049539.562592:0:6841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.26@tcp, seq: 240 00000020:00010000:0.0:1789049539.563312:0:5838:0:(genops.c:1906:obd_stale_export_get()) Get export ffff8cb8c62e0800: total 0 00010000:00010000:0.0:1789049539.563319:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789049539.563357:0:5838:0:(ldlm_lock.c:2657:ldlm_export_cancel_blocked_locks()) Export ffff8cb8c62e0800, canceled 0 locks, left on hash table 1. 00010000:00010000:0.0:1789049539.563388:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8cb8e0130500) 00010000:00010000:0.0:1789049539.563392:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1789049539.563400:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c6b35800/0xf4f48ce5e1bbfd4b lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a3711 expref: 4 pid: 6841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049539.563421:0:5838:0:(ldlm_lock.c:2685:ldlm_export_cancel_locks()) Export ffff8cb8c62e0800, canceled 1 locks, left on hash table 0. 00010000:00010000:0.0:1789049539.563431:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789049539.563433:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789049539.563434:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789049539.580813:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.26@tcp (source: 12345-192.168.206.26@tcp) 00000100:00100000:2.0:1789049539.580933:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954089696384 00000100:00100000:2.0:1789049539.580943:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954089696384 00000100:00100000:2.0:1789049539.581008:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.26@tcp, seq: 302 00000100:00100000:2.0:1789049539.581025:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8c6bee850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:de93d576-ed8d-4d27-ab00-9189a62cea33+7:2354:x1875954089696384:12345-192.168.206.26@tcp:251:umount.0 00000020:00000080:2.0:1789049539.581072:0:5843:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xf4f48ce5e1bbed22 00000020:00010000:2.0:1789049539.581079:0:5843:0:(genops.c:1920:obd_stale_export_put()) Put export ffff8cb8df600000: total 0 00000100:00080000:2.0:1789049539.581084:0:5843:0:(import.c:65:import_set_state_nolock()) ffff8cb8df601000 : changing import state from FULL to CLOSED 00000100:00100000:2.0:1789049539.581159:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8c6bee850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:de93d576-ed8d-4d27-ab00-9189a62cea33+3:2354:x1875954089696384:12345-192.168.206.26@tcp:251:umount.0 Request processed in 142us (355us total) trans 0 rc 0/0 00000100:00100000:2.0:1789049539.581167:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.26@tcp, seq: 302 00000020:00010000:1.0:1789049539.581460:0:6719:0:(genops.c:1906:obd_stale_export_get()) Get export ffff8cb8df600000: total 0 00010000:00010000:1.0:1789049539.581499:0:6719:0:(ldlm_lock.c:2657:ldlm_export_cancel_blocked_locks()) Export ffff8cb8df600000, canceled 0 locks, left on hash table 1. 00010000:00010000:1.0:1789049539.581529:0:6719:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cb8d776f400/0xf4f48ce5e1bbed76 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801000000000 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a32aa expref: 2 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049539.581545:0:6719:0:(ldlm_lock.c:2685:ldlm_export_cancel_locks()) Export ffff8cb8df600000, canceled 1 locks, left on hash table 0. 00000020:00000080:1.0:1789049539.581554:0:6719:0:(genops.c:885:class_export_put()) final put ffff8cb8df600000/de93d576-ed8d-4d27-ab00-9189a62cea33 00010000:00010000:1.0:1789049539.581571:0:6719:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789049539.581573:0:6719:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789049539.581575:0:6719:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1789049539.582563:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8cb8df600000/de93d576-ed8d-4d27-ab00-9189a62cea33 for MGS 00000020:00000080:3.0:1789049539.582611:0:8:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8cb8df601000 for MGS 00000040:00080000:3.0:1789049540.125788:0:11704:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1789049540.125797:0:11704:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1789049540.126514:0:11704:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 6 count 1 00000040:00080000:3.0:1789049540.126522:0:11704:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:0.0:1789049540.331142:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789049541.339140:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:1.0:1789049541.939393:0:12929:0:(tgt_mount.c:2191:server_umount_begin()) umount -f 00000020:01000004:1.0:1789049541.951961:0:12929:0:(tgt_mount.c:2061:server_put_super()) server put_super lustre-MDT0000 00010000:00010000:1.0:1789049541.952007:0:12929:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.126@tcp lock: ffff8cb7c4c38200/0xf4f48ce5e1bbedb5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xf4f48ce5e1bbedbc expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049541.952032:0:12929:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.126@tcp lock: ffff8cb7c4c38200/0xf4f48ce5e1bbedb5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xf4f48ce5e1bbedbc expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049541.952040:0:12929:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.126@tcp lock: ffff8cb7c4c38200/0xf4f48ce5e1bbedb5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0xf4f48ce5e1bbedbc expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049541.952062:0:12929:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.126@tcp lock: ffff8cb7c4c38200/0xf4f48ce5e1bbedb5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0xf4f48ce5e1bbedbc expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049541.952087:0:12929:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:1.0:1789049541.952093:0:12929:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:1.0:1789049541.952115:0:12929:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1789049541.952119:0:12929:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 3 00000100:00080000:1.0:1789049541.952126:0:12929:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00080000:1.0:1789049541.952148:0:12929:0:(import.c:65:import_set_state_nolock()) ffff8cb8fe2db800 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00010000:00010000:0.0:1789049541.952266:0:6719:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789049541.952273:0:6719:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.126@tcp lock: ffff8cb7c4c38200/0xf4f48ce5e1bbedb5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0xf4f48ce5e1bbedbc expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049541.952281:0:6719:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cb7c4c38200 already unused, calling callback (ffffffffc1ca3c20) 10000000:00010000:0.0:1789049541.952292:0:6719:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.126@tcp lock: ffff8cb7c4c38200/0xf4f48ce5e1bbedb5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0xf4f48ce5e1bbedbc expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049541.952306:0:6719:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.126@tcp lock: ffff8cb7c4c38200/0xf4f48ce5e1bbedb5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1008400000000 nid: local remote: 0xf4f48ce5e1bbedbc expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789049541.952314:0:6719:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.126@tcp lock: ffff8cb7c4c38200/0xf4f48ce5e1bbedb5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1009400000000 nid: local remote: 0xf4f48ce5e1bbedbc expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789049541.952320:0:6719:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1789049541.952323:0:6719:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:0.0:1789049541.952325:0:6719:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:0.0:1789049541.952353:0:6719:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.126@tcp lock: ffff8cb7c4c38200/0xf4f48ce5e1bbedb5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0xf4f48ce5e1bbedbc expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049541.952360:0:6719:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789049541.952387:0:6719:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.126@tcp lock: ffff8cb7c4c38200/0xf4f48ce5e1bbedb5 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0xf4f48ce5e1bbedbc expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049541.952395:0:6719:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.126@tcp lock: ffff8cb7c4c38200/0xf4f48ce5e1bbedb5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0xf4f48ce5e1bbedbc expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049541.952407:0:6719:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789049541.952409:0:6719:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789049541.952411:0:6719:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789049541.952425:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb900e40a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3307:1875954110643200:0@lo:39:umount.0 00000100:00100000:0.0:1789049541.952480:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789049541.952534:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789049541.952543:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb7c7139f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7ef694ec-1ea0-4f02-800c-d1279b4fdf12:3310:1875954110643328:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789049541.952567:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789049541.952605:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954110643200 00000100:00100000:0.0:1789049541.952612:0:5852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954110643200 00000100:00100000:0.0:1789049541.952658:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 241 00000100:00100000:0.0:1789049541.952666:0:5852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb7c713b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1875954110643200:12345-0@lo:39:umount.0 00000020:00000080:0.0:1789049541.952700:0:5852:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xf4f48ce5e1bbeb31 00000100:00080000:0.0:1789049541.952707:0:5852:0:(import.c:65:import_set_state_nolock()) ffff8cb8c638e800 : changing import state from FULL to CLOSED 00000100:00100000:0.0:1789049541.952769:0:5852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb7c713b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+1:3307:x1875954110643200:12345-0@lo:39:umount.0 Request processed in 103us (288us total) trans 0 rc 0/0 00000100:00100000:0.0:1789049541.952776:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 241 00000020:00000080:0.0:1789049541.952784:0:5852:0:(genops.c:885:class_export_put()) final put ffff8cb8c638b000/lustre-MDT0000-lwp-MDT0000_UUID 00000100:00100000:0.0:1789049541.952808:0:6720:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954110643328 00000100:00100000:0.0:1789049541.952812:0:6720:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954110643328 00000100:00100000:0.0:1789049541.952838:0:6720:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1789049541.952876:0:6720:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb7c713a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7ef694ec-1ea0-4f02-800c-d1279b4fdf12+19:3310:x1875954110643328:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789049541.952886:0:6720:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789049541.952899:0:6720:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cb8c146c600/0xf4f48ce5e1bbedbc lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xf4f48ce5e1bbedb5 expref: 19 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049541.952911:0:6720:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789049541.952937:0:6720:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb7c713a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7ef694ec-1ea0-4f02-800c-d1279b4fdf12+18:3310:x1875954110643328:12345-0@lo:103:ldlm_bl.0 Request processed in 63us (369us total) trans 0 rc 0/0 00000100:00100000:0.0:1789049541.952943:0:6720:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00010000:00010000:0.0:1789049541.952958:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1789049541.952967:0:12636:0:(genops.c:844:class_export_destroy()) destroying export ffff8cb8c638b000/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000 00000020:00000080:0.0:1789049541.953017:0:12636:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8cb8c638e800 for lustre-MDT0000 00000100:00100000:0.0:1789049541.953054:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb7c7139f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7ef694ec-1ea0-4f02-800c-d1279b4fdf12:3310:1875954110643328:0@lo:103:ldlm_bl.0 00000100:00080000:0.0:1789049541.953078:0:3307:0:(import.c:65:import_set_state_nolock()) ffff8cb8fe2db800 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:0.0:1789049541.953085:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb900e40a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3307:1875954110643200:0@lo:39:umount.0 00000100:00080000:1.0:1789049541.953261:0:12929:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1789049541.953264:0:12929:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 4 00000100:00100000:1.0:1789049541.953268:0:12929:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:1.0:1789049541.954378:0:12929:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.126@tcp lock: ffff8cb8d6715600/0xf4f48ce5e1bbedc3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xf4f48ce5e1bbedca expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049541.954393:0:12929:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.126@tcp lock: ffff8cb8d6715600/0xf4f48ce5e1bbedc3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0xf4f48ce5e1bbedca expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049541.954401:0:12929:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.126@tcp lock: ffff8cb8d6715600/0xf4f48ce5e1bbedc3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000400000000 nid: local remote: 0xf4f48ce5e1bbedca expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049541.954409:0:12929:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.126@tcp lock: ffff8cb8d6715600/0xf4f48ce5e1bbedc3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000400000000 nid: local remote: 0xf4f48ce5e1bbedca expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049541.954427:0:12929:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789049541.954432:0:12929:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.126@tcp lock: ffff8cb7c4c38600/0xf4f48ce5e1bbecdc lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf4f48ce5e1bbece3 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049541.954453:0:12929:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.126@tcp lock: ffff8cb7c4c38600/0xf4f48ce5e1bbecdc lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xf4f48ce5e1bbece3 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049541.954461:0:12929:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.126@tcp lock: ffff8cb7c4c38600/0xf4f48ce5e1bbecdc lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xf4f48ce5e1bbece3 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049541.954467:0:12929:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.126@tcp lock: ffff8cb7c4c38600/0xf4f48ce5e1bbecdc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xf4f48ce5e1bbece3 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049541.954478:0:12929:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1789049541.954484:0:12929:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.126@tcp lock: ffff8cb7c4c39600/0xf4f48ce5e1bbefd7 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf4f48ce5e1bbefde expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049541.954492:0:12929:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.126@tcp lock: ffff8cb7c4c39600/0xf4f48ce5e1bbefd7 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xf4f48ce5e1bbefde expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049541.954498:0:12929:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.126@tcp lock: ffff8cb7c4c39600/0xf4f48ce5e1bbefd7 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0xf4f48ce5e1bbefde expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049541.954505:0:12929:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.126@tcp lock: ffff8cb7c4c39600/0xf4f48ce5e1bbefd7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0xf4f48ce5e1bbefde expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049541.954514:0:12929:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:1.0:1789049541.954518:0:12929:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.126@tcp lock: ffff8cb8d776e800/0xf4f48ce5e1bbea90 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf4f48ce5e1bbea97 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049541.954526:0:12929:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.126@tcp lock: ffff8cb8d776e800/0xf4f48ce5e1bbea90 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xf4f48ce5e1bbea97 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049541.954541:0:12929:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.126@tcp lock: ffff8cb8d776e800/0xf4f48ce5e1bbea90 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xf4f48ce5e1bbea97 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049541.954548:0:12929:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.126@tcp lock: ffff8cb8d776e800/0xf4f48ce5e1bbea90 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xf4f48ce5e1bbea97 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049541.954555:0:12929:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 10000000:01000000:1.0:1789049541.954558:0:12929:0:(mgc_request.c:547:config_log_end()) end config log lustre-MDT0000 (0) 00000020:01000004:1.0:1789049541.954580:0:12929:0:(tgt_mount.c:2111:server_put_super()) stopping lustre-MDT0000 00000020:01000000:1.0:1789049541.954583:0:12929:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000 (flags='F') 00000020:00000080:1.0:1789049541.954586:0:12929:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1789049541.954592:0:12929:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000: forcing exports to disconnect: 2/7 00000020:00080000:1.0:1789049541.954598:0:12929:0:(genops.c:1818:print_export_data()) lustre-MDT0000: ACTIVE ffff8cb7c4c10800 lustre-MDT0000-lwp-OST0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1789049541.954604:0:12929:0:(genops.c:1818:print_export_data()) lustre-MDT0000: ACTIVE ffff8cb7c4c44800 lustre-MDT0000-lwp-OST0000_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1789049541.954611:0:12929:0:(genops.c:1818:print_export_data()) lustre-MDT0000: UNLINKED ffff8cb8c62e0800 59d63492-f1ee-4aa5-bf8c-853a603b0252 192.168.206.26@tcp 2 (0 2 0) 1 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1789049541.954616:0:12929:0:(genops.c:1552:class_disconnect_exports()) OBD device 5 (ffff8cb8c62a8000) has exports, disconnecting them 00000020:00080000:1.0:1789049541.954621:0:12929:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff8cb7c4c10800), last request at 1789049537 00000020:00000080:1.0:1789049541.954627:0:12929:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xf4f48ce5e1bbeca4 00000100:00080000:1.0:1789049541.954643:0:12929:0:(import.c:65:import_set_state_nolock()) ffff8cb7c4c11000 : changing import state from FULL to CLOSED 00000020:00080000:1.0:1789049541.954694:0:12929:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff8cb7c4c10800): rc 0 00000020:00000080:1.0:1789049541.954696:0:12929:0:(genops.c:885:class_export_put()) final put ffff8cb7c4c10800/lustre-MDT0000-lwp-OST0001_UUID 00000020:00080000:1.0:1789049541.954704:0:12929:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff8cb7c4c44800), last request at 1789049537 00000020:00000080:1.0:1789049541.954708:0:12929:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xf4f48ce5e1bbebd9 00000100:00080000:1.0:1789049541.954713:0:12929:0:(import.c:65:import_set_state_nolock()) ffff8cb7c4c45800 : changing import state from FULL to CLOSED 00000020:00080000:1.0:1789049541.954719:0:12929:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff8cb7c4c44800): rc 0 00000020:00000080:1.0:1789049541.954721:0:12929:0:(genops.c:885:class_export_put()) final put ffff8cb7c4c44800/lustre-MDT0000-lwp-OST0000_UUID 00000004:00000080:1.0:1789049541.954728:0:12929:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=400866e7 len=0 karg=ffffac7501c67ae0 00010000:00010000:0.0:1789049541.954869:0:5838:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:0.0:1789049541.954877:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.126@tcp lock: ffff8cb8d6715600/0xf4f48ce5e1bbedc3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0xf4f48ce5e1bbedca expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049541.954885:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cb8d6715600 already unused, calling callback (ffffffffc1ca3c20) 10000000:00010000:0.0:1789049541.954890:0:5838:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.126@tcp lock: ffff8cb8d6715600/0xf4f48ce5e1bbedc3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0xf4f48ce5e1bbedca expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049541.954899:0:5838:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.126@tcp lock: ffff8cb8d6715600/0xf4f48ce5e1bbedc3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1008400000000 nid: local remote: 0xf4f48ce5e1bbedca expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789049541.954908:0:5838:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.126@tcp lock: ffff8cb8d6715600/0xf4f48ce5e1bbedc3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1009400000000 nid: local remote: 0xf4f48ce5e1bbedca expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789049541.954914:0:5838:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1789049541.954917:0:5838:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-MDT0000: stopping, won't requeue 10000000:01000000:0.0:1789049541.954919:0:5838:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-MDT0000 00010000:00010000:0.0:1789049541.954948:0:5838:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.126@tcp lock: ffff8cb8d6715600/0xf4f48ce5e1bbedc3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0xf4f48ce5e1bbedca expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049541.954954:0:5838:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789049541.954974:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.126@tcp lock: ffff8cb8d6715600/0xf4f48ce5e1bbedc3 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0xf4f48ce5e1bbedca expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049541.954981:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.126@tcp lock: ffff8cb8d6715600/0xf4f48ce5e1bbedc3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0xf4f48ce5e1bbedca expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049541.954994:0:5838:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1789049541.954997:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.126@tcp lock: ffff8cb7c4c38600/0xf4f48ce5e1bbecdc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xf4f48ce5e1bbece3 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049541.955015:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cb7c4c38600 already unused, calling callback (ffffffffc1ca3c20) 10000000:00010000:0.0:1789049541.955018:0:5838:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.126@tcp lock: ffff8cb7c4c38600/0xf4f48ce5e1bbecdc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xf4f48ce5e1bbece3 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049541.955037:0:5838:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.126@tcp lock: ffff8cb7c4c38600/0xf4f48ce5e1bbecdc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0xf4f48ce5e1bbece3 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789049541.955044:0:5838:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.126@tcp lock: ffff8cb7c4c38600/0xf4f48ce5e1bbecdc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0xf4f48ce5e1bbece3 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789049541.955050:0:5838:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 10000000:01000000:0.0:1789049541.955052:0:5838:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-mdtir: stopping, won't requeue 10000000:01000000:0.0:1789049541.955054:0:5838:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-mdtir 00010000:00010000:0.0:1789049541.955067:0:5838:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.126@tcp lock: ffff8cb7c4c38600/0xf4f48ce5e1bbecdc lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xf4f48ce5e1bbece3 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049541.955073:0:5838:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789049541.955079:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.126@tcp lock: ffff8cb7c4c38600/0xf4f48ce5e1bbecdc lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xf4f48ce5e1bbece3 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049541.955092:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.126@tcp lock: ffff8cb7c4c38600/0xf4f48ce5e1bbecdc lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xf4f48ce5e1bbece3 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049541.955105:0:5838:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1789049541.955108:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.126@tcp lock: ffff8cb7c4c39600/0xf4f48ce5e1bbefd7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0xf4f48ce5e1bbefde expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049541.955114:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cb7c4c39600 already unused, calling callback (ffffffffc1ca3c20) 10000000:00010000:0.0:1789049541.955118:0:5838:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.126@tcp lock: ffff8cb7c4c39600/0xf4f48ce5e1bbefd7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0xf4f48ce5e1bbefde expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049541.955130:0:5838:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.126@tcp lock: ffff8cb7c4c39600/0xf4f48ce5e1bbefd7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0xf4f48ce5e1bbefde expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789049541.955137:0:5838:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.126@tcp lock: ffff8cb7c4c39600/0xf4f48ce5e1bbefd7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0xf4f48ce5e1bbefde expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789049541.955143:0:5838:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:0.0:1789049541.955145:0:5838:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:0.0:1789049541.955146:0:5838:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:0.0:1789049541.955160:0:5838:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.126@tcp lock: ffff8cb7c4c39600/0xf4f48ce5e1bbefd7 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0xf4f48ce5e1bbefde expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049541.955166:0:5838:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789049541.955180:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.126@tcp lock: ffff8cb7c4c39600/0xf4f48ce5e1bbefd7 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0xf4f48ce5e1bbefde expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049541.955187:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.126@tcp lock: ffff8cb7c4c39600/0xf4f48ce5e1bbefd7 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0xf4f48ce5e1bbefde expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049541.955196:0:5838:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789049541.955200:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.126@tcp lock: ffff8cb8d776e800/0xf4f48ce5e1bbea90 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xf4f48ce5e1bbea97 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049541.955206:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cb8d776e800 already unused, calling callback (ffffffffc1ca3c20) 10000000:00010000:0.0:1789049541.955210:0:5838:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.126@tcp lock: ffff8cb8d776e800/0xf4f48ce5e1bbea90 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xf4f48ce5e1bbea97 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049541.955217:0:5838:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.126@tcp lock: ffff8cb8d776e800/0xf4f48ce5e1bbea90 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0xf4f48ce5e1bbea97 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789049541.955233:0:5838:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.126@tcp lock: ffff8cb8d776e800/0xf4f48ce5e1bbea90 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0xf4f48ce5e1bbea97 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789049541.955239:0:5838:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 10000000:01000000:0.0:1789049541.955241:0:5838:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-barrier: stopping, won't requeue 10000000:01000000:0.0:1789049541.955244:0:5838:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-barrier 00000020:00000080:3.0:1789049541.955390:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8cb7c4c10800/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000 00000020:00000080:3.0:1789049541.955426:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8cb7c4c44800/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000 00000020:00000080:3.0:1789049541.955452:0:8:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8cb7c4c11000 for lustre-MDT0000 00000020:00000080:3.0:1789049541.955456:0:8:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8cb7c4c45800 for lustre-MDT0000 00000100:00080000:1.0:1789049541.955886:0:12929:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:1.0:1789049541.955890:0:12929:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967324 gen 3 00000004:00080000:1.0:1789049541.955903:0:12929:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:1.0:1789049541.956000:0:12929:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000100:00080000:1.0:1789049541.956009:0:12929:0:(import.c:65:import_set_state_nolock()) ffff8cb8c6bc4000 lustre-OST0000_UUID: changing import state from FULL to CONNECTING 00000100:00080000:1.0:1789049541.956033:0:12929:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:1.0:1789049541.956036:0:12929:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967310 gen 3 00000004:00080000:1.0:1789049541.956049:0:12929:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:1.0:1789049541.956106:0:12929:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000100:00080000:1.0:1789049541.956115:0:12929:0:(import.c:65:import_set_state_nolock()) ffff8cb8f7b33000 lustre-OST0001_UUID: changing import state from FULL to CONNECTING 00000020:00080000:1.0:1789049541.956156:0:12929:0:(genops.c:1557:class_disconnect_exports()) OBD device 5 (ffff8cb8c62a8000) has no exports 00000100:00100000:1.0:1789049541.965917:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb7c713bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:7ef694ec-1ea0-4f02-800c-d1279b4fdf12:3309:1875954110643584:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789049541.965982:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789049541.966345:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1789049541.966354:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb7c7139f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:7ef694ec-1ea0-4f02-800c-d1279b4fdf12:3309:1875954110643456:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789049541.966381:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1789049541.966411:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789049541.966421:0:6719:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789049541.970951:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb900e42300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:0:1875954110643840:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789049541.970980:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1789049541.970990:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb8f7b90700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:7ef694ec-1ea0-4f02-800c-d1279b4fdf12:3311:1875954110643712:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789049541.972396:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789049541.972461:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954110643584 00000100:00100000:0.0:1789049541.972470:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954110643584 00000100:00100000:0.0:1789049541.972526:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954110643456 00000100:00100000:0.0:1789049541.972529:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954110643456 00000100:00100000:0.0:1789049541.972543:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954110643712 00000100:00100000:0.0:1789049541.972545:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954110643712 00000100:00100000:0.0:1789049541.972560:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1789049541.972569:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb900e41880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7ef694ec-1ea0-4f02-800c-d1279b4fdf12+20:3309:x1875954110643584:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789049541.972584:0:5837:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789049541.972602:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cb8d776ea00/0xf4f48ce5e1bbece3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xf4f48ce5e1bbecdc expref: 20 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049541.972619:0:5837:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789049541.972661:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb900e41880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7ef694ec-1ea0-4f02-800c-d1279b4fdf12+19:3309:x1875954110643584:12345-0@lo:103:ldlm_bl.0 Request processed in 92us (6678us total) trans 0 rc 0/0 00000100:00100000:0.0:1789049541.972668:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1789049541.972698:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1789049541.972705:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb900e42680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7ef694ec-1ea0-4f02-800c-d1279b4fdf12+18:3309:x1875954110643456:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789049541.972727:0:5837:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789049541.972736:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cb8c6b34600/0xf4f48ce5e1bbedca lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xf4f48ce5e1bbedc3 expref: 18 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049541.972745:0:5837:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789049541.972770:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb900e42680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7ef694ec-1ea0-4f02-800c-d1279b4fdf12+17:3309:x1875954110643456:12345-0@lo:103:ldlm_bl.0 Request processed in 65us (6388us total) trans 0 rc 0/0 00000100:00100000:0.0:1789049541.972776:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1789049541.972789:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1789049541.972797:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8c7934850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7ef694ec-1ea0-4f02-800c-d1279b4fdf12+16:3311:x1875954110643712:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789049541.972804:0:5837:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789049541.972813:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cb8c146c000/0xf4f48ce5e1bbefde lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xf4f48ce5e1bbefd7 expref: 16 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049541.972821:0:5837:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789049541.972863:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8c7934850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7ef694ec-1ea0-4f02-800c-d1279b4fdf12+15:3311:x1875954110643712:12345-0@lo:103:ldlm_bl.0 Request processed in 68us (471us total) trans 0 rc 0/0 00000100:00100000:0.0:1789049541.972869:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1789049541.972922:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb8f7b90700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:7ef694ec-1ea0-4f02-800c-d1279b4fdf12:3311:1875954110643712:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789049541.972949:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb900e41c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3307:1875954110643968:0@lo:9:umount.0 00000100:00100000:0.0:1789049541.972978:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789049541.973000:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb900e40380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3307:1875954110644096:0@lo:9:umount.0 00000100:00100000:0.0:1789049541.975465:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789049541.975599:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb7c7139f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:7ef694ec-1ea0-4f02-800c-d1279b4fdf12:3309:1875954110643456:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789049541.975611:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb7c713bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:7ef694ec-1ea0-4f02-800c-d1279b4fdf12:3309:1875954110643584:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789049541.975663:0:5838:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.126@tcp lock: ffff8cb8d776e800/0xf4f48ce5e1bbea90 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xf4f48ce5e1bbea97 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049541.975684:0:5838:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789049541.975718:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.126@tcp lock: ffff8cb8d776e800/0xf4f48ce5e1bbea90 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xf4f48ce5e1bbea97 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049541.975727:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.126@tcp lock: ffff8cb8d776e800/0xf4f48ce5e1bbea90 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xf4f48ce5e1bbea97 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789049541.975748:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1789049541.975758:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb8f7b91500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:7ef694ec-1ea0-4f02-800c-d1279b4fdf12:3309:1875954110644224:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789049541.975810:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789049541.976522:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954110644224 00000100:00100000:0.0:1789049541.976530:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954110644224 00000100:00100000:0.0:1789049541.976592:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1789049541.976600:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8f7b93b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7ef694ec-1ea0-4f02-800c-d1279b4fdf12+15:3309:x1875954110644224:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789049541.976613:0:5837:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789049541.976628:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cb8c146c800/0xf4f48ce5e1bbea97 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xf4f48ce5e1bbea90 expref: 15 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049541.976644:0:5837:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789049541.976697:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8f7b93b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7ef694ec-1ea0-4f02-800c-d1279b4fdf12+14:3309:x1875954110644224:12345-0@lo:103:ldlm_bl.0 Request processed in 98us (887us total) trans 0 rc 0/0 00000100:00100000:0.0:1789049541.976705:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1789049541.976734:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb8f7b91500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:7ef694ec-1ea0-4f02-800c-d1279b4fdf12:3309:1875954110644224:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789049541.976753:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789049541.976756:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789049541.976768:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789049541.978693:0:12489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954110643968 00000100:00100000:1.0:1789049541.978704:0:12489:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954110643968 00000100:00100000:1.0:1789049541.978762:0:12489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954110644096 00000100:00100000:1.0:1789049541.978766:0:12489:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954110644096 00000100:00100000:1.0:1789049541.978790:0:12489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1789049541.978799:0:12489:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8f7b90700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3307:x1875954110643968:12345-0@lo:9:umount.0 00000020:00000080:1.0:1789049541.978824:0:12489:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xf4f48ce5e1bbec26 00000100:00080000:1.0:1789049541.978832:0:12489:0:(import.c:65:import_set_state_nolock()) ffff8cb8df168000 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1789049541.978889:0:12489:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967324 00000100:00080000:0.0:1789049541.979149:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789049541.979154:0:5846:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789049541.979425:0:12489:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8f7b90700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+2:3307:x1875954110643968:12345-0@lo:9:umount.0 Request processed in 627us (6445us total) trans 0 rc 0/0 00000100:00100000:1.0:1789049541.979444:0:12489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1789049541.979461:0:12489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1789049541.979468:0:12489:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8f7b93800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3307:x1875954110644096:12345-0@lo:9:umount.0 00000020:00000080:1.0:1789049541.979486:0:12489:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xf4f48ce5e1bbed0d 00000100:00080000:1.0:1789049541.979493:0:12489:0:(import.c:65:import_set_state_nolock()) ffff8cb8c622f800 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1789049541.979518:0:12489:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967310 00000100:00100000:1.0:1789049541.979706:0:12489:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8f7b93800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+2:3307:x1875954110644096:12345-0@lo:9:umount.0 Request processed in 237us (6685us total) trans 0 rc 0/0 00000100:00100000:1.0:1789049541.979713:0:12489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00010000:00010000:1.0:1789049541.979734:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789049541.979739:0:6719:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1789049541.979810:0:3307:0:(import.c:65:import_set_state_nolock()) ffff8cb8c6bc4000 lustre-OST0000_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:0.0:1789049541.979831:0:3307:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:0.0:1789049541.979833:0:3307:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1789049541.979837:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb900e41c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3307:1875954110643968:0@lo:9:umount.0 00000100:00080000:0.0:1789049541.979869:0:3307:0:(import.c:65:import_set_state_nolock()) ffff8cb8f7b33000 lustre-OST0001_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:0.0:1789049541.979884:0:3307:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:0.0:1789049541.979886:0:3307:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1789049541.979889:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb900e40380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3307:1875954110644096:0@lo:9:umount.0 00000020:00080000:3.0:1789049541.988182:0:12929:0:(genops.c:1557:class_disconnect_exports()) OBD device 5 (ffff8cb8c62a8000) has no exports 00000020:00000080:3.0:1789049542.054413:0:12929:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xf4f48ce5e1bbeaeb 00000020:00000080:3.0:1789049542.054427:0:12929:0:(genops.c:885:class_export_put()) final put ffff8cb8df658800/lustre-QMT0000_UUID 00000020:01000000:3.0:1789049542.054511:0:12929:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-QMT0000 (flags='') 00000020:00000080:2.0:1789049542.054604:0:12929:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1789049542.054615:0:12929:0:(obd_config.c:956:class_cleanup()) lustre-QMT0000: forcing exports to disconnect: 0/2 00000020:00080000:2.0:1789049542.054620:0:12929:0:(genops.c:1557:class_disconnect_exports()) OBD device 7 (ffff8cb8d6b7cd40) has no exports 00000020:00000080:0.0:1789049542.055164:0:12929:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xf4f48ce5e1bbeae4 00000020:00000080:0.0:1789049542.055172:0:12929:0:(genops.c:885:class_export_put()) final put ffff8cb8fe2d9000/lustre-MDT0000-osd_UUID 00000020:00000080:1.0:1789049542.055222:0:12636:0:(genops.c:844:class_export_destroy()) destroying export ffff8cb8df658800/lustre-QMT0000_UUID for lustre-QMT0000 00000020:00000080:0.0:1789049542.055395:0:12929:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1789049542.055403:0:12929:0:(obd_config.c:883:class_detach()) detach on obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:0.0:1789049542.055406:0:12929:0:(genops.c:885:class_export_put()) final put ffff8cb8fe2da800/lustre-QMT0000_UUID 00000020:00000080:0.0:1789049542.055408:0:12929:0:(genops.c:844:class_export_destroy()) destroying export ffff8cb8fe2da800/lustre-QMT0000_UUID for lustre-QMT0000 00000020:01000000:0.0:1789049542.055416:0:12929:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-QMT0000 (lustre-QMT0000_UUID) 00000020:00000080:1.0:1789049542.055586:0:12636:0:(genops.c:844:class_export_destroy()) destroying export ffff8cb8fe2d9000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:00010000:0.0:1789049542.363143:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789049543.068023:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb900e96d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3310:1875954110644480:0@lo:400:kworker.0 00000100:00100000:0.0:1789049543.068094:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789049543.068159:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789049543.068165:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb900e94700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3310:1875954110644608:0@lo:400:kworker.0 00000100:00100000:0.0:1789049543.068196:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789049543.068271:0:6841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954110644480 00000100:00100000:0.0:1789049543.068279:0:6841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954110644480 00000100:00100000:0.0:1789049543.068312:0:6841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954110644608 00000100:00100000:0.0:1789049543.068314:0:6841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954110644608 00000100:00100000:0.0:1789049543.068331:0:6841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 242 00000100:00100000:0.0:1789049543.068339:0:6841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8f7b91500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3310:x1875954110644480:12345-0@lo:400:kworker.0 00000020:00080000:0.0:1789049543.068355:0:6841:0:(tgt_handler.c:811:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:0.0:1789049543.068412:0:6841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8f7b91500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3310:x1875954110644480:12345-0@lo:400:kworker.0 Request processed in 73us (318us total) trans 0 rc -107/-107 00000100:00100000:0.0:1789049543.068420:0:6841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 242 00000100:00100000:0.0:1789049543.068438:0:6841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 243 00000100:00100000:0.0:1789049543.068443:0:6841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8f7b90380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3310:x1875954110644608:12345-0@lo:400:kworker.0 00000020:00080000:0.0:1789049543.068447:0:6841:0:(tgt_handler.c:811:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:0.0:1789049543.068476:0:6841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8f7b90380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3310:x1875954110644608:12345-0@lo:400:kworker.0 Request processed in 32us (279us total) trans 0 rc -107/-107 00000100:00100000:0.0:1789049543.068482:0:6841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 243 00000100:00080000:0.0:1789049543.068527:0:3310:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:0.0:1789049543.068532:0:3310:0:(import.c:65:import_set_state_nolock()) ffff8cb8f7b30800 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:0.0:1789049543.068535:0:3310:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00100000:2.0:1789049543.068644:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb900e94380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:7ef694ec-1ea0-4f02-800c-d1279b4fdf12:3309:1875954110644352:0@lo:400:kworker.0 00000100:00100000:2.0:1789049543.068872:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789049543.069390:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954110644352 00000100:00100000:2.0:1789049543.069396:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954110644352 00000100:00100000:2.0:1789049543.069438:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 303 00000100:00100000:2.0:1789049543.069447:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8c6bee050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7ef694ec-1ea0-4f02-800c-d1279b4fdf12+14:3309:x1875954110644352:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789049543.069497:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8c6bee050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7ef694ec-1ea0-4f02-800c-d1279b4fdf12+14:3309:x1875954110644352:12345-0@lo:400:kworker.0 Request processed in 51us (624us total) trans 0 rc 0/0 00000100:00100000:2.0:1789049543.069511:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 303 00000100:00100000:2.0:1789049543.069551:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb900e94380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:7ef694ec-1ea0-4f02-800c-d1279b4fdf12:3309:1875954110644352:0@lo:400:kworker.0 00000100:00080000:0.0:1789049543.092628:0:3310:0:(import.c:65:import_set_state_nolock()) ffff8cb8f7b30800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1789049543.092641:0:3310:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 185 00000100:00080000:0.0:1789049543.092677:0:3310:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8cb8f7b30800 using connection 192.168.206.126@tcp/0@lo 00000100:00100000:0.0:1789049543.092716:0:3310:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8cb8f7b92300 x1875954110644736/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1789049543.092742:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb900e94700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3310:1875954110644608:0@lo:400:kworker.0 00000100:00080000:0.0:1789049543.092769:0:3310:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0000 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:0.0:1789049543.092773:0:3310:0:(import.c:65:import_set_state_nolock()) ffff8cb7c4c41800 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:0.0:1789049543.092776:0:3310:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0000: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:0.0:1789049543.092780:0:3310:0:(import.c:65:import_set_state_nolock()) ffff8cb7c4c41800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1789049543.092783:0:3310:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 165 00000100:00080000:0.0:1789049543.092800:0:3310:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8cb7c4c41800 using connection 192.168.206.126@tcp/0@lo 00000100:00100000:0.0:1789049543.092814:0:3310:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8cb8f7b93100 x1875954110644864/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1789049543.092826:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb900e96d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3310:1875954110644480:0@lo:400:kworker.0 00000100:00100000:0.0:1789049543.096153:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb8f7b92300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3307:1875954110644736:0@lo:38:ptlrpcd_00_02.0 00000100:00100000:0.0:1789049543.096229:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789049543.096265:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb8f7b93100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3307:1875954110644864:0@lo:38:ptlrpcd_00_02.0 00000100:00100000:0.0:1789049543.096287:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789049543.096344:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954110644736 00000100:00100000:0.0:1789049543.096352:0:5851:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954110644736 00000100:00100000:0.0:1789049543.096386:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954110644864 00000100:00100000:0.0:1789049543.096389:0:5851:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954110644864 00000100:00100000:0.0:1789049543.096415:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 244 00000100:00100000:0.0:1789049543.096423:0:5851:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8f7b92d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3307:x1875954110644736:12345-0@lo:38:ptlrpcd_00_02.0 00010000:02000000:0.0:1789049543.096443:0:5851:0:(ldlm_lib.c:1212:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:2.0:1789049543.097993:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 245 00000100:00100000:2.0:1789049543.098004:0:5852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8f7b91f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3307:x1875954110644864:12345-0@lo:38:ptlrpcd_00_02.0 00010000:02000000:2.0:1789049543.098022:0:5852:0:(ldlm_lib.c:1212:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:2.0:1789049543.098097:0:5852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8f7b91f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3307:x1875954110644864:12345-0@lo:38:ptlrpcd_00_02.0 Request processed in 93us (1807us total) trans 0 rc -19/-19 00000100:00100000:2.0:1789049543.098104:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 245 00000100:00080000:2.0:1789049543.098187:0:3307:0:(import.c:65:import_set_state_nolock()) ffff8cb7c4c41800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1789049543.098194:0:3307:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1789049543.098199:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb8f7b93100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3307:1875954110644864:0@lo:38:ptlrpcd_00_02.0 00000100:00100000:0.0:1789049543.110573:0:5851:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8f7b92d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3307:x1875954110644736:12345-0@lo:38:ptlrpcd_00_02.0 Request processed in 14143us (14339us total) trans 0 rc -19/-19 00000100:00100000:0.0:1789049543.110597:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 244 00000100:00080000:0.0:1789049543.110648:0:3307:0:(import.c:65:import_set_state_nolock()) ffff8cb8f7b30800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1789049543.110654:0:3307:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1789049543.110657:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb8f7b92300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3307:1875954110644736:0@lo:38:ptlrpcd_00_02.0 00000001:00100000:0.0:1789049543.130478:0:7663:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1789049543.130487:0:7663:0:(genops.c:885:class_export_put()) final put ffff8cb8c622d000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1789049543.130516:0:12636:0:(genops.c:844:class_export_destroy()) destroying export ffff8cb8c622d000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001 00000020:00000080:0.0:1789049543.130559:0:12636:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8cb8c622f800 for lustre-OST0001 00000001:00100000:0.0:1789049543.135084:0:5872:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 59d63492-f1ee-4aa5-bf8c-853a603b0252 00000001:00080000:0.0:1789049543.135112:0:5872:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967534 is committed 00000020:00000080:0.0:1789049543.135116:0:5872:0:(genops.c:885:class_export_put()) final put ffff8cb8c62e0800/59d63492-f1ee-4aa5-bf8c-853a603b0252 00000020:00000080:0.0:1789049543.135144:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8cb8c62e0800/59d63492-f1ee-4aa5-bf8c-853a603b0252 for lustre-MDT0000 00000020:00000080:0.0:1789049543.135191:0:8:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8cb8c62e2000 for lustre-MDT0000 00000001:00100000:1.0:1789049543.145681:0:6731:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1789049543.145690:0:6731:0:(genops.c:885:class_export_put()) final put ffff8cb8df169000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1789049543.145775:0:12636:0:(genops.c:844:class_export_destroy()) destroying export ffff8cb8df169000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000 00000020:00000080:0.0:1789049543.146126:0:12636:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8cb8df168000 for lustre-OST0000 00010000:00010000:1.0:1789049543.387330:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:0.0:1789049544.091419:0:12929:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8cb8c6a19cc0 - data ffff8cb8ffc73438/ffff8cb7c556d000 00000020:01000000:0.0:1789049544.091553:0:12929:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8cb8d1a2fa20 - data ffff8cb8db45b000/ffff8cb900965000 00000001:00000004:0.0:1789049544.100351:0:12929:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967534 00000100:00080000:3.0:1789049544.217905:0:12929:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:3.0:1789049544.217912:0:12929:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967324 gen 4 00000004:00080000:3.0:1789049544.217933:0:12929:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1789049544.217936:0:12929:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:1.0:1789049544.218639:0:6838:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:1.0:1789049544.218644:0:6838:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x3:0x0] index 8 count 1 00000040:00080000:1.0:1789049544.218652:0:6838:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x2:0x0] index 1 count 2 00000100:00080000:3.0:1789049544.219455:0:12929:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:3.0:1789049544.219459:0:12929:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967310 gen 4 00000004:00080000:3.0:1789049544.219479:0:12929:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1789049544.219482:0:12929:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:1.0:1789049544.220780:0:8128:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:1.0:1789049544.220786:0:8128:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x6:0x0] index 5 count 1 00000040:00080000:1.0:1789049544.220797:0:8128:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x5:0x0] index 1 count 2 00000020:00000080:3.0:1789049544.299619:0:12929:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xf4f48ce5e1bbeab3 00000020:00000080:3.0:1789049544.299631:0:12929:0:(genops.c:885:class_export_put()) final put ffff8cb8c7ce6800/lustre-MDT0000-osd_UUID 00000020:00000080:0.0:1789049544.300309:0:12636:0:(genops.c:844:class_export_destroy()) destroying export ffff8cb8c7ce6800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:3.0:1789049544.301422:0:12929:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xf4f48ce5e1bbeac8 00000020:00000080:3.0:1789049544.301434:0:12929:0:(genops.c:885:class_export_put()) final put ffff8cb8c7ce0800/lustre-MDT0000-mdtlov_UUID 00000020:01000000:3.0:1789049544.301456:0:12929:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-mdtlov (flags='') 00000020:00000080:3.0:1789049544.301464:0:12929:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1789049544.301472:0:12929:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-mdtlov: forcing exports to disconnect: 0/2 00000020:00080000:3.0:1789049544.301476:0:12929:0:(genops.c:1557:class_disconnect_exports()) OBD device 4 (ffff8cb8c62acd40) has no exports 00000020:00000080:0.0:1789049544.301726:0:12636:0:(genops.c:844:class_export_destroy()) destroying export ffff8cb8c7ce0800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000004:01000000:3.0:1789049544.301784:0:12929:0:(lod_lov.c:59:lod_putref()) destroying 2 ltd desc 00000020:00000080:3.0:1789049544.301793:0:12929:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xf4f48ce5e1bbed06 00000020:00000080:3.0:1789049544.301798:0:12929:0:(genops.c:885:class_export_put()) final put ffff8cb8df601800/lustre-MDT0000-mdtlov_UUID 00000020:01000000:3.0:1789049544.301812:0:12929:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osc-MDT0000 (flags='') 00000020:00000080:3.0:1789049544.301816:0:12929:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1789049544.301823:0:12929:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:3.0:1789049544.301826:0:12929:0:(genops.c:1557:class_disconnect_exports()) OBD device 17 (ffff8cb900bab380) has no exports 00000020:00000080:3.0:1789049544.301833:0:12929:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xf4f48ce5e1bbecff 00000020:00000080:3.0:1789049544.301837:0:12929:0:(genops.c:885:class_export_put()) final put ffff8cb8f7b35800/lustre-MDT0000-osd_UUID 00000020:00000080:0.0:1789049544.301899:0:12636:0:(genops.c:844:class_export_destroy()) destroying export ffff8cb8df601800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:00000080:0.0:1789049544.301906:0:12636:0:(genops.c:844:class_export_destroy()) destroying export ffff8cb8f7b35800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:01000000:3.0:1789049544.302181:0:12929:0:(obd_class.h:676:obd_cleanup_client_import()) lustre-OST0001-osc-MDT0000: client import never connected 00000100:00080000:3.0:1789049544.302186:0:12929:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:3.0:1789049544.302190:0:12929:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967310 gen 5 00000004:00080000:3.0:1789049544.302195:0:12929:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1789049544.302209:0:12929:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1789049544.302252:0:12929:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1789049544.302260:0:12929:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1789049544.302265:0:12929:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xf4f48ce5e1bbec1f 00000020:00000080:3.0:1789049544.302270:0:12929:0:(genops.c:885:class_export_put()) final put ffff8cb7c4c42000/lustre-MDT0000-mdtlov_UUID 00000020:01000000:3.0:1789049544.302274:0:12929:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osc-MDT0000 (flags='') 00000020:00000080:3.0:1789049544.302277:0:12929:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1789049544.302280:0:12929:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:3.0:1789049544.302282:0:12929:0:(genops.c:1557:class_disconnect_exports()) OBD device 13 (ffff8cb8c7c6cd40) has no exports 00000020:00000080:3.0:1789049544.302285:0:12929:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xf4f48ce5e1bbec18 00000020:00000080:3.0:1789049544.302288:0:12929:0:(genops.c:885:class_export_put()) final put ffff8cb8c6bc7000/lustre-MDT0000-osd_UUID 00000020:00000080:0.0:1789049544.302380:0:12636:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8cb8f7b33000 for lustre-OST0001-osc-MDT0000 00000020:00000080:0.0:1789049544.302386:0:12636:0:(genops.c:885:class_export_put()) final put ffff8cb7c4c14000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1789049544.302388:0:12636:0:(genops.c:844:class_export_destroy()) destroying export ffff8cb7c4c14000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:01000000:0.0:1789049544.302392:0:12636:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1789049544.302454:0:12636:0:(genops.c:844:class_export_destroy()) destroying export ffff8cb7c4c42000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:00000080:0.0:1789049544.302459:0:12636:0:(genops.c:844:class_export_destroy()) destroying export ffff8cb8c6bc7000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:01000000:3.0:1789049544.302604:0:12929:0:(obd_class.h:676:obd_cleanup_client_import()) lustre-OST0000-osc-MDT0000: client import never connected 00000100:00080000:3.0:1789049544.302607:0:12929:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:3.0:1789049544.302610:0:12929:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967324 gen 5 00000004:00080000:3.0:1789049544.302613:0:12929:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1789049544.302615:0:12929:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1789049544.302649:0:12929:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1789049544.302654:0:12929:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1789049544.302689:0:12929:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1789049544.302693:0:12929:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1789049544.302696:0:12929:0:(genops.c:885:class_export_put()) final put ffff8cb8c59f0800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1789049544.302698:0:12929:0:(genops.c:844:class_export_destroy()) destroying export ffff8cb8c59f0800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:01000000:3.0:1789049544.302702:0:12929:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-mdtlov (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1789049544.303081:0:12636:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8cb8c6bc4000 for lustre-OST0000-osc-MDT0000 00000020:00000080:3.0:1789049544.303083:0:12929:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xf4f48ce5e1bbeacf 00000020:00000080:0.0:1789049544.303087:0:12636:0:(genops.c:885:class_export_put()) final put ffff8cb8c6bc1800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1789049544.303088:0:12929:0:(genops.c:885:class_export_put()) final put ffff8cb8c7ce2000/lustre-MDD0000_UUID 00000020:00000080:0.0:1789049544.303089:0:12636:0:(genops.c:844:class_export_destroy()) destroying export ffff8cb8c6bc1800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:01000000:0.0:1789049544.303093:0:12636:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:01000000:3.0:1789049544.303108:0:12929:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDD0000 (flags='') 00000020:00000080:3.0:1789049544.303111:0:12929:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1789049544.303115:0:12929:0:(obd_config.c:956:class_cleanup()) lustre-MDD0000: forcing exports to disconnect: 0/2 00000020:00080000:3.0:1789049544.303118:0:12929:0:(genops.c:1557:class_disconnect_exports()) OBD device 6 (ffff8cb900ba99c0) has no exports 00000020:00000080:3.0:1789049544.303134:0:12929:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1789049544.303137:0:12929:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000020:00000080:3.0:1789049544.303140:0:12929:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xf4f48ce5e1bbead6 00000020:00000080:3.0:1789049544.303150:0:12929:0:(genops.c:885:class_export_put()) final put ffff8cb8c7ce2800/lustre-MDT0000-osd_UUID 00000020:01000004:3.0:1789049544.303157:0:12929:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8cb8e01c3000 from lustre-MDT0000, refs=3 00000020:00000080:0.0:1789049544.303157:0:12636:0:(genops.c:844:class_export_destroy()) destroying export ffff8cb8c7ce2000/lustre-MDD0000_UUID for lustre-MDD0000 00000020:01000004:3.0:1789049544.303160:0:12929:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8cb8e01c3000 3 00000020:00000080:0.0:1789049544.303160:0:12636:0:(genops.c:885:class_export_put()) final put ffff8cb8c7ce4800/lustre-MDD0000_UUID 00000020:01000004:3.0:1789049544.303162:0:12929:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff8cb8e01c3000 from lustre-MDT0000 00000020:00000080:0.0:1789049544.303162:0:12636:0:(genops.c:844:class_export_destroy()) destroying export ffff8cb8c7ce4800/lustre-MDD0000_UUID for lustre-MDD0000 00000020:01000000:0.0:1789049544.303169:0:12636:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDD0000 (lustre-MDD0000_UUID) 00000020:00000080:0.0:1789049544.303295:0:12636:0:(genops.c:844:class_export_destroy()) destroying export ffff8cb8c7ce2800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:3.0:1789049544.303562:0:12929:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1789049544.303577:0:12929:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:00000080:3.0:1789049544.303581:0:12929:0:(genops.c:885:class_export_put()) final put ffff8cb8c7ce4000/lustre-MDT0000_UUID 00000020:00000080:3.0:1789049544.303583:0:12929:0:(genops.c:844:class_export_destroy()) destroying export ffff8cb8c7ce4000/lustre-MDT0000_UUID for lustre-MDT0000 00000020:01000000:3.0:1789049544.303591:0:12929:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000 (lustre-MDT0000_UUID) 00000020:01000004:3.0:1789049544.303620:0:12929:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 2 references. 00000020:01000004:3.0:1789049544.303624:0:12929:0:(tgt_mount.c:255:server_stop_mgs()) Stop MGS service MGS 00000020:01000000:3.0:1789049544.303627:0:12929:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGS (flags='F') 00000020:00000080:3.0:1789049544.303630:0:12929:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1789049544.303633:0:12929:0:(obd_config.c:956:class_cleanup()) MGS: forcing exports to disconnect: 1/3 00000020:00080000:3.0:1789049544.303640:0:12929:0:(genops.c:1818:print_export_data()) MGS: ACTIVE ffff8cb8d6d64000 7ef694ec-1ea0-4f02-800c-d1279b4fdf12 0@lo 13 (0 0 8) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1789049544.303645:0:12929:0:(genops.c:1552:class_disconnect_exports()) OBD device 1 (ffff8cb8c62a99c0) has exports, disconnecting them 00000020:00080000:3.0:1789049544.303649:0:12929:0:(genops.c:1527:class_disconnect_export_list()) MGS: disconnecting export at 0@lo (ffff8cb8d6d64000), last request at 1789049321 00000020:00000080:3.0:1789049544.303672:0:12929:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xf4f48ce5e1bbea6d 00000020:00010000:3.0:1789049544.303677:0:12929:0:(genops.c:1920:obd_stale_export_put()) Put export ffff8cb8d6d64000: total 0 00000100:00080000:3.0:1789049544.303681:0:12929:0:(import.c:65:import_set_state_nolock()) ffff8cb8d6d67000 : changing import state from FULL to CLOSED 00000020:00080000:3.0:1789049544.303698:0:12929:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff8cb8d6d64000): rc 0 00000020:00080000:3.0:1789049544.303702:0:12929:0:(genops.c:1557:class_disconnect_exports()) OBD device 1 (ffff8cb8c62a99c0) has no exports 00000100:00100000:3.0:1789049544.303807:0:5845:0:(service.c:3188:ptlrpc_main()) ll_mgs_0002: service thread [ffff8cb8d0a26400:5845] 2 exiting: rc = 0 00000100:00100000:0.0:1789049544.304115:0:5843:0:(service.c:3188:ptlrpc_main()) ll_mgs_0000: service thread [ffff8cb8d11acc00:5843] 0 exiting: rc = 1 00000020:00010000:1.0:1789049544.304353:0:6719:0:(genops.c:1906:obd_stale_export_get()) Get export ffff8cb8d6d64000: total 0 00010000:00010000:1.0:1789049544.304392:0:6719:0:(ldlm_lock.c:2657:ldlm_export_cancel_blocked_locks()) Export ffff8cb8d6d64000, canceled 0 locks, left on hash table 8. 00010000:00010000:1.0:1789049544.304423:0:6719:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cb8c146d600/0xf4f48ce5e1bbeda0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xf4f48ce5e1bbed99 expref: 9 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049544.304439:0:6719:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cb8d776f600/0xf4f48ce5e1bbedae lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xf4f48ce5e1bbeda7 expref: 8 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049544.304464:0:6719:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cb8d6714800/0xf4f48ce5e1bbeb8c lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xf4f48ce5e1bbeb85 expref: 7 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049544.304477:0:6719:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cb7c4c39800/0xf4f48ce5e1bbedd8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xf4f48ce5e1bbedd1 expref: 6 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049544.304487:0:6719:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cb8c146dc00/0xf4f48ce5e1bbefc2 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xf4f48ce5e1bbefbb expref: 5 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049544.304496:0:6719:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cb8c6b34400/0xf4f48ce5e1bbefd0 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xf4f48ce5e1bbefc9 expref: 4 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049544.304506:0:6719:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cb8c146d400/0xf4f48ce5e1bbed84 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xf4f48ce5e1bbed7d expref: 3 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049544.304516:0:6719:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cb8d776f000/0xf4f48ce5e1bbed92 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xf4f48ce5e1bbed8b expref: 2 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049544.304526:0:6719:0:(ldlm_lock.c:2685:ldlm_export_cancel_locks()) Export ffff8cb8d6d64000, canceled 8 locks, left on hash table 0. 00000020:00000080:1.0:1789049544.304540:0:6719:0:(genops.c:885:class_export_put()) final put ffff8cb8d6d64000/7ef694ec-1ea0-4f02-800c-d1279b4fdf12 00010000:00010000:1.0:1789049544.304558:0:6719:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789049544.304560:0:6719:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789049544.304562:0:6719:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1789049544.304755:0:12636:0:(genops.c:844:class_export_destroy()) destroying export ffff8cb8d6d64000/7ef694ec-1ea0-4f02-800c-d1279b4fdf12 for MGS 00000020:00000080:0.0:1789049544.304986:0:12636:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8cb8d6d67000 for MGS 00000100:00100000:3.0:1789049544.305810:0:5844:0:(service.c:3188:ptlrpc_main()) ll_mgs_0001: service thread [ffff8cb8d0a27a00:5844] 1 exiting: rc = 0 00000100:00100000:0.0:1789049544.305991:0:12929:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789049544.306000:0:12929:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789049544.306024:0:12929:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789049544.306030:0:12929:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789049544.306036:0:12929:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789049544.306041:0:12929:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789049544.306048:0:12929:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789049544.306053:0:12929:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789049544.306059:0:12929:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789049544.306066:0:12929:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789049544.306073:0:12929:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789049544.306078:0:12929:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789049544.306084:0:12929:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789049544.306089:0:12929:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789049544.306095:0:12929:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789049544.306100:0:12929:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789049544.306105:0:12929:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789049544.306111:0:12929:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789049544.306116:0:12929:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789049544.306121:0:12929:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789049544.306126:0:12929:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789049544.306131:0:12929:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789049544.306137:0:12929:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789049544.306142:0:12929:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789049544.306147:0:12929:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789049544.306152:0:12929:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789049544.306157:0:12929:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789049544.306162:0:12929:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789049544.306167:0:12929:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789049544.306186:0:12929:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789049544.306191:0:12929:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789049544.306196:0:12929:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789049544.306201:0:12929:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789049544.306207:0:12929:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789049544.306213:0:12929:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789049544.306218:0:12929:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789049544.306223:0:12929:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789049544.306228:0:12929:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789049544.306232:0:12929:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789049544.306238:0:12929:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789049544.306243:0:12929:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789049544.306247:0:12929:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789049544.306252:0:12929:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789049544.306257:0:12929:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789049544.306262:0:12929:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789049544.306267:0:12929:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789049544.306272:0:12929:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789049544.306277:0:12929:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789049544.306282:0:12929:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789049544.306287:0:12929:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789049544.306292:0:12929:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789049544.306296:0:12929:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789049544.306301:0:12929:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789049544.306305:0:12929:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789049544.306310:0:12929:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789049544.306314:0:12929:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789049544.306319:0:12929:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789049544.306325:0:12929:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789049544.306330:0:12929:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789049544.306336:0:12929:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789049544.306341:0:12929:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789049544.306346:0:12929:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789049544.306352:0:12929:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789049544.306356:0:12929:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 20000000:01000000:0.0:1789049544.307304:0:12929:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:0.0:1789049544.307309:0:12929:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 00000020:01000000:0.0:1789049544.312227:0:12929:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8cb8df60ce40 - data ffff8cb8ffdb2d80/ffff8cb900ece000 00000020:01000000:0.0:1789049544.312338:0:12929:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8cb8d17ae480 - data ffff8cb8db447bd0/ffff8cb8c6b81c00 00000020:00000080:0.0:1789049544.312811:0:12929:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xf4f48ce5e1bbea58 00000020:00000080:0.0:1789049544.312819:0:12929:0:(genops.c:885:class_export_put()) final put ffff8cb8c8063800/lustre-MDT0000-osd_UUID 00000020:01000004:0.0:1789049544.312838:0:12929:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8cb8e01c3000 from MGS, refs=2 00000020:01000004:0.0:1789049544.312856:0:12929:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8cb8e01c3000 2 00000020:00000080:3.0:1789049544.312859:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8cb8c8063800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000004:0.0:1789049544.312859:0:12929:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff8cb8e01c3000 from MGS 00000020:00000080:0.0:1789049544.312880:0:12929:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1789049544.312886:0:12929:0:(obd_config.c:883:class_detach()) detach on obd MGS (uuid MGS) 00000020:00000080:0.0:1789049544.312889:0:12929:0:(genops.c:885:class_export_put()) final put ffff8cb8d0168000/MGS 00000020:00000080:0.0:1789049544.312891:0:12929:0:(genops.c:844:class_export_destroy()) destroying export ffff8cb8d0168000/MGS for MGS 00000020:01000000:0.0:1789049544.312896:0:12929:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGS (MGS) 00000020:01000000:0.0:1789049544.312954:0:12929:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-MDT0000 (flags='F') 00000020:00000080:0.0:1789049544.312958:0:12929:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1789049544.312963:0:12929:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-MDT0000: forcing exports to disconnect: 1/3 00000020:00080000:0.0:1789049544.312969:0:12929:0:(genops.c:1818:print_export_data()) lustre-MDT0000-lwp-MDT0000: ACTIVE ffff8cb8db34d800 lustre-MDT0000-lwp-MDT0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1789049544.312975:0:12929:0:(genops.c:1552:class_disconnect_exports()) OBD device 8 (ffff8cb8c595b380) has exports, disconnecting them 00000020:00080000:0.0:1789049544.312980:0:12929:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0000-lwp-MDT0000: disconnecting export at 0@lo (ffff8cb8db34d800), last request at 1789049322 00000020:00000080:0.0:1789049544.312984:0:12929:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xf4f48ce5e1bbeb23 00000020:00080000:0.0:1789049544.312993:0:12929:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff8cb8db34d800): rc 0 00000020:00000080:0.0:1789049544.312998:0:12929:0:(genops.c:885:class_export_put()) final put ffff8cb8db34d800/lustre-MDT0000-lwp-MDT0000 00000020:00000080:3.0:1789049544.313173:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8cb8db34d800/lustre-MDT0000-lwp-MDT0000 for lustre-MDT0000-lwp-MDT0000 00010000:01000000:1.0:1789049544.316210:0:12929:0:(obd_class.h:676:obd_cleanup_client_import()) lustre-MDT0000-lwp-MDT0000: client import never connected 00000100:00080000:1.0:1789049544.316218:0:12929:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1789049544.316222:0:12929:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 5 00000100:00100000:1.0:1789049544.316229:0:12929:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1789049544.316292:0:8:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8cb8fe2db800 for lustre-MDT0000-lwp-MDT0000 00000020:00000080:1.0:1789049544.316386:0:12929:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1789049544.316394:0:12929:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000020:00000080:1.0:1789049544.316409:0:12929:0:(genops.c:885:class_export_put()) final put ffff8cb8db348000/lustre-MDT0000-lwp-MDT0000_UUID 00000020:00000080:1.0:1789049544.316413:0:12929:0:(genops.c:844:class_export_destroy()) destroying export ffff8cb8db348000/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000-lwp-MDT0000 00000020:01000000:1.0:1789049544.316423:0:12929:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-MDT0000 (lustre-MDT0000-lwp-MDT0000_UUID) 00000020:01000004:1.0:1789049544.316478:0:12929:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8cb8e01c3000 1 00000020:00000080:1.0:1789049544.316484:0:12929:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xf4f48ce5e1bbea4a 00000020:00000080:1.0:1789049544.316490:0:12929:0:(genops.c:885:class_export_put()) final put ffff8cb8d016c800/lustre-MDT0000-osd_UUID 00000020:01000000:1.0:1789049544.316505:0:12929:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-osd (flags='') 00000020:00000080:1.0:1789049544.316510:0:12929:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1789049544.316514:0:12929:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-osd: forcing exports to disconnect: 0/2 00000020:00080000:1.0:1789049544.316518:0:12929:0:(genops.c:1557:class_disconnect_exports()) OBD device 0 (ffff8cb8d6b7b380) has no exports 00000020:00000080:3.0:1789049544.316694:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8cb8d016c800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:3.0:1789049544.387336:0:12929:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1789049544.387350:0:12929:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00000020:00000080:3.0:1789049544.387364:0:12929:0:(genops.c:885:class_export_put()) final put ffff8cb8e01c0000/lustre-MDT0000-osd_UUID 00000020:00000080:3.0:1789049544.387368:0:12929:0:(genops.c:844:class_export_destroy()) destroying export ffff8cb8e01c0000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000000:3.0:1789049544.387383:0:12929:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-osd (lustre-MDT0000-osd_UUID) 00000020:01000004:3.0:1789049544.387519:0:12929:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff8cb8e01c1000 00000020:01000000:3.0:1789049544.387538:0:12929:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MDS (flags='F') 00000020:00000080:3.0:1789049544.387542:0:12929:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1789049544.387547:0:12929:0:(obd_config.c:956:class_cleanup()) MDS: forcing exports to disconnect: 0/1 00000020:00080000:3.0:1789049544.387550:0:12929:0:(genops.c:1557:class_disconnect_exports()) OBD device 3 (ffff8cb8c62ab380) has no exports 00000100:00100000:0.0:1789049544.387688:0:5851:0:(service.c:3188:ptlrpc_main()) mdt00_001: service thread [ffff8cb8c597b800:5851] 1 exiting: rc = 0 00000100:00100000:1.0:1789049544.389765:0:5850:0:(service.c:3188:ptlrpc_main()) mdt00_000: service thread [ffff8cb8c597b600:5850] 0 exiting: rc = 1 00000100:00100000:2.0:1789049544.390242:0:5852:0:(service.c:3188:ptlrpc_main()) mdt00_002: service thread [ffff8cb8d0383000:5852] 2 exiting: rc = 0 00000100:00100000:2.0:1789049544.390311:0:6841:0:(service.c:3188:ptlrpc_main()) mdt00_003: service thread [ffff8cb8c51ff800:6841] 3 exiting: rc = 0 00000100:00100000:3.0:1789049544.390837:0:12929:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789049544.390873:0:12929:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789049544.390880:0:12929:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789049544.390885:0:12929:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789049544.390891:0:12929:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789049544.390896:0:12929:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789049544.390902:0:12929:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789049544.390906:0:12929:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789049544.390911:0:12929:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789049544.390916:0:12929:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789049544.390921:0:12929:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789049544.390926:0:12929:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789049544.390930:0:12929:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789049544.390934:0:12929:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789049544.390939:0:12929:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789049544.390944:0:12929:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789049544.390949:0:12929:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789049544.390954:0:12929:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789049544.390958:0:12929:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789049544.390963:0:12929:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789049544.390968:0:12929:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789049544.390973:0:12929:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789049544.390979:0:12929:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789049544.390984:0:12929:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789049544.390989:0:12929:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789049544.390994:0:12929:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789049544.391161:0:12929:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789049544.391167:0:12929:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789049544.391172:0:12929:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789049544.391176:0:12929:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789049544.391181:0:12929:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789049544.391186:0:12929:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789049544.391203:0:12929:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789049544.391210:0:12929:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789049544.391215:0:12929:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789049544.391219:0:12929:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789049544.391224:0:12929:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789049544.391229:0:12929:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789049544.391234:0:12929:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789049544.391239:0:12929:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789049544.391243:0:12929:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789049544.391249:0:12929:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789049544.391253:0:12929:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789049544.391259:0:12929:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789049544.391264:0:12929:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789049544.391269:0:12929:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789049544.391274:0:12929:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789049544.391279:0:12929:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789049544.391285:0:12929:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789049544.391291:0:12929:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789049544.391299:0:12929:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789049544.391304:0:12929:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789049544.391310:0:12929:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789049544.391315:0:12929:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789049544.391322:0:12929:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789049544.391327:0:12929:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789049544.391332:0:12929:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789049544.391337:0:12929:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789049544.391343:0:12929:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789049544.391348:0:12929:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789049544.391353:0:12929:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789049544.391366:0:12929:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789049544.391371:0:12929:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789049544.391376:0:12929:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789049544.396548:0:5854:0:(service.c:3188:ptlrpc_main()) mdt_rdpg00_001: service thread [ffff8cb8d0382400:5854] 1 exiting: rc = 0 00000100:00100000:0.0:1789049544.396921:0:5853:0:(service.c:3188:ptlrpc_main()) mdt_rdpg00_000: service thread [ffff8cb8d0a26c00:5853] 0 exiting: rc = 1 00000100:00100000:3.0:1789049544.397196:0:12929:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789049544.397204:0:12929:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789049544.397211:0:12929:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789049544.397218:0:12929:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789049544.397223:0:12929:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789049544.397228:0:12929:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789049544.397234:0:12929:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789049544.397239:0:12929:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789049544.397245:0:12929:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789049544.397251:0:12929:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789049544.397257:0:12929:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789049544.397263:0:12929:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789049544.397269:0:12929:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789049544.397274:0:12929:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789049544.397279:0:12929:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789049544.397284:0:12929:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789049544.397289:0:12929:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789049544.397294:0:12929:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789049544.397299:0:12929:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789049544.397305:0:12929:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789049544.397311:0:12929:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789049544.397316:0:12929:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789049544.397321:0:12929:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789049544.397325:0:12929:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789049544.397331:0:12929:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789049544.397336:0:12929:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789049544.397341:0:12929:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789049544.397345:0:12929:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789049544.397350:0:12929:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789049544.397355:0:12929:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789049544.397359:0:12929:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789049544.397364:0:12929:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789049544.397383:0:12929:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789049544.397388:0:12929:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789049544.397393:0:12929:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789049544.397398:0:12929:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789049544.397403:0:12929:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789049544.397408:0:12929:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789049544.397413:0:12929:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789049544.397418:0:12929:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789049544.397424:0:12929:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789049544.397429:0:12929:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789049544.397433:0:12929:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789049544.397437:0:12929:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789049544.397442:0:12929:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789049544.397447:0:12929:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789049544.397451:0:12929:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789049544.397456:0:12929:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789049544.397460:0:12929:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789049544.397465:0:12929:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789049544.397469:0:12929:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789049544.397474:0:12929:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789049544.397478:0:12929:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789049544.397483:0:12929:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789049544.397488:0:12929:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789049544.397493:0:12929:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789049544.397498:0:12929:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789049544.397502:0:12929:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789049544.397508:0:12929:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789049544.397514:0:12929:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789049544.397519:0:12929:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789049544.397524:0:12929:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789049544.397528:0:12929:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789049544.397534:0:12929:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789049544.398755:0:5856:0:(service.c:3188:ptlrpc_main()) mdt_out00_001: service thread [ffff8cb8c5754200:5856] 1 exiting: rc = 0 00000100:00100000:1.0:1789049544.400900:0:5855:0:(service.c:3188:ptlrpc_main()) mdt_out00_000: service thread [ffff8cb8c5754e00:5855] 0 exiting: rc = 1 00000100:00100000:3.0:1789049544.401434:0:12929:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789049544.401443:0:12929:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789049544.401449:0:12929:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789049544.401466:0:12929:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789049544.401473:0:12929:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789049544.401478:0:12929:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789049544.401484:0:12929:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789049544.401489:0:12929:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789049544.401495:0:12929:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789049544.401511:0:12929:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789049544.401518:0:12929:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789049544.401522:0:12929:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789049544.401528:0:12929:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789049544.401532:0:12929:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789049544.401538:0:12929:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789049544.401543:0:12929:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789049544.401549:0:12929:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789049544.401555:0:12929:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789049544.401560:0:12929:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789049544.401566:0:12929:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789049544.401702:0:12929:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789049544.401723:0:12929:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789049544.401730:0:12929:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789049544.401807:0:12929:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789049544.401815:0:12929:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789049544.401821:0:12929:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789049544.401827:0:12929:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789049544.401833:0:12929:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789049544.401943:0:12929:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789049544.401954:0:12929:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789049544.401960:0:12929:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789049544.401965:0:12929:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789049544.401971:0:12929:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789049544.401992:0:12929:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789049544.401999:0:12929:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789049544.402017:0:12929:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789049544.402024:0:12929:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789049544.402032:0:12929:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789049544.402046:0:12929:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789049544.402052:0:12929:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789049544.402058:0:12929:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789049544.402065:0:12929:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789049544.402071:0:12929:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789049544.402076:0:12929:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789049544.402082:0:12929:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789049544.402102:0:12929:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789049544.402109:0:12929:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789049544.402115:0:12929:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789049544.402121:0:12929:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789049544.402127:0:12929:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789049544.402134:0:12929:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789049544.402140:0:12929:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789049544.402146:0:12929:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789049544.402154:0:12929:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789049544.402160:0:12929:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789049544.402165:0:12929:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789049544.402172:0:12929:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789049544.402193:0:12929:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789049544.402201:0:12929:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789049544.402205:0:12929:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789049544.402211:0:12929:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789049544.402218:0:12929:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789049544.402224:0:12929:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789049544.402230:0:12929:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00010000:00010000:1.0:1789049544.413058:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789049544.413281:0:5858:0:(service.c:3188:ptlrpc_main()) mdt_seqs_0001: service thread [ffff8cb8c5755e00:5858] 1 exiting: rc = 0 00000100:00100000:3.0:1789049544.413405:0:5857:0:(service.c:3188:ptlrpc_main()) mdt_seqs_0000: service thread [ffff8cb8c5755000:5857] 0 exiting: rc = 1 00000100:00100000:0.0:1789049544.413487:0:12929:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789049544.413495:0:12929:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789049544.413500:0:12929:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789049544.413505:0:12929:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789049544.413525:0:12929:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789049544.413530:0:12929:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789049544.413535:0:12929:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789049544.413540:0:12929:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789049544.413545:0:12929:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789049544.413550:0:12929:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789049544.413555:0:12929:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789049544.413560:0:12929:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789049544.413565:0:12929:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789049544.413584:0:12929:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789049544.413591:0:12929:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789049544.413599:0:12929:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789049544.413603:0:12929:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789049544.413608:0:12929:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789049544.413613:0:12929:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789049544.413619:0:12929:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789049544.413624:0:12929:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789049544.413628:0:12929:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789049544.413633:0:12929:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789049544.413638:0:12929:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789049544.413643:0:12929:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789049544.413648:0:12929:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789049544.413654:0:12929:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789049544.413669:0:12929:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789049544.413675:0:12929:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789049544.413680:0:12929:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789049544.413684:0:12929:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789049544.413689:0:12929:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789049544.413693:0:12929:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789049544.413698:0:12929:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789049544.413704:0:12929:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789049544.413709:0:12929:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789049544.413714:0:12929:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789049544.413719:0:12929:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789049544.413724:0:12929:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789049544.413981:0:12929:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789049544.413989:0:12929:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789049544.413994:0:12929:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789049544.413999:0:12929:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789049544.414073:0:12929:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789049544.414083:0:12929:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789049544.414088:0:12929:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789049544.414093:0:12929:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789049544.414098:0:12929:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789049544.414102:0:12929:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789049544.414107:0:12929:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789049544.414112:0:12929:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789049544.414116:0:12929:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789049544.414121:0:12929:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789049544.414125:0:12929:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789049544.414129:0:12929:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789049544.414134:0:12929:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789049544.414139:0:12929:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789049544.414143:0:12929:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789049544.414148:0:12929:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789049544.414153:0:12929:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789049544.414158:0:12929:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789049544.414164:0:12929:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789049544.414169:0:12929:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789049544.414174:0:12929:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789049544.415445:0:5860:0:(service.c:3188:ptlrpc_main()) mdt_seqm_0001: service thread [ffff8cb8c5754a00:5860] 1 exiting: rc = 0 00000100:00100000:0.0:1789049544.417581:0:5859:0:(service.c:3188:ptlrpc_main()) mdt_seqm_0000: service thread [ffff8cb8c5754c00:5859] 0 exiting: rc = 1 00000100:00100000:1.0:1789049544.417725:0:12929:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789049544.417732:0:12929:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789049544.417747:0:12929:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789049544.417752:0:12929:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789049544.417756:0:12929:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789049544.417761:0:12929:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789049544.417766:0:12929:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789049544.417771:0:12929:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789049544.417777:0:12929:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789049544.417782:0:12929:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789049544.417788:0:12929:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789049544.417793:0:12929:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789049544.417799:0:12929:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789049544.417803:0:12929:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789049544.417808:0:12929:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789049544.417813:0:12929:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789049544.417818:0:12929:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789049544.417823:0:12929:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789049544.417828:0:12929:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789049544.417886:0:12929:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789049544.417891:0:12929:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789049544.417896:0:12929:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789049544.417901:0:12929:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789049544.417906:0:12929:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789049544.417910:0:12929:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789049544.417915:0:12929:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789049544.417920:0:12929:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789049544.417924:0:12929:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789049544.417929:0:12929:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789049544.417933:0:12929:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789049544.417938:0:12929:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789049544.417942:0:12929:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789049544.417946:0:12929:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789049544.417950:0:12929:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789049544.417955:0:12929:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789049544.417959:0:12929:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789049544.417963:0:12929:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789049544.417967:0:12929:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789049544.417973:0:12929:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789049544.417978:0:12929:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789049544.417983:0:12929:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789049544.417988:0:12929:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789049544.417992:0:12929:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789049544.417997:0:12929:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789049544.418002:0:12929:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789049544.418017:0:12929:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789049544.418023:0:12929:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789049544.418028:0:12929:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789049544.418032:0:12929:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789049544.418037:0:12929:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789049544.418041:0:12929:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789049544.418046:0:12929:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789049544.418051:0:12929:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789049544.418055:0:12929:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789049544.418068:0:12929:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789049544.418073:0:12929:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789049544.418078:0:12929:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789049544.418102:0:12929:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789049544.418107:0:12929:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789049544.418112:0:12929:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789049544.418117:0:12929:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789049544.418122:0:12929:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789049544.418127:0:12929:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789049544.418131:0:12929:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789049544.418584:0:5861:0:(service.c:3188:ptlrpc_main()) mdt_fld_0000: service thread [ffff8cb8c5755c00:5861] 0 exiting: rc = 1 00000100:00100000:2.0:1789049544.419559:0:5862:0:(service.c:3188:ptlrpc_main()) mdt_fld_0001: service thread [ffff8cb8c5754600:5862] 1 exiting: rc = 0 00000100:00100000:1.0:1789049544.421956:0:12929:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789049544.421965:0:12929:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789049544.421969:0:12929:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789049544.421974:0:12929:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789049544.421980:0:12929:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789049544.421985:0:12929:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789049544.421990:0:12929:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789049544.421995:0:12929:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789049544.422000:0:12929:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789049544.422113:0:12929:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789049544.422120:0:12929:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789049544.422125:0:12929:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789049544.422130:0:12929:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789049544.422134:0:12929:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789049544.422139:0:12929:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789049544.422143:0:12929:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789049544.422148:0:12929:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789049544.422152:0:12929:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789049544.422157:0:12929:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789049544.422162:0:12929:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789049544.422166:0:12929:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789049544.422171:0:12929:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789049544.422176:0:12929:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789049544.422181:0:12929:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789049544.422187:0:12929:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789049544.422205:0:12929:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789049544.422210:0:12929:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789049544.422215:0:12929:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789049544.422220:0:12929:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789049544.422225:0:12929:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789049544.422230:0:12929:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789049544.422234:0:12929:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789049544.422239:0:12929:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789049544.422244:0:12929:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789049544.422249:0:12929:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789049544.422254:0:12929:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789049544.422260:0:12929:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789049544.422265:0:12929:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789049544.422270:0:12929:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789049544.422274:0:12929:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789049544.422279:0:12929:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789049544.422283:0:12929:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789049544.422288:0:12929:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789049544.422292:0:12929:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789049544.422296:0:12929:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789049544.422301:0:12929:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789049544.422305:0:12929:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789049544.422310:0:12929:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789049544.422314:0:12929:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789049544.422319:0:12929:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789049544.422324:0:12929:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789049544.422328:0:12929:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789049544.422332:0:12929:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789049544.422336:0:12929:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789049544.422342:0:12929:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789049544.422347:0:12929:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789049544.422352:0:12929:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789049544.422357:0:12929:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789049544.422361:0:12929:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789049544.422365:0:12929:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789049544.422378:0:12929:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789049544.422383:0:12929:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789049544.422388:0:12929:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789049544.422393:0:12929:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789049544.424291:0:5863:0:(service.c:3188:ptlrpc_main()) mdt_io00_000: service thread [ffff8cb8d110ec00:5863] 0 exiting: rc = 1 00000100:00100000:1.0:1789049544.424949:0:5864:0:(service.c:3188:ptlrpc_main()) mdt_io00_001: service thread [ffff8cb8d6abd400:5864] 1 exiting: rc = 0 00000100:00100000:1.0:1789049544.425234:0:5865:0:(service.c:3188:ptlrpc_main()) mdt_io00_002: service thread [ffff8cb8d6abdc00:5865] 2 exiting: rc = 0 00000100:00100000:1.0:1789049544.425292:0:12929:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789049544.425299:0:12929:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789049544.425304:0:12929:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789049544.425309:0:12929:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789049544.425327:0:12929:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789049544.425333:0:12929:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789049544.425338:0:12929:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789049544.425343:0:12929:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789049544.425349:0:12929:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789049544.425354:0:12929:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789049544.425360:0:12929:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789049544.425364:0:12929:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789049544.425370:0:12929:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789049544.425375:0:12929:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789049544.425380:0:12929:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789049544.425386:0:12929:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789049544.425391:0:12929:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789049544.425396:0:12929:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789049544.425401:0:12929:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789049544.425406:0:12929:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789049544.425412:0:12929:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789049544.425417:0:12929:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789049544.425423:0:12929:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789049544.425429:0:12929:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789049544.425434:0:12929:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789049544.425440:0:12929:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789049544.425446:0:12929:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789049544.425451:0:12929:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789049544.425471:0:12929:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789049544.425489:0:12929:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789049544.425495:0:12929:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789049544.425501:0:12929:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789049544.425507:0:12929:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789049544.425511:0:12929:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789049544.425520:0:12929:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789049544.425525:0:12929:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789049544.425532:0:12929:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789049544.425537:0:12929:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789049544.425543:0:12929:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789049544.425548:0:12929:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789049544.425554:0:12929:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789049544.425560:0:12929:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789049544.425565:0:12929:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789049544.425905:0:12929:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789049544.425913:0:12929:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789049544.425918:0:12929:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789049544.425924:0:12929:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789049544.425930:0:12929:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789049544.425935:0:12929:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789049544.425940:0:12929:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789049544.425946:0:12929:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789049544.425951:0:12929:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789049544.425974:0:12929:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789049544.425981:0:12929:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789049544.425986:0:12929:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789049544.425991:0:12929:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789049544.425997:0:12929:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789049544.426002:0:12929:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789049544.426114:0:12929:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789049544.426121:0:12929:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789049544.426127:0:12929:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789049544.426132:0:12929:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789049544.426138:0:12929:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789049544.426144:0:12929:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:1.0:1789049544.432208:0:12929:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1789049544.432220:0:12929:0:(obd_config.c:883:class_detach()) detach on obd MDS (uuid MDS_uuid) 00000020:00000080:1.0:1789049544.432225:0:12929:0:(genops.c:885:class_export_put()) final put ffff8cb8c8066800/MDS_uuid 00000020:00000080:1.0:1789049544.432230:0:12929:0:(genops.c:844:class_export_destroy()) destroying export ffff8cb8c8066800/MDS_uuid for MDS 00000020:01000000:1.0:1789049544.432235:0:12929:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MDS (MDS_uuid) 00000020:02000400:1.0:1789049544.432364:0:12929:0:(tgt_mount.c:2180:server_put_super()) server umount lustre-MDT0000 complete 00010000:00010000:1.0:1789049545.436058:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789049546.460819:0:6719:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:3.0:1789049547.325523:0:13083:0:(tgt_mount.c:2191:server_umount_begin()) umount -f 00000020:01000004:1.0:1789049547.335812:0:13083:0:(tgt_mount.c:2061:server_put_super()) server put_super lustre-OST0000 00010000:00010000:1.0:1789049547.335885:0:13083:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.126@tcp lock: ffff8cb7c4c39c00/0xf4f48ce5e1bbed99 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xf4f48ce5e1bbeda0 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049547.335899:0:13083:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.126@tcp lock: ffff8cb7c4c39c00/0xf4f48ce5e1bbed99 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xf4f48ce5e1bbeda0 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049547.335907:0:13083:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.126@tcp lock: ffff8cb7c4c39c00/0xf4f48ce5e1bbed99 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0xf4f48ce5e1bbeda0 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049547.335914:0:13083:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.126@tcp lock: ffff8cb7c4c39c00/0xf4f48ce5e1bbed99 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0xf4f48ce5e1bbeda0 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049547.335933:0:13083:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:1.0:1789049547.335938:0:13083:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:1.0:1789049547.335960:0:13083:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1789049547.335964:0:13083:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 3 00000100:00080000:1.0:1789049547.335969:0:13083:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00080000:1.0:1789049547.335975:0:13083:0:(import.c:65:import_set_state_nolock()) ffff8cb7c4c41800 lustre-MDT0000_UUID: changing import state from DISCONN to CLOSED 00000100:00080000:1.0:1789049547.335980:0:13083:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1789049547.335982:0:13083:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 4 00000100:00100000:1.0:1789049547.335985:0:13083:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:1.0:1789049547.336883:0:13083:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.126@tcp lock: ffff8cb8d6714600/0xf4f48ce5e1bbeda7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xf4f48ce5e1bbedae expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049547.336909:0:13083:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.126@tcp lock: ffff8cb8d6714600/0xf4f48ce5e1bbeda7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xf4f48ce5e1bbedae expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049547.336916:0:13083:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.126@tcp lock: ffff8cb8d6714600/0xf4f48ce5e1bbeda7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0xf4f48ce5e1bbedae expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049547.336923:0:13083:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.126@tcp lock: ffff8cb8d6714600/0xf4f48ce5e1bbeda7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0xf4f48ce5e1bbedae expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049547.336938:0:13083:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1789049547.336951:0:5839:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1789049547.336956:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.126@tcp lock: ffff8cb7c4c39c00/0xf4f48ce5e1bbed99 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0xf4f48ce5e1bbeda0 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049547.336963:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cb7c4c39c00 already unused, calling callback (ffffffffc1ca3c20) 10000000:00010000:1.0:1789049547.336966:0:5839:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.126@tcp lock: ffff8cb7c4c39c00/0xf4f48ce5e1bbed99 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0xf4f48ce5e1bbeda0 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049547.336975:0:5839:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.126@tcp lock: ffff8cb7c4c39c00/0xf4f48ce5e1bbed99 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1008400000000 nid: local remote: 0xf4f48ce5e1bbeda0 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789049547.336982:0:5839:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.126@tcp lock: ffff8cb7c4c39c00/0xf4f48ce5e1bbed99 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1009400000000 nid: local remote: 0xf4f48ce5e1bbeda0 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789049547.336988:0:5839:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1789049547.337077:0:5838:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789049547.337083:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.126@tcp lock: ffff8cb8d6714600/0xf4f48ce5e1bbeda7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0xf4f48ce5e1bbedae expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049547.337090:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cb8d6714600 already unused, calling callback (ffffffffc1ca3c20) 10000000:00010000:0.0:1789049547.337093:0:5838:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.126@tcp lock: ffff8cb8d6714600/0xf4f48ce5e1bbeda7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0xf4f48ce5e1bbedae expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049547.337106:0:5838:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.126@tcp lock: ffff8cb8d6714600/0xf4f48ce5e1bbeda7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1008400000000 nid: local remote: 0xf4f48ce5e1bbedae expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789049547.337112:0:5838:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.126@tcp lock: ffff8cb8d6714600/0xf4f48ce5e1bbeda7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1009400000000 nid: local remote: 0xf4f48ce5e1bbedae expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789049547.337117:0:5838:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1789049547.337119:0:5838:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0000: stopping, won't requeue 00010000:00010000:0.0:1789049547.337147:0:5838:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.126@tcp lock: ffff8cb8d6714600/0xf4f48ce5e1bbeda7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000020 nid: local remote: 0xf4f48ce5e1bbedae expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049547.337153:0:5838:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789049547.337175:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.126@tcp lock: ffff8cb8d6714600/0xf4f48ce5e1bbeda7 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000020 nid: local remote: 0xf4f48ce5e1bbedae expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049547.337182:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.126@tcp lock: ffff8cb8d6714600/0xf4f48ce5e1bbeda7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000020 nid: local remote: 0xf4f48ce5e1bbedae expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049547.337193:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789049547.337195:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789049547.337197:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789049547.337211:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb8f7b92300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7ef694ec-1ea0-4f02-800c-d1279b4fdf12:3308:1875954110644992:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789049547.337265:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789049547.337318:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954110644992 00000100:00100000:0.0:1789049547.337323:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954110644992 00000100:00100000:0.0:1789049547.337353:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1789049547.337360:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8f7b91880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0+-99:3308:x1875954110644992:12345-0@lo:103:ldlm_bl.0 00010000:00020000:0.0:1789049547.337366:0:5835:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1789049547 with bad export cookie 17650887758534404717 10000000:01000000:1.0:1789049547.340178:0:5839:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:1.0:1789049547.340182:0:5839:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:1.0:1789049547.340222:0:5839:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.126@tcp lock: ffff8cb7c4c39c00/0xf4f48ce5e1bbed99 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0xf4f48ce5e1bbeda0 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049547.340247:0:5839:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789049547.340274:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.126@tcp lock: ffff8cb7c4c39c00/0xf4f48ce5e1bbed99 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0xf4f48ce5e1bbeda0 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049547.340282:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.126@tcp lock: ffff8cb7c4c39c00/0xf4f48ce5e1bbed99 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0xf4f48ce5e1bbeda0 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049547.340308:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789049547.340311:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789049547.340313:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789049547.340333:0:13083:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.126@tcp lock: ffff8cb8c6b35000/0xf4f48ce5e1bbefc9 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf4f48ce5e1bbefd0 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049547.340342:0:13083:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.126@tcp lock: ffff8cb8c6b35000/0xf4f48ce5e1bbefc9 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xf4f48ce5e1bbefd0 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049547.340349:0:13083:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.126@tcp lock: ffff8cb8c6b35000/0xf4f48ce5e1bbefc9 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xf4f48ce5e1bbefd0 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049547.340356:0:13083:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.126@tcp lock: ffff8cb8c6b35000/0xf4f48ce5e1bbefc9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xf4f48ce5e1bbefd0 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049547.340373:0:13083:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:1.0:1789049547.340377:0:13083:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0000 10000000:01000000:1.0:1789049547.340381:0:13083:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0000 (0) 00000020:01000004:1.0:1789049547.340411:0:13083:0:(tgt_mount.c:2111:server_put_super()) stopping lustre-OST0000 00000020:01000000:1.0:1789049547.340415:0:13083:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000 (flags='F') 00000020:00000080:1.0:1789049547.340420:0:13083:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1789049547.340425:0:13083:0:(obd_config.c:956:class_cleanup()) lustre-OST0000: forcing exports to disconnect: 0/1 00000020:00080000:1.0:1789049547.340430:0:13083:0:(genops.c:1557:class_disconnect_exports()) OBD device 11 (ffff8cb8d6b799c0) has no exports 00000020:00080000:1.0:1789049547.340469:0:13083:0:(genops.c:1557:class_disconnect_exports()) OBD device 11 (ffff8cb8d6b799c0) has no exports 00000100:00100000:2.0:1789049547.341535:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb900e40000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:7ef694ec-1ea0-4f02-800c-d1279b4fdf12:3309:1875954110645120:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789049547.341601:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789049547.341668:0:6720:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954110645120 00000100:00100000:2.0:1789049547.341674:0:6720:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954110645120 00000100:00100000:2.0:1789049547.341711:0:6720:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1789049547.341717:0:6720:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb900e94380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0+-99:3309:x1875954110645120:12345-0@lo:103:ldlm_bl.0 00010000:00020000:2.0:1789049547.341724:0:6720:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1789049547 with bad export cookie 17650887758534404717 00000100:00100000:2.0:1789049547.341765:0:6720:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb900e94380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0+-99:3309:x1875954110645120:12345-0@lo:103:ldlm_bl.0 Request processed in 46us (164us total) trans 0 rc -107/-107 00000100:00100000:2.0:1789049547.341775:0:6720:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00080000:2.0:1789049547.341810:0:3309:0:(recover.c:205:ptlrpc_request_handle_notconn()) import MGC192.168.206.126@tcp of MGS@0@lo abruptly disconnected: reconnecting 00000100:00080000:2.0:1789049547.341822:0:3309:0:(import.c:65:import_set_state_nolock()) ffff8cb8c62b9000 MGS: changing import state from FULL to DISCONN 00000100:02020000:2.0:1789049547.341826:0:3309:0:(import.c:186:ptlrpc_set_import_discon()) MGC192.168.206.126@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail 00000020:01000000:1.0:1789049547.353400:0:13083:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8cb8c6a19a20 - data ffff8cb8ffc735e8/ffff8cb7c556c800 00000020:01000000:1.0:1789049547.353552:0:13083:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8cb8c7829e40 - data ffff8cb8db42e000/ffff8cb7c4e90400 00010000:00010000:3.0:1789049547.362152:0:6719:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789049547.362166:0:6719:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.126@tcp lock: ffff8cb8c6b35000/0xf4f48ce5e1bbefc9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xf4f48ce5e1bbefd0 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049547.362179:0:6719:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cb8c6b35000 already unused, calling callback (ffffffffc1ca3c20) 10000000:00010000:3.0:1789049547.362198:0:6719:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.126@tcp lock: ffff8cb8c6b35000/0xf4f48ce5e1bbefc9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xf4f48ce5e1bbefd0 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049547.362208:0:6719:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.126@tcp lock: ffff8cb8c6b35000/0xf4f48ce5e1bbefc9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0xf4f48ce5e1bbefd0 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789049547.362215:0:6719:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.126@tcp lock: ffff8cb8c6b35000/0xf4f48ce5e1bbefc9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0xf4f48ce5e1bbefd0 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789049547.362221:0:6719:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:3.0:1789049547.362224:0:6719:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:3.0:1789049547.362226:0:6719:0:(mgc_request.c:130:config_log_put()) dropping config log params 00000100:00100000:0.0:1789049547.364160:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8f7b91880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0+-99:3308:x1875954110644992:12345-0@lo:103:ldlm_bl.0 Request processed in 26794us (26889us total) trans 0 rc -107/-107 00000100:00100000:0.0:1789049547.364172:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00080000:2.0:1789049547.383639:0:3309:0:(import.c:192:ptlrpc_set_import_discon()) import MGS@0@lo for MGC192.168.206.126@tcp not replayable, auto-deactivating 00000100:00080000:2.0:1789049547.384196:0:3309:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:2.0:1789049547.384263:0:3309:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff8cb8f7b92300 x1875954110644992/t0(0) o103->MGC192.168.206.126@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1789049563 ref 1 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789049547.384277:0:3309:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff8cb900e40000 x1875954110645120/t0(0) o103->MGC192.168.206.126@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1789049563 ref 1 fl Rpc:RQU/200/0 rc 0/-107 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789049547.389166:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb8f7b92300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7ef694ec-1ea0-4f02-800c-d1279b4fdf12:3308:1875954110644992:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789049547.390297:0:6719:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.126@tcp lock: ffff8cb8c6b35000/0xf4f48ce5e1bbefc9 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xf4f48ce5e1bbefd0 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049547.390309:0:6719:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789049547.390347:0:6719:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.126@tcp lock: ffff8cb8c6b35000/0xf4f48ce5e1bbefc9 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xf4f48ce5e1bbefd0 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049547.390356:0:6719:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.126@tcp lock: ffff8cb8c6b35000/0xf4f48ce5e1bbefc9 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xf4f48ce5e1bbefd0 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049547.390374:0:6719:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789049547.390377:0:6719:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789049547.390379:0:6719:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789049547.390390:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1789049547.390406:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb7c5c35c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:7ef694ec-1ea0-4f02-800c-d1279b4fdf12:0:1875954110645248:0@lo:103:ldlm_bl.0 10000000:01000000:2.0:1789049547.390923:0:3309:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:2.0:1789049547.390928:0:3309:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:2.0:1789049547.390929:0:3309:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:2.0:1789049547.390934:0:3309:0:(import.c:65:import_set_state_nolock()) ffff8cb8c62b9000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1789049547.390940:0:3309:0:(import.c:545:import_select_connection()) MGC192.168.206.126@tcp: connect to NID 0@lo last attempt 147 00000100:00080000:2.0:1789049547.390953:0:3309:0:(import.c:666:import_select_connection()) MGC192.168.206.126@tcp: import ffff8cb8c62b9000 using connection 192.168.206.126@tcp/0@lo 00000100:00100000:2.0:1789049547.391579:0:3309:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8cb900e95880 x1875954110645376/t0(0) o250->MGC192.168.206.126@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1789049547.391686:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb900e95880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:7ef694ec-1ea0-4f02-800c-d1279b4fdf12:3307:1875954110645376:0@lo:250:ptlrpcd_00_01.0 00000400:00000100:0.0:1789049547.391736:0:3307:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1875954110645376 offset 0 length 520: 4 00000100:00100000:0.0:1789049547.391783:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb900e40000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:7ef694ec-1ea0-4f02-800c-d1279b4fdf12:3309:1875954110645120:0@lo:103:ldlm_bl.0 00100000:10000000:0.0:1789049547.403683:0:13083:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0000-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:2.0:1789049547.443096:0:13083:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xf4f48ce5e1bbeba8 00000020:00000080:2.0:1789049547.443106:0:13083:0:(genops.c:885:class_export_put()) final put ffff8cb7c4c4f800/lustre-OST0000-osd_UUID 00000020:01000004:2.0:1789049547.443116:0:13083:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8cb8d1c83000 from lustre-OST0000, refs=2 00000020:01000004:2.0:1789049547.443119:0:13083:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8cb8d1c83000 2 00000020:01000004:2.0:1789049547.443122:0:13083:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff8cb8d1c83000 from lustre-OST0000 00000020:00000080:2.0:1789049547.443145:0:13083:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1789049547.443154:0:13083:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:00000080:2.0:1789049547.443157:0:13083:0:(genops.c:885:class_export_put()) final put ffff8cb7c4c4d800/lustre-OST0000_UUID 00000020:00000080:2.0:1789049547.443159:0:13083:0:(genops.c:844:class_export_destroy()) destroying export ffff8cb7c4c4d800/lustre-OST0000_UUID for lustre-OST0000 00000020:01000000:2.0:1789049547.443165:0:13083:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000 (lustre-OST0000_UUID) 00000020:01000004:2.0:1789049547.443201:0:13083:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 1 references. 00000020:01000000:2.0:1789049547.443216:0:13083:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0000 (flags='F') 00000020:00000080:2.0:1789049547.443220:0:13083:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1789049547.443235:0:13083:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-OST0000: forcing exports to disconnect: 1/3 00000020:00080000:2.0:1789049547.443249:0:13083:0:(genops.c:1818:print_export_data()) lustre-MDT0000-lwp-OST0000: ACTIVE ffff8cb7c4c15000 lustre-MDT0000-lwp-OST0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1789049547.443254:0:13083:0:(genops.c:1552:class_disconnect_exports()) OBD device 12 (ffff8cb8c595cd40) has exports, disconnecting them 00000020:00080000:2.0:1789049547.443259:0:13083:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0000: disconnecting export at 0@lo (ffff8cb7c4c15000), last request at 1789049339 00000020:00000080:2.0:1789049547.443262:0:13083:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xf4f48ce5e1bbebd2 00000020:00080000:2.0:1789049547.443271:0:13083:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff8cb7c4c15000): rc 0 00000020:00000080:2.0:1789049547.443275:0:13083:0:(genops.c:885:class_export_put()) final put ffff8cb7c4c15000/lustre-MDT0000-lwp-OST0000 00000020:00000080:3.0:1789049547.443534:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8cb7c4c4f800/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:3.0:1789049547.443545:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8cb7c4c15000/lustre-MDT0000-lwp-OST0000 for lustre-MDT0000-lwp-OST0000 00010000:01000000:2.0:1789049547.458170:0:13083:0:(obd_class.h:676:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0000: client import never connected 00000100:00080000:2.0:1789049547.458178:0:13083:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1789049547.458182:0:13083:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 5 00000100:00100000:2.0:1789049547.458188:0:13083:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1789049547.458235:0:8:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8cb7c4c41800 for lustre-MDT0000-lwp-OST0000 00000020:00000080:2.0:1789049547.458365:0:13083:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1789049547.458374:0:13083:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000020:00000080:2.0:1789049547.458379:0:13083:0:(genops.c:885:class_export_put()) final put ffff8cb7c4c44000/lustre-MDT0000-lwp-OST0000_UUID 00000020:00000080:2.0:1789049547.458383:0:13083:0:(genops.c:844:class_export_destroy()) destroying export ffff8cb7c4c44000/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000-lwp-OST0000 00000020:01000000:2.0:1789049547.458390:0:13083:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0000 (lustre-MDT0000-lwp-OST0000_UUID) 00000020:01000004:2.0:1789049547.458441:0:13083:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8cb8d1c83000 1 00000020:00000080:2.0:1789049547.458446:0:13083:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xf4f48ce5e1bbeb62 00000020:00000080:2.0:1789049547.458452:0:13083:0:(genops.c:885:class_export_put()) final put ffff8cb8c7ce5000/lustre-OST0000-osd_UUID 00000020:01000000:2.0:1789049547.458533:0:13083:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osd (flags='') 00000020:00000080:2.0:1789049547.458538:0:13083:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1789049547.458543:0:13083:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osd: forcing exports to disconnect: 0/2 00000020:00080000:2.0:1789049547.458546:0:13083:0:(genops.c:1557:class_disconnect_exports()) OBD device 9 (ffff8cb8d6b78000) has no exports 00000020:00000080:3.0:1789049547.458605:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8cb8c7ce5000/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00010000:00010000:0.0:1789049547.484401:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1789049547.500352:0:13083:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1789049547.500366:0:13083:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00000020:00000080:2.0:1789049547.500371:0:13083:0:(genops.c:885:class_export_put()) final put ffff8cb8fe2dc000/lustre-OST0000-osd_UUID 00000020:00000080:2.0:1789049547.500376:0:13083:0:(genops.c:844:class_export_destroy()) destroying export ffff8cb8fe2dc000/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:01000000:2.0:1789049547.500382:0:13083:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osd (lustre-OST0000-osd_UUID) 00000020:01000004:2.0:1789049547.500508:0:13083:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff8cb8d1c82800 00000020:02000400:2.0:1789049547.500555:0:13083:0:(tgt_mount.c:2180:server_put_super()) server umount lustre-OST0000 complete 00000100:00080000:3.0:1789049548.189600:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) 7ef694ec-1ea0-4f02-800c-d1279b4fdf12->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1789049548.189608:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) 7ef694ec-1ea0-4f02-800c-d1279b4fdf12->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1789049548.189611:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1789049548.189614:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1789049548.189618:0:8:0:(import.c:65:import_set_state_nolock()) ffff8cb8f7b30800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1789049548.189625:0:8:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 369 00000100:00080000:3.0:1789049548.189630:0:8:0:(import.c:630:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1789049548.189652:0:8:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8cb8f7b30800 using connection 192.168.206.126@tcp/0@lo 00000100:00100000:3.0:1789049548.189683:0:8:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8cb7c5c34a80 x1875954110645504/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1789049548.190296:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb7c5c34a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3307:1875954110645504:0@lo:38:kworker.0 00000400:00000100:0.0:1789049548.190351:0:3307:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875954110645504 offset 0 length 520: 4 00010000:00010000:1.0:1789049548.508035:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789049549.532017:0:6719:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1789049550.247600:0:13234:0:(tgt_mount.c:2191:server_umount_begin()) umount -f 00000020:01000004:0.0:1789049550.261206:0:13234:0:(tgt_mount.c:2061:server_put_super()) server put_super lustre-OST0001 00010000:00010000:0.0:1789049550.261286:0:13234:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.126@tcp lock: ffff8cb8d776fc00/0xf4f48ce5e1bbed7d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf4f48ce5e1bbed84 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049550.261370:0:13234:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.126@tcp lock: ffff8cb8d776fc00/0xf4f48ce5e1bbed7d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xf4f48ce5e1bbed84 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049550.261380:0:13234:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.126@tcp lock: ffff8cb8d776fc00/0xf4f48ce5e1bbed7d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0xf4f48ce5e1bbed84 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049550.261387:0:13234:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.126@tcp lock: ffff8cb8d776fc00/0xf4f48ce5e1bbed7d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0xf4f48ce5e1bbed84 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049550.261448:0:13234:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:0.0:1789049550.261454:0:13234:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:0.0:1789049550.261479:0:13234:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1789049550.261490:0:13234:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff8cb7c5c34a80 x1875954110645504/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 1789049563 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789049550.261512:0:13234:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 3 00000100:00080000:0.0:1789049550.261518:0:13234:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00080000:0.0:1789049550.261524:0:13234:0:(import.c:65:import_set_state_nolock()) ffff8cb8f7b30800 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00080000:0.0:1789049550.261529:0:13234:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1789049550.261532:0:13234:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff8cb7c5c34a80 x1875954110645504/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 1789049563 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789049550.261539:0:13234:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 4 00000100:00100000:0.0:1789049550.261542:0:13234:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 17s for inflight to error out 00000100:00100000:1.0:1789049550.261599:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb7c5c34a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3307:1875954110645504:0@lo:38:kworker.0 00010000:00010000:0.0:1789049550.262671:0:13234:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.126@tcp lock: ffff8cb8d6715400/0xf4f48ce5e1bbed8b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf4f48ce5e1bbed92 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049550.262683:0:13234:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.126@tcp lock: ffff8cb8d6715400/0xf4f48ce5e1bbed8b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xf4f48ce5e1bbed92 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049550.262700:0:13234:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.126@tcp lock: ffff8cb8d6715400/0xf4f48ce5e1bbed8b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0xf4f48ce5e1bbed92 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049550.262706:0:13234:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.126@tcp lock: ffff8cb8d6715400/0xf4f48ce5e1bbed8b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0xf4f48ce5e1bbed92 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049550.266380:0:5838:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1789049550.266395:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.126@tcp lock: ffff8cb8d776fc00/0xf4f48ce5e1bbed7d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0xf4f48ce5e1bbed84 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049550.266407:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cb8d776fc00 already unused, calling callback (ffffffffc1ca3c20) 10000000:00010000:2.0:1789049550.266412:0:5838:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.126@tcp lock: ffff8cb8d776fc00/0xf4f48ce5e1bbed7d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0xf4f48ce5e1bbed84 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049550.266423:0:5838:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.126@tcp lock: ffff8cb8d776fc00/0xf4f48ce5e1bbed7d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0xf4f48ce5e1bbed84 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789049550.266430:0:5838:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.126@tcp lock: ffff8cb8d776fc00/0xf4f48ce5e1bbed7d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0xf4f48ce5e1bbed84 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789049550.266436:0:5838:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1789049550.266438:0:5838:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:2.0:1789049550.266442:0:5838:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:2.0:1789049550.266458:0:5838:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff8cb8c62b9000 00010000:00010000:2.0:1789049550.266462:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.126@tcp lock: ffff8cb8d776fc00/0xf4f48ce5e1bbed7d lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0xf4f48ce5e1bbed84 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049550.266468:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.126@tcp lock: ffff8cb8d776fc00/0xf4f48ce5e1bbed7d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0xf4f48ce5e1bbed84 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049550.266481:0:5838:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789049550.266485:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.126@tcp lock: ffff8cb8d6715400/0xf4f48ce5e1bbed8b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xf4f48ce5e1bbed92 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049550.266489:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cb8d6715400 already unused, calling callback (ffffffffc1ca3c20) 10000000:00010000:2.0:1789049550.266492:0:5838:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.126@tcp lock: ffff8cb8d6715400/0xf4f48ce5e1bbed8b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xf4f48ce5e1bbed92 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049550.266512:0:5838:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.126@tcp lock: ffff8cb8d6715400/0xf4f48ce5e1bbed8b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0xf4f48ce5e1bbed92 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789049550.266517:0:5838:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.126@tcp lock: ffff8cb8d6715400/0xf4f48ce5e1bbed8b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0xf4f48ce5e1bbed92 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789049550.266522:0:5838:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1789049550.266525:0:5838:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0001: stopping, won't requeue 00010000:00010000:2.0:1789049550.266529:0:5838:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff8cb8c62b9000 00010000:00010000:2.0:1789049550.266532:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.126@tcp lock: ffff8cb8d6715400/0xf4f48ce5e1bbed8b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0xf4f48ce5e1bbed92 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049550.266539:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789049550.266541:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789049550.266543:0:5838:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789049550.266646:0:13234:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1789049550.266654:0:13234:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.126@tcp lock: ffff8cb8d6715400/0xf4f48ce5e1bbed8b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0xf4f48ce5e1bbed92 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049550.266668:0:13234:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.126@tcp lock: ffff8cb8c6b34a00/0xf4f48ce5e1bbefbb lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf4f48ce5e1bbefc2 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049550.266676:0:13234:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.126@tcp lock: ffff8cb8c6b34a00/0xf4f48ce5e1bbefbb lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xf4f48ce5e1bbefc2 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049550.266682:0:13234:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.126@tcp lock: ffff8cb8c6b34a00/0xf4f48ce5e1bbefbb lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xf4f48ce5e1bbefc2 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049550.266689:0:13234:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.126@tcp lock: ffff8cb8c6b34a00/0xf4f48ce5e1bbefbb lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xf4f48ce5e1bbefc2 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049550.266767:0:5839:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789049550.266774:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.126@tcp lock: ffff8cb8c6b34a00/0xf4f48ce5e1bbefbb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xf4f48ce5e1bbefc2 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049550.266781:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cb8c6b34a00 already unused, calling callback (ffffffffc1ca3c20) 10000000:00010000:1.0:1789049550.266784:0:5839:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.126@tcp lock: ffff8cb8c6b34a00/0xf4f48ce5e1bbefbb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xf4f48ce5e1bbefc2 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049550.266791:0:5839:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.126@tcp lock: ffff8cb8c6b34a00/0xf4f48ce5e1bbefbb lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0xf4f48ce5e1bbefc2 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789049550.266798:0:5839:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.126@tcp lock: ffff8cb8c6b34a00/0xf4f48ce5e1bbefbb lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0xf4f48ce5e1bbefc2 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789049550.266803:0:5839:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:1.0:1789049550.266806:0:5839:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 00010000:00010000:1.0:1789049550.266811:0:5839:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff8cb8c62b9000 00010000:00010000:1.0:1789049550.266813:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.126@tcp lock: ffff8cb8c6b34a00/0xf4f48ce5e1bbefbb lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0xf4f48ce5e1bbefc2 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049550.266821:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789049550.266823:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789049550.266824:0:5839:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789049550.266982:0:13234:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1789049550.266987:0:13234:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.126@tcp lock: ffff8cb8c6b34a00/0xf4f48ce5e1bbefbb lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0xf4f48ce5e1bbefc2 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789049550.267000:0:13234:0:(mgc_request.c:130:config_log_put()) dropping config log params 10000000:01000000:0.0:1789049550.267004:0:13234:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0001 10000000:01000000:0.0:1789049550.267006:0:13234:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0001 (0) 00000020:01000004:0.0:1789049550.267040:0:13234:0:(tgt_mount.c:2111:server_put_super()) stopping lustre-OST0001 00000020:01000000:0.0:1789049550.267044:0:13234:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001 (flags='F') 00000020:00000080:0.0:1789049550.267049:0:13234:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1789049550.267055:0:13234:0:(obd_config.c:956:class_cleanup()) lustre-OST0001: forcing exports to disconnect: 0/1 00000020:00080000:0.0:1789049550.267058:0:13234:0:(genops.c:1557:class_disconnect_exports()) OBD device 15 (ffff8cb8c7c699c0) has no exports 00000020:00080000:0.0:1789049550.267083:0:13234:0:(genops.c:1557:class_disconnect_exports()) OBD device 15 (ffff8cb8c7c699c0) has no exports 00010000:00010000:2.0:1789049550.269529:0:6719:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:1.0:1789049550.269598:0:13234:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8cb8c6a19de0 - data ffff8cb8db6a0870/ffff8cb8f7ba0400 00000020:01000000:1.0:1789049550.269746:0:13234:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8cb8c63ef240 - data ffff8cb8ffcac6c0/ffff8cb900ec2400 00100000:10000000:1.0:1789049550.282154:0:13234:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0001-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:2.0:1789049550.321100:0:13234:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xf4f48ce5e1bbec73 00000020:00000080:2.0:1789049550.321109:0:13234:0:(genops.c:885:class_export_put()) final put ffff8cb8f7b34000/lustre-OST0001-osd_UUID 00000020:01000004:2.0:1789049550.321125:0:13234:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8cb8c631b800 from lustre-OST0001, refs=2 00000020:01000004:2.0:1789049550.321128:0:13234:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8cb8c631b800 2 00000020:01000004:2.0:1789049550.321131:0:13234:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff8cb8c631b800 from lustre-OST0001 00000020:00000080:2.0:1789049550.321152:0:13234:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1789049550.321161:0:13234:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:00000080:2.0:1789049550.321163:0:13234:0:(genops.c:885:class_export_put()) final put ffff8cb8f7b32000/lustre-OST0001_UUID 00000020:00000080:2.0:1789049550.321166:0:13234:0:(genops.c:844:class_export_destroy()) destroying export ffff8cb8f7b32000/lustre-OST0001_UUID for lustre-OST0001 00000020:01000000:2.0:1789049550.321173:0:13234:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001 (lustre-OST0001_UUID) 00000100:00080000:2.0:1789049550.321272:0:13234:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import 7ef694ec-1ea0-4f02-800c-d1279b4fdf12->MGS 00010000:00010000:2.0:1789049550.321287:0:13234:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.126@tcp lock: ffff8cb8c0030000/0xf4f48ce5e1bbeb85 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0xf4f48ce5e1bbeb8c expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789049550.321324:0:13234:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.126@tcp lock: ffff8cb8c0030000/0xf4f48ce5e1bbeb85 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0xf4f48ce5e1bbeb8c expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789049550.321329:0:13234:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 10000000:01000000:2.0:1789049550.321332:0:13234:0:(mgc_request.c:954:mgc_blocking_ast()) log nodemap: disconnecting, won't requeue 10000000:01000000:2.0:1789049550.321335:0:13234:0:(mgc_request.c:130:config_log_put()) dropping config log nodemap 00010000:00010000:2.0:1789049550.321347:0:13234:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff8cb8c62b9000 00010000:00010000:2.0:1789049550.321350:0:13234:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.126@tcp lock: ffff8cb8c0030000/0xf4f48ce5e1bbeb85 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0xf4f48ce5e1bbeb8c expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049550.321365:0:13234:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.126@tcp lock: ffff8cb8c6b34800/0xf4f48ce5e1bbedd1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0xf4f48ce5e1bbedd8 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789049550.321370:0:13234:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.126@tcp lock: ffff8cb8c6b34800/0xf4f48ce5e1bbedd1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0xf4f48ce5e1bbedd8 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789049550.321374:0:13234:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1789049550.321376:0:13234:0:(mgc_request.c:954:mgc_blocking_ast()) log lustre-s: disconnecting, won't requeue 10000000:01000000:2.0:1789049550.321378:0:13234:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-sptlrpc 00010000:00010000:2.0:1789049550.321385:0:13234:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff8cb8c62b9000 00010000:00010000:2.0:1789049550.321388:0:13234:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.126@tcp lock: ffff8cb8c6b34800/0xf4f48ce5e1bbedd1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0xf4f48ce5e1bbedd8 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:2.0:1789049550.321402:0:13234:0:(import.c:65:import_set_state_nolock()) ffff8cb8c62b9000 MGS: changing import state from CONNECTING to CLOSED 10000000:01000000:2.0:1789049550.321406:0:13234:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:2.0:1789049550.321408:0:13234:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:2.0:1789049550.321409:0:13234:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:2.0:1789049550.321413:0:13234:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:2.0:1789049550.321422:0:13234:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff8cb900e95880 x1875954110645376/t0(0) o250->MGC192.168.206.126@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 1789049557 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'ptlrpcd_00_01.0' uid:0 gid:0 projid:4294967295 10000000:01000000:2.0:1789049550.321452:0:13234:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:2.0:1789049550.321455:0:13234:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 9s for inflight to error out 00000020:00000080:1.0:1789049550.321641:0:12636:0:(genops.c:844:class_export_destroy()) destroying export ffff8cb8f7b34000/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000100:00100000:3.0:1789049550.321709:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb900e95880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:7ef694ec-1ea0-4f02-800c-d1279b4fdf12:3307:1875954110645376:0@lo:250:ptlrpcd_00_01.0 10000000:01000000:1.0:1789049550.321872:0:13234:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:1.0:1789049550.321880:0:13234:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xf4f48ce5e1bbea66 00000020:00000080:1.0:1789049550.321885:0:13234:0:(genops.c:885:class_export_put()) final put ffff8cb8c8067000/7ef694ec-1ea0-4f02-800c-d1279b4fdf12 00000020:01000000:1.0:1789049550.321897:0:13234:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGC192.168.206.126@tcp (flags='') 00000020:00000080:1.0:1789049550.321902:0:13234:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1789049550.321907:0:13234:0:(obd_config.c:956:class_cleanup()) MGC192.168.206.126@tcp: forcing exports to disconnect: 0/3 00000020:00080000:1.0:1789049550.321910:0:13234:0:(genops.c:1557:class_disconnect_exports()) OBD device 2 (ffff8cb8c59599c0) has no exports 10000000:01000000:1.0:1789049550.321926:0:5848:0:(mgc_request.c:708:mgc_requeue_thread()) Ending requeue thread 10000000:01000000:1.0:1789049550.321984:0:13234:0:(obd_class.h:676:obd_cleanup_client_import()) MGC192.168.206.126@tcp: client import never connected 00000100:00080000:1.0:1789049550.321987:0:13234:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 10000000:01000000:1.0:1789049550.321989:0:13234:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:1.0:1789049550.321991:0:13234:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 10000000:01000000:1.0:1789049550.321993:0:13234:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:1.0:1789049550.322020:0:13234:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1789049550.322024:0:13234:0:(obd_config.c:883:class_detach()) detach on obd MGC192.168.206.126@tcp (uuid 7ef694ec-1ea0-4f02-800c-d1279b4fdf12) 00000020:01000000:1.0:1789049550.322029:0:13234:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0001 (flags='F') 00000020:00000080:1.0:1789049550.322032:0:13234:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1789049550.322035:0:13234:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-OST0001: forcing exports to disconnect: 1/3 00000020:00080000:1.0:1789049550.322039:0:13234:0:(genops.c:1818:print_export_data()) lustre-MDT0000-lwp-OST0001: ACTIVE ffff8cb7c4c42800 lustre-MDT0000-lwp-OST0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1789049550.322044:0:13234:0:(genops.c:1552:class_disconnect_exports()) OBD device 16 (ffff8cb8c7c6b380) has exports, disconnecting them 00000020:00080000:1.0:1789049550.322048:0:13234:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0001: disconnecting export at 0@lo (ffff8cb7c4c42800), last request at 1789049359 00000020:00000080:1.0:1789049550.322052:0:13234:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xf4f48ce5e1bbec9d 00000020:00080000:1.0:1789049550.322062:0:13234:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff8cb7c4c42800): rc 0 00000020:00000080:1.0:1789049550.322066:0:13234:0:(genops.c:885:class_export_put()) final put ffff8cb7c4c42800/lustre-MDT0000-lwp-OST0001 00000020:00000080:3.0:1789049550.322224:0:12636:0:(genops.c:844:class_export_destroy()) destroying export ffff8cb8c8067000/7ef694ec-1ea0-4f02-800c-d1279b4fdf12 for MGC192.168.206.126@tcp 00000020:00000080:3.0:1789049550.322235:0:12636:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8cb8c62b9000 for MGC192.168.206.126@tcp 00000020:00000080:3.0:1789049550.322240:0:12636:0:(genops.c:885:class_export_put()) final put ffff8cb8c62bf000/7ef694ec-1ea0-4f02-800c-d1279b4fdf12 00000020:00000080:3.0:1789049550.322242:0:12636:0:(genops.c:844:class_export_destroy()) destroying export ffff8cb8c62bf000/7ef694ec-1ea0-4f02-800c-d1279b4fdf12 for MGC192.168.206.126@tcp 00000020:01000000:3.0:1789049550.322246:0:12636:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGC192.168.206.126@tcp (7ef694ec-1ea0-4f02-800c-d1279b4fdf12) 00000020:00000080:3.0:1789049550.322484:0:12636:0:(genops.c:844:class_export_destroy()) destroying export ffff8cb7c4c42800/lustre-MDT0000-lwp-OST0001 for lustre-MDT0000-lwp-OST0001 00010000:01000000:2.0:1789049550.324565:0:13234:0:(obd_class.h:676:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0001: client import never connected 00000100:00080000:2.0:1789049550.324572:0:13234:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1789049550.324575:0:13234:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 5 00000100:00100000:2.0:1789049550.324582:0:13234:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:2.0:1789049550.324651:0:5838:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-1 blwis in pool) 00000020:00000080:3.0:1789049550.324788:0:12636:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8cb8f7b30800 for lustre-MDT0000-lwp-OST0001 00010000:00010000:1.0:1789049550.357421:0:5839:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-2 blwis in pool) 00010000:00010000:3.0:1789049550.357564:0:6719:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-3 blwis in pool) 00000100:00100000:3.0:1789049550.357726:0:5834:0:(service.c:3188:ptlrpc_main()) ldlm_cb00_001: service thread [ffff8cb8d6dae200:5834] 1 exiting: rc = 0 00000100:00100000:0.0:1789049550.357920:0:6718:0:(service.c:3188:ptlrpc_main()) ldlm_cb00_002: service thread [ffff8cb7c4527e00:6718] 2 exiting: rc = 0 00000100:00100000:1.0:1789049550.358249:0:5833:0:(service.c:3188:ptlrpc_main()) ldlm_cb00_000: service thread [ffff8cb8c6119400:5833] 0 exiting: rc = 1 00000100:00100000:2.0:1789049550.358404:0:13234:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789049550.358644:0:5836:0:(service.c:3188:ptlrpc_main()) ldlm_cn00_001: service thread [ffff8cb8c7c01a00:5836] 1 exiting: rc = 0 00000100:00100000:3.0:1789049550.358736:0:6720:0:(service.c:3188:ptlrpc_main()) ldlm_cn00_003: service thread [ffff8cb8d10fb200:6720] 3 exiting: rc = 0 00000100:00100000:0.0:1789049550.359278:0:5835:0:(service.c:3188:ptlrpc_main()) ldlm_cn00_000: service thread [ffff8cb8c310d000:5835] 0 exiting: rc = 1 00000100:00100000:0.0:1789049550.359334:0:5837:0:(service.c:3188:ptlrpc_main()) ldlm_cn00_002: service thread [ffff8cb8c7cf4800:5837] 2 exiting: rc = 0 00000100:00100000:3.0:1789049550.359475:0:13234:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789049550.359493:0:13234:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789049550.359499:0:13234:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789049550.359504:0:13234:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789049550.359510:0:13234:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789049550.359516:0:13234:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789049550.359521:0:13234:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789049550.359527:0:13234:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789049550.359533:0:13234:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789049550.359538:0:13234:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789049550.359543:0:13234:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789049550.359549:0:13234:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789049550.359553:0:13234:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789049550.359561:0:13234:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789049550.359567:0:13234:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789049550.359572:0:13234:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789049550.359579:0:13234:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789049550.359585:0:13234:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789049550.359601:0:13234:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789049550.359606:0:13234:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789049550.359610:0:13234:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789049550.359616:0:13234:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789049550.359622:0:13234:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789049550.359637:0:13234:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789049550.359641:0:13234:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789049550.359646:0:13234:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789049550.359650:0:13234:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789049550.359655:0:13234:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789049550.359659:0:13234:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789049550.359664:0:13234:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789049550.359669:0:13234:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789049550.359674:0:13234:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789049550.359678:0:13234:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789049550.359683:0:13234:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789049550.359688:0:13234:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789049550.359692:0:13234:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789049550.359697:0:13234:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789049550.359703:0:13234:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789049550.359708:0:13234:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789049550.359712:0:13234:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789049550.359717:0:13234:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789049550.359722:0:13234:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789049550.359727:0:13234:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789049550.359732:0:13234:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789049550.359736:0:13234:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789049550.359741:0:13234:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789049550.359745:0:13234:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789049550.359750:0:13234:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789049550.359754:0:13234:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789049550.359759:0:13234:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789049550.359764:0:13234:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789049550.359769:0:13234:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789049550.359775:0:13234:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789049550.359787:0:13234:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789049550.359791:0:13234:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789049550.359797:0:13234:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789049550.359802:0:13234:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789049550.359807:0:13234:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789049550.359812:0:13234:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789049550.359817:0:13234:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789049550.359821:0:13234:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789049550.359826:0:13234:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789049550.359831:0:13234:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789049550.359837:0:13234:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:2.0:1789049550.362997:0:13234:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1789049550.363009:0:13234:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000020:00000080:2.0:1789049550.363016:0:13234:0:(genops.c:885:class_export_put()) final put ffff8cb8f7b32800/lustre-MDT0000-lwp-OST0001_UUID 00000020:00000080:2.0:1789049550.363020:0:13234:0:(genops.c:844:class_export_destroy()) destroying export ffff8cb8f7b32800/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000-lwp-OST0001 00000020:01000000:2.0:1789049550.363027:0:13234:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0001 (lustre-MDT0000-lwp-OST0001_UUID) 00000020:01000004:2.0:1789049550.363072:0:13234:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8cb8c631b800 1 00000020:00000080:2.0:1789049550.363078:0:13234:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xf4f48ce5e1bbec42 00000020:00000080:2.0:1789049550.363085:0:13234:0:(genops.c:885:class_export_put()) final put ffff8cb8c6319800/lustre-OST0001-osd_UUID 00000020:01000000:2.0:1789049550.369349:0:13234:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osd (flags='') 00000020:00000080:3.0:1789049550.369883:0:12636:0:(genops.c:844:class_export_destroy()) destroying export ffff8cb8c6319800/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:00000080:3.0:1789049550.369904:0:13234:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1789049550.369912:0:13234:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osd: forcing exports to disconnect: 0/1 00000020:00080000:3.0:1789049550.369916:0:13234:0:(genops.c:1557:class_disconnect_exports()) OBD device 14 (ffff8cb8c7c68000) has no exports 00000020:00000080:2.0:1789049550.392542:0:13234:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1789049550.392554:0:13234:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00000020:00000080:2.0:1789049550.392559:0:13234:0:(genops.c:885:class_export_put()) final put ffff8cb8c631d000/lustre-OST0001-osd_UUID 00000020:00000080:2.0:1789049550.392564:0:13234:0:(genops.c:844:class_export_destroy()) destroying export ffff8cb8c631d000/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:01000000:2.0:1789049550.392574:0:13234:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osd (lustre-OST0001-osd_UUID) 00000020:01000004:2.0:1789049550.392760:0:13234:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff8cb8c631d800 00000020:01000000:2.0:1789049550.392778:0:13234:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of OSS (flags='F') 00000020:00000080:2.0:1789049550.392783:0:13234:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1789049550.392787:0:13234:0:(obd_config.c:956:class_cleanup()) OSS: forcing exports to disconnect: 0/1 00000020:00080000:2.0:1789049550.392791:0:13234:0:(genops.c:1557:class_disconnect_exports()) OBD device 10 (ffff8cb8fcbc19c0) has no exports 00000020:00000080:2.0:1789049550.392814:0:13234:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1789049550.392819:0:13234:0:(obd_config.c:883:class_detach()) detach on obd OSS (uuid OSS_uuid) 00000020:00000080:2.0:1789049550.392830:0:13234:0:(genops.c:885:class_export_put()) final put ffff8cb8c7ce5800/OSS_uuid 00000020:00000080:2.0:1789049550.392832:0:13234:0:(genops.c:844:class_export_destroy()) destroying export ffff8cb8c7ce5800/OSS_uuid for OSS 00000020:01000000:2.0:1789049550.392836:0:13234:0:(genops.c:441:class_free_dev()) finishing cleanup of obd OSS (OSS_uuid) 00000100:00080000:1.0:1789049550.392891:0:5846:0:(pinger.c:548:ping_evictor_main()) Exiting Ping Evictor 00000100:00100000:2.0:1789049550.392923:0:6703:0:(service.c:3188:ptlrpc_main()) ll_ost00_000: service thread [ffff8cb8d1152800:6703] 0 exiting: rc = 1 00000100:00100000:0.0:1789049550.394795:0:6704:0:(service.c:3188:ptlrpc_main()) ll_ost00_001: service thread [ffff8cb8d10d0600:6704] 1 exiting: rc = 0 00000100:00100000:3.0:1789049550.395289:0:10560:0:(service.c:3188:ptlrpc_main()) ll_ost00_003: service thread [ffff8cb8df42c600:10560] 3 exiting: rc = 0 00000100:00100000:1.0:1789049550.399515:0:12489:0:(service.c:3188:ptlrpc_main()) ll_ost00_004: service thread [ffff8cb8c6396e00:12489] 4 exiting: rc = 0 00000100:00100000:1.0:1789049550.399596:0:6705:0:(service.c:3188:ptlrpc_main()) ll_ost00_002: service thread [ffff8cb8d10d1800:6705] 2 exiting: rc = 0 00000100:00100000:2.0:1789049550.399713:0:13234:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789049550.399721:0:13234:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789049550.399728:0:13234:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789049550.399734:0:13234:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789049550.399739:0:13234:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789049550.399745:0:13234:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789049550.399750:0:13234:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789049550.399755:0:13234:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789049550.399760:0:13234:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789049550.399766:0:13234:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789049550.399771:0:13234:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789049550.399776:0:13234:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789049550.399782:0:13234:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789049550.399788:0:13234:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789049550.399793:0:13234:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789049550.399798:0:13234:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789049550.399803:0:13234:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789049550.399808:0:13234:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789049550.399813:0:13234:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789049550.399819:0:13234:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789049550.399823:0:13234:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789049550.399829:0:13234:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789049550.399834:0:13234:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789049550.399840:0:13234:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789049550.399957:0:13234:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789049550.399962:0:13234:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789049550.399967:0:13234:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789049550.400126:0:13234:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789049550.400137:0:13234:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789049550.400142:0:13234:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789049550.400148:0:13234:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789049550.400163:0:13234:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789049550.400168:0:13234:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789049550.400174:0:13234:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789049550.400181:0:13234:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789049550.400255:0:13234:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789049550.400265:0:13234:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789049550.400271:0:13234:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789049550.400277:0:13234:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789049550.400282:0:13234:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789049550.400287:0:13234:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789049550.400292:0:13234:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789049550.400308:0:13234:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789049550.400312:0:13234:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789049550.400318:0:13234:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789049550.400324:0:13234:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789049550.400329:0:13234:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789049550.400335:0:13234:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789049550.400341:0:13234:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789049550.400346:0:13234:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789049550.400351:0:13234:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789049550.400356:0:13234:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789049550.400362:0:13234:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789049550.400367:0:13234:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789049550.400373:0:13234:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789049550.400378:0:13234:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789049550.400383:0:13234:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789049550.400388:0:13234:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789049550.400393:0:13234:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789049550.400399:0:13234:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789049550.400404:0:13234:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789049550.400410:0:13234:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789049550.400414:0:13234:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789049550.400420:0:13234:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789049550.404206:0:6706:0:(service.c:3188:ptlrpc_main()) ll_ost_create00_000: service thread [ffff8cb8d10d1600:6706] 0 exiting: rc = 1 00000100:00100000:1.0:1789049550.404285:0:6707:0:(service.c:3188:ptlrpc_main()) ll_ost_create00_001: service thread [ffff8cb8d10d0e00:6707] 1 exiting: rc = 0 00000100:00100000:1.0:1789049550.404341:0:13234:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789049550.404351:0:13234:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789049550.404355:0:13234:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789049550.404361:0:13234:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789049550.404366:0:13234:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789049550.404371:0:13234:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789049550.404376:0:13234:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789049550.404381:0:13234:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789049550.404386:0:13234:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789049550.404391:0:13234:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789049550.404396:0:13234:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789049550.404401:0:13234:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789049550.404405:0:13234:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789049550.404410:0:13234:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789049550.404414:0:13234:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789049550.404419:0:13234:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789049550.404424:0:13234:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789049550.404430:0:13234:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789049550.404435:0:13234:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789049550.404440:0:13234:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789049550.404445:0:13234:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789049550.404450:0:13234:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789049550.404455:0:13234:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789049550.404460:0:13234:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789049550.404465:0:13234:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789049550.404470:0:13234:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789049550.404475:0:13234:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789049550.404480:0:13234:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789049550.404486:0:13234:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789049550.404491:0:13234:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789049550.404496:0:13234:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789049550.404501:0:13234:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789049550.404518:0:13234:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789049550.404523:0:13234:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789049550.404528:0:13234:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789049550.404533:0:13234:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789049550.404538:0:13234:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789049550.404542:0:13234:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789049550.404547:0:13234:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789049550.404552:0:13234:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789049550.404557:0:13234:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789049550.404562:0:13234:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789049550.404566:0:13234:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789049550.404572:0:13234:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789049550.404577:0:13234:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789049550.404582:0:13234:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789049550.404586:0:13234:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789049550.404591:0:13234:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789049550.404596:0:13234:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789049550.404601:0:13234:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789049550.404606:0:13234:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789049550.404612:0:13234:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789049550.404617:0:13234:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789049550.404621:0:13234:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789049550.404636:0:13234:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789049550.404642:0:13234:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789049550.404647:0:13234:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789049550.404652:0:13234:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789049550.404656:0:13234:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789049550.404660:0:13234:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789049550.404665:0:13234:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789049550.404669:0:13234:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789049550.404675:0:13234:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789049550.404680:0:13234:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789049550.405406:0:6708:0:(service.c:3188:ptlrpc_main()) ll_ost_io00_000: service thread [ffff8cb8d6bfec00:6708] 0 exiting: rc = 1 00000100:00100000:1.0:1789049550.405546:0:6710:0:(service.c:3188:ptlrpc_main()) ll_ost_io00_002: service thread [ffff8cb8f73bca00:6710] 2 exiting: rc = 0 00000100:00100000:0.0:1789049550.406714:0:6709:0:(service.c:3188:ptlrpc_main()) ll_ost_io00_001: service thread [ffff8cb8d6bfc400:6709] 1 exiting: rc = 0 00000100:00100000:1.0:1789049550.406781:0:13234:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789049550.406797:0:13234:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789049550.406809:0:13234:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789049550.406815:0:13234:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789049550.406875:0:13234:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789049550.406882:0:13234:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789049550.406888:0:13234:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789049550.406894:0:13234:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789049550.406899:0:13234:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789049550.406905:0:13234:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789049550.406910:0:13234:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789049550.406916:0:13234:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789049550.406922:0:13234:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789049550.406927:0:13234:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789049550.406932:0:13234:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789049550.406938:0:13234:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789049550.406944:0:13234:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789049550.406950:0:13234:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789049550.406955:0:13234:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789049550.406961:0:13234:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789049550.407151:0:13234:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789049550.407159:0:13234:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789049550.407164:0:13234:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789049550.407169:0:13234:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789049550.407175:0:13234:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789049550.407180:0:13234:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789049550.407186:0:13234:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789049550.407192:0:13234:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789049550.407197:0:13234:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789049550.407202:0:13234:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789049550.407207:0:13234:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789049550.407212:0:13234:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789049550.407218:0:13234:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789049550.407224:0:13234:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789049550.407229:0:13234:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789049550.407235:0:13234:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789049550.407250:0:13234:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789049550.407255:0:13234:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789049550.407260:0:13234:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789049550.407266:0:13234:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789049550.407271:0:13234:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789049550.407277:0:13234:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789049550.407283:0:13234:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789049550.407288:0:13234:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789049550.407308:0:13234:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789049550.407316:0:13234:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789049550.407321:0:13234:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789049550.407326:0:13234:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789049550.407332:0:13234:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789049550.407337:0:13234:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789049550.407343:0:13234:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789049550.407349:0:13234:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789049550.407354:0:13234:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789049550.407360:0:13234:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789049550.407366:0:13234:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789049550.407371:0:13234:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789049550.407377:0:13234:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789049550.407382:0:13234:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789049550.407388:0:13234:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789049550.407393:0:13234:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789049550.407399:0:13234:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789049550.407405:0:13234:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789049550.407410:0:13234:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789049550.407417:0:13234:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789049550.424165:0:6712:0:(service.c:3188:ptlrpc_main()) ll_ost_seq00_001: service thread [ffff8cb8d10d0200:6712] 1 exiting: rc = 0 00000100:00100000:2.0:1789049550.424227:0:6711:0:(service.c:3188:ptlrpc_main()) ll_ost_seq00_000: service thread [ffff8cb8c6394400:6711] 0 exiting: rc = 1 00000100:00100000:0.0:1789049550.424350:0:13234:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789049550.424358:0:13234:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789049550.424363:0:13234:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789049550.424369:0:13234:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789049550.424374:0:13234:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789049550.424379:0:13234:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789049550.424385:0:13234:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789049550.424389:0:13234:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789049550.424394:0:13234:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789049550.424399:0:13234:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789049550.424405:0:13234:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789049550.424410:0:13234:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789049550.424415:0:13234:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789049550.424420:0:13234:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789049550.424425:0:13234:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789049550.424430:0:13234:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789049550.424435:0:13234:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789049550.424440:0:13234:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789049550.424445:0:13234:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789049550.424449:0:13234:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789049550.424454:0:13234:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789049550.424459:0:13234:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789049550.424464:0:13234:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789049550.424488:0:13234:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789049550.424494:0:13234:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789049550.424499:0:13234:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789049550.424515:0:13234:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789049550.424522:0:13234:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789049550.424528:0:13234:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789049550.424534:0:13234:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789049550.424539:0:13234:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789049550.424545:0:13234:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789049550.424550:0:13234:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789049550.424555:0:13234:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789049550.424560:0:13234:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789049550.424565:0:13234:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789049550.424569:0:13234:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789049550.424574:0:13234:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789049550.424580:0:13234:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789049550.424585:0:13234:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789049550.424591:0:13234:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789049550.424596:0:13234:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789049550.424602:0:13234:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789049550.424608:0:13234:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789049550.424613:0:13234:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789049550.424618:0:13234:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789049550.424634:0:13234:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789049550.424641:0:13234:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789049550.424646:0:13234:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789049550.424651:0:13234:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789049550.424657:0:13234:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789049550.424665:0:13234:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789049550.424671:0:13234:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789049550.424677:0:13234:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789049550.424682:0:13234:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789049550.424688:0:13234:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789049550.424693:0:13234:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789049550.424698:0:13234:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789049550.424711:0:13234:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789049550.424717:0:13234:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789049550.424721:0:13234:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789049550.424726:0:13234:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789049550.424731:0:13234:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789049550.424736:0:13234:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789049550.428111:0:6714:0:(service.c:3188:ptlrpc_main()) ll_ost_out00_001: service thread [ffff8cb7c4527600:6714] 1 exiting: rc = 0 00000100:00100000:1.0:1789049550.428118:0:6713:0:(service.c:3188:ptlrpc_main()) ll_ost_out00_000: service thread [ffff8cb8d6bff200:6713] 0 exiting: rc = 1 00000100:00100000:2.0:1789049550.428222:0:13234:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789049550.428248:0:13234:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789049550.428255:0:13234:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789049550.428261:0:13234:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789049550.428266:0:13234:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789049550.428273:0:13234:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789049550.428279:0:13234:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789049550.428284:0:13234:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789049550.428291:0:13234:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789049550.428310:0:13234:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789049550.428317:0:13234:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789049550.428323:0:13234:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789049550.428329:0:13234:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789049550.428338:0:13234:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789049550.428358:0:13234:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789049550.428364:0:13234:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789049550.428370:0:13234:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789049550.428375:0:13234:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789049550.428380:0:13234:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789049550.428386:0:13234:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789049550.428391:0:13234:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789049550.428397:0:13234:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789049550.428402:0:13234:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789049550.428409:0:13234:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789049550.428414:0:13234:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789049550.428420:0:13234:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789049550.428439:0:13234:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789049550.428446:0:13234:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789049550.428452:0:13234:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789049550.428457:0:13234:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789049550.428463:0:13234:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789049550.428469:0:13234:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789049550.428474:0:13234:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789049550.428480:0:13234:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789049550.428486:0:13234:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789049550.428491:0:13234:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789049550.428504:0:13234:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789049550.428509:0:13234:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789049550.428528:0:13234:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789049550.428535:0:13234:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789049550.428540:0:13234:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789049550.428546:0:13234:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789049550.428552:0:13234:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789049550.428557:0:13234:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789049550.428563:0:13234:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789049550.428568:0:13234:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789049550.428574:0:13234:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789049550.428579:0:13234:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789049550.428585:0:13234:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789049550.428592:0:13234:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789049550.428610:0:13234:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789049550.428617:0:13234:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789049550.428622:0:13234:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789049550.428638:0:13234:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789049550.428644:0:13234:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789049550.428649:0:13234:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789049550.428656:0:13234:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789049550.428662:0:13234:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789049550.428668:0:13234:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789049550.428674:0:13234:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789049550.428679:0:13234:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789049550.428685:0:13234:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789049550.428691:0:13234:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789049550.428704:0:13234:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:02000400:3.0:1789049550.439514:0:13234:0:(tgt_mount.c:2180:server_put_super()) server umount lustre-OST0001 complete 00000001:02000400:3.0:1789049568.463090:0:13850:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg626-server.virtnet: executing load_modules_local 00000020:01000004:2.0:1789049577.473627:0:14310:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:2.0:1789049577.473632:0:14310:0:(obd_mount.c:926:lmd_print()) device: lustre-mdt1/mdt1 00000080:01200004:2.0:1789049577.473743:0:14310:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff8cb8d1a86000 00000020:01000004:2.0:1789049577.473758:0:14310:0:(tgt_mount.c:2502:osd_start()) Attempting to start lustre-MDT0000, type=osd-zfs, lsifl=200005, mountfl=0 00000020:01000004:2.0:1789049577.473767:0:14310:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-zfs) 00000020:00000080:2.0:1789049577.473781:0:14310:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (ffff8cb900bacd40) 00000020:00000080:2.0:1789049577.473792:0:14310:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-zfs with refcount 2 00100000:10000000:3.0:1789049577.499252:0:14310:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000001:0x3:0x0] (8/24) 00100000:10000000:3.0:1789049577.503446:0:14310:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000003:0x11:0x0] (8/32) 00100000:10000000:3.0:1789049577.504247:0:14310:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-MDT0000 under 579: rc = 0 00100000:10000000:3.0:1789049577.504385:0:14310:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-OST0001 under 579: rc = 0 00100000:10000000:3.0:1789049577.504576:0:14310:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000003:0x3:0x0] (8/32) 00100000:10000000:3.0:1789049577.504810:0:14310:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled nodemap under 579: rc = 0 00100000:10000000:3.0:1789049577.504960:0:14310:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-OST0000 under 579: rc = 0 00100000:10000000:3.0:1789049577.505073:0:14310:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled params under 579: rc = 0 00100000:10000000:3.0:1789049577.505175:0:14310:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-client under 579: rc = 0 00100000:10000000:3.0:1789049577.505392:0:14310:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre under 581: rc = 0 00100000:10000000:3.0:1789049577.506328:0:14310:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled dt-0x0 under 7: rc = 0 00100000:10000000:3.0:1789049577.506414:0:14310:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled md-0x0 under 7: rc = 0 00100000:10000000:3.0:1789049577.507409:0:14310:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2020000-MDT0000 under 397: rc = 0 00100000:10000000:3.0:1789049577.507692:0:14310:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2010000 under 397: rc = 0 00100000:10000000:3.0:1789049577.507965:0:14310:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1010000 under 397: rc = 0 00100000:10000000:3.0:1789049577.508211:0:14310:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x10000-MDT0000 under 397: rc = 0 00100000:10000000:3.0:1789049577.508486:0:14310:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1010000-MDT0000 under 397: rc = 0 00100000:10000000:3.0:1789049577.508724:0:14310:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x20000 under 397: rc = 0 00100000:10000000:3.0:1789049577.509003:0:14310:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x10000 under 397: rc = 0 00100000:10000000:3.0:1789049577.509258:0:14310:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1020000-MDT0000 under 397: rc = 0 00100000:10000000:3.0:1789049577.509509:0:14310:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x20000-MDT0000 under 397: rc = 0 00100000:10000000:3.0:1789049577.509749:0:14310:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1020000 under 397: rc = 0 00100000:10000000:3.0:1789049577.510645:0:14310:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2020000 under 397: rc = 0 00100000:10000000:3.0:1789049577.511675:0:14310:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2010000-MDT0000 under 397: rc = 0 00100000:10000000:3.0:1789049577.512443:0:14310:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_00 under 20: rc = 0 00100000:10000000:3.0:1789049577.512773:0:14310:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_02 under 20: rc = 0 00100000:10000000:3.0:1789049577.513220:0:14310:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_08 under 20: rc = 0 00100000:10000000:3.0:1789049577.513459:0:14310:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_13 under 20: rc = 0 00100000:10000000:3.0:1789049577.513796:0:14310:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_11 under 20: rc = 0 00100000:10000000:3.0:1789049577.514690:0:14310:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_14 under 20: rc = 0 00100000:10000000:3.0:1789049577.514960:0:14310:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_05 under 20: rc = 0 00100000:10000000:3.0:1789049577.515328:0:14310:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_07 under 20: rc = 0 00100000:10000000:3.0:1789049577.515647:0:14310:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_09 under 20: rc = 0 00100000:10000000:3.0:1789049577.516344:0:14310:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_03 under 20: rc = 0 00100000:10000000:3.0:1789049577.517068:0:14310:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_01 under 20: rc = 0 00100000:10000000:3.0:1789049577.517321:0:14310:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_10 under 20: rc = 0 00100000:10000000:3.0:1789049577.517634:0:14310:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_12 under 20: rc = 0 00100000:10000000:3.0:1789049577.517918:0:14310:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_15 under 20: rc = 0 00100000:10000000:3.0:1789049577.518262:0:14310:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_06 under 20: rc = 0 00100000:10000000:3.0:1789049577.518530:0:14310:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_04 under 20: rc = 0 00100000:10000000:3.0:1789049577.518786:0:14310:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_04 under 20: rc = 0 00100000:10000000:3.0:1789049577.519069:0:14310:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_06 under 20: rc = 0 00100000:10000000:3.0:1789049577.519311:0:14310:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_15 under 20: rc = 0 00100000:10000000:3.0:1789049577.519753:0:14310:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_12 under 20: rc = 0 00100000:10000000:3.0:1789049577.520234:0:14310:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_10 under 20: rc = 0 00100000:10000000:3.0:1789049577.520521:0:14310:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_01 under 20: rc = 0 00100000:10000000:3.0:1789049577.520776:0:14310:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_09 under 20: rc = 0 00100000:10000000:3.0:1789049577.521519:0:14310:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_03 under 20: rc = 0 00100000:10000000:3.0:1789049577.521836:0:14310:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_07 under 20: rc = 0 00100000:10000000:3.0:1789049577.523257:0:14310:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_05 under 20: rc = 0 00100000:10000000:3.0:1789049577.523541:0:14310:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_14 under 20: rc = 0 00100000:10000000:3.0:1789049577.524661:0:14310:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_11 under 20: rc = 0 00100000:10000000:3.0:1789049577.525619:0:14310:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_13 under 20: rc = 0 00100000:10000000:3.0:1789049577.525911:0:14310:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_02 under 20: rc = 0 00100000:10000000:3.0:1789049577.526263:0:14310:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_08 under 20: rc = 0 00100000:10000000:3.0:1789049577.526522:0:14310:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_00 under 20: rc = 0 00100000:10000000:3.0:1789049577.526914:0:14310:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled [0x200000400:0x1:0x0] under 770: rc = 0 00100000:10000000:3.0:1789049577.528131:0:14310:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x20000:0x0] (8/32) 00100000:10000000:3.0:1789049577.528304:0:14310:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x20000 under 394: rc = 0 00100000:10000000:3.0:1789049577.528505:0:14310:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x1020000:0x0] (8/32) 00100000:10000000:3.0:1789049577.528693:0:14310:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1020000 under 394: rc = 0 00100000:10000000:3.0:1789049577.529239:0:14310:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x2020000:0x0] (8/32) 00100000:10000000:3.0:1789049577.529311:0:14310:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2020000 under 394: rc = 0 00100000:10000000:3.0:1789049577.529798:0:14310:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x10000:0x0] (8/32) 00100000:10000000:3.0:1789049577.529890:0:14310:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x10000 under 8: rc = 0 00100000:10000000:3.0:1789049577.530221:0:14310:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x2010000:0x0] (8/32) 00100000:10000000:3.0:1789049577.530290:0:14310:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2010000 under 8: rc = 0 00100000:10000000:3.0:1789049577.530491:0:14310:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x1010000:0x0] (8/32) 00100000:10000000:3.0:1789049577.532506:0:14310:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1010000 under 8: rc = 0 00000020:00000080:3.0:1789049577.534397:0:14310:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:3.0:1789049577.534406:0:14310:0:(osd_handler.c:1574:osd_obd_connect()) connect #0 00000020:00000080:3.0:1789049577.534416:0:14310:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xf4f48ce5e1bbfd59 00000020:01000004:3.0:1789049577.534423:0:14310:0:(tgt_mount.c:2587:server_fill_super()) Found service lustre-MDT0000 on device lustre-mdt1/mdt1 00000020:01000000:3.0:1789049577.534428:0:14310:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:3.0:1789049577.534432:0:14310:0:(tgt_mount.c:101:server_register_mount()) register mount ffff8cb8d1a86000 from MGS 00000020:01000004:3.0:1789049577.534436:0:14310:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:3.0:1789049577.534446:0:14310:0:(genops.c:413:class_newdev()) Allocate new device MGS (ffff8cb8c7c68000) 00000020:00000080:3.0:1789049577.534456:0:14310:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:3.0:1789049577.534521:0:14310:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8cb8d1a86000 from MGS, refs=2 00080000:01000000:3.0:1789049577.534526:0:14310:0:(osd_handler.c:1574:osd_obd_connect()) connect #1 00000020:00000080:3.0:1789049577.534530:0:14310:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xf4f48ce5e1bbfd67 00000100:00100000:3.0:1789049577.534772:0:14310:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/1 left), rc = 0 00000100:00100000:3.0:1789049577.534919:0:14310:0:(service.c:3467:ptlrpc_start_thread()) ldlm_cbd[0] started 0 min 2 max 56 00000100:00100000:3.0:1789049577.534927:0:14310:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cb00_000' 00000100:00100000:3.0:1789049577.536049:0:14310:0:(service.c:3467:ptlrpc_start_thread()) ldlm_cbd[0] started 1 min 2 max 56 00000100:00100000:3.0:1789049577.536058:0:14310:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cb00_001' 00000100:00100000:3.0:1789049577.541532:0:14310:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1789049577.541719:0:14310:0:(service.c:3467:ptlrpc_start_thread()) ldlm_canceld[0] started 0 min 3 max 56 00000100:00100000:3.0:1789049577.541726:0:14310:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cn00_000' 00000100:00100000:3.0:1789049577.543532:0:14310:0:(service.c:3467:ptlrpc_start_thread()) ldlm_canceld[0] started 1 min 3 max 56 00000100:00100000:3.0:1789049577.543542:0:14310:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cn00_001' 00000100:00100000:3.0:1789049577.544310:0:14310:0:(service.c:3467:ptlrpc_start_thread()) ldlm_canceld[0] started 2 min 3 max 56 00000100:00100000:3.0:1789049577.544318:0:14310:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cn00_002' 00010000:00010000:0.0:1789049577.546893:0:14316:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789049577.546898:0:14316:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789049577.546900:0:14316:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789049577.547341:0:14317:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789049577.547344:0:14317:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789049577.547346:0:14317:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789049577.549223:0:14310:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGS-0 is initialized 00010000:00010000:0.0:1789049577.552519:0:14316:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:01000000:3.0:1789049577.563344:0:14310:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 20000000:01000000:3.0:1789049577.563368:0:14310:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:3.0:1789049577.563371:0:14310:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 10000000:01000000:3.0:1789049577.568990:0:14319:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:2.0:1789049577.570601:0:14310:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:2.0:1789049577.570714:0:14310:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:2.0:1789049577.571234:0:14310:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:2.0:1789049577.571527:0:14310:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1789049577.571675:0:14310:0:(service.c:3467:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:2.0:1789049577.571681:0:14310:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:2.0:1789049577.574423:0:14310:0:(service.c:3467:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:2.0:1789049577.574437:0:14310:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:3.0:1789049577.577001:0:14310:0:(service.c:3467:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:3.0:1789049577.577015:0:14310:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000100:00080000:2.0:1789049577.581024:0:14324:0:(pinger.c:466:ping_evictor_main()) Starting Ping Evictor 00000020:00000080:2.0:1789049577.581183:0:14310:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:2.0:1789049577.581203:0:14310:0:(obd_mount.c:411:lustre_start_mgc()) Start MGC 'MGC192.168.206.126@tcp' 00000020:01000004:2.0:1789049577.581205:0:14310:0:(obd_mount.c:420:lustre_start_mgc()) mgs NIDs (null). 00000020:01000004:2.0:1789049577.581235:0:14310:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGC192.168.206.126@tcp (typ=mgc) 00000020:00000080:2.0:1789049577.581247:0:14310:0:(genops.c:413:class_newdev()) Allocate new device MGC192.168.206.126@tcp (ffff8cb900ba8000) 00000020:00000080:2.0:1789049577.581262:0:14310:0:(obd_config.c:720:class_attach_name()) OBD: dev 2 attached type mgc with refcount 2 00010000:00080000:2.0:1789049577.581349:0:14310:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8cb8d0abd800@MGC192.168.206.126@tcp: add connection 192.168.206.126@tcp at head 00010000:00010000:2.0:1789049577.581511:0:14310:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGC192.168.206.126@tcp-0 is initialized 00000040:01000000:2.0:1789049577.581517:0:14310:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.206.126@tcp ctxt 1 is initialized 10000000:01000000:3.0:1789049577.583985:0:14325:0:(mgc_request.c:631:mgc_requeue_thread()) Starting requeue thread 00000020:00000080:2.0:1789049577.584638:0:14310:0:(obd_config.c:826:class_setup()) finished setup of obd MGC192.168.206.126@tcp (uuid 817823bd-3ba1-432d-9714-f03a15bff403) 00000020:00000080:2.0:1789049577.584662:0:14310:0:(genops.c:1384:class_connect()) connect: client 817823bd-3ba1-432d-9714-f03a15bff403, cookie 0xf4f48ce5e1bbfd75 00000100:00080000:2.0:1789049577.584674:0:14310:0:(import.c:545:import_select_connection()) MGC192.168.206.126@tcp: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1789049577.584686:0:14310:0:(import.c:666:import_select_connection()) MGC192.168.206.126@tcp: import ffff8cb8d0abd800 using connection 192.168.206.126@tcp/0@lo 00000100:00100000:2.0:1789049577.584723:0:14310:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8cb900e96680 x1875954110645632/t0(0) o250->MGC192.168.206.126@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1789049577.584755:0:14310:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import 817823bd-3ba1-432d-9714-f03a15bff403->MGS 00000100:00100000:3.0:1789049577.584811:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb900e96680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:817823bd-3ba1-432d-9714-f03a15bff403:3307:1875954110645632:0@lo:250:mount.lustre.0 00000100:00100000:3.0:1789049577.584901:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789049577.584959:0:14321:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954110645632 00000100:00100000:3.0:1789049577.584967:0:14321:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954110645632 00000100:00100000:3.0:1789049577.585001:0:14321:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1789049577.585008:0:14321:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8f73fa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3307:x1875954110645632:12345-0@lo:250:mount.lustre.0 00010000:00080000:3.0:1789049577.585042:0:14321:0:(ldlm_lib.c:1453:target_handle_connect()) MGS: connection from 817823bd-3ba1-432d-9714-f03a15bff403@0@lo t0 exp 0000000000000000 cur 403 last 0 00000020:00000080:3.0:1789049577.585065:0:14321:0:(genops.c:1384:class_connect()) connect: client 817823bd-3ba1-432d-9714-f03a15bff403, cookie 0xf4f48ce5e1bbfd7c 00000100:00080000:3.0:1789049577.585192:0:14321:0:(import.c:65:import_set_state_nolock()) ffff8cb900e70000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1789049577.585239:0:14321:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8f73fa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:817823bd-3ba1-432d-9714-f03a15bff403+5:3307:x1875954110645632:12345-0@lo:250:mount.lustre.0 Request processed in 230us (338us total) trans 0 rc 0/0 00000100:00100000:3.0:1789049577.585246:0:14321:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1789049577.585284:0:3307:0:(client.c:3126:ptlrpc_free_committed()) MGC192.168.206.126@tcp: committing for last_committed 0 gen 1 00000100:00080000:3.0:1789049577.585293:0:3307:0:(import.c:1177:ptlrpc_connect_interpret()) MGC192.168.206.126@tcp: connect to target with instance 0 00000100:00080000:3.0:1789049577.585299:0:3307:0:(import.c:1001:ptlrpc_connect_set_flags()) MGC192.168.206.126@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:3.0:1789049577.585303:0:3307:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:3.0:1789049577.585307:0:3307:0:(import.c:65:import_set_state_nolock()) ffff8cb8d0abd800 MGS: changing import state from CONNECTING to FULL 10000000:01000000:3.0:1789049577.585309:0:3307:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:3.0:1789049577.585317:0:3307:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:3.0:1789049577.585321:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb900e96680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:817823bd-3ba1-432d-9714-f03a15bff403:3307:1875954110645632:0@lo:250:mount.lustre.0 00000020:01000004:2.0:1789049577.586144:0:14310:0:(tgt_mount.c:1808:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:2.0:1789049577.586152:0:14310:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000020:00000080:2.0:1789049577.586166:0:14310:0:(genops.c:413:class_newdev()) Allocate new device MDS (ffff8cb900ba99c0) 00000020:00000080:2.0:1789049577.586179:0:14310:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00000100:00100000:2.0:1789049577.604154:0:14310:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1789049577.604342:0:14310:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:2.0:1789049577.604348:0:14310:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt00_000' 00000100:00100000:3.0:1789049577.607358:0:14310:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:3.0:1789049577.607371:0:14310:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:2.0:1789049577.607803:0:14310:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:2.0:1789049577.607809:0:14310:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:3.0:1789049577.608757:0:14310:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1789049577.610313:0:14310:0:(service.c:3467:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:3.0:1789049577.610321:0:14310:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:3.0:1789049577.611765:0:14310:0:(service.c:3467:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:3.0:1789049577.611775:0:14310:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00000100:00100000:2.0:1789049577.672609:0:14310:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1789049577.673760:0:14310:0:(service.c:3467:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:2.0:1789049577.673767:0:14310:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:2.0:1789049577.676060:0:14310:0:(service.c:3467:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:2.0:1789049577.676074:0:14310:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:2.0:1789049577.676814:0:14310:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1789049577.677044:0:14310:0:(service.c:3467:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:2.0:1789049577.677049:0:14310:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:2.0:1789049577.678434:0:14310:0:(service.c:3467:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:2.0:1789049577.678444:0:14310:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:2.0:1789049577.679326:0:14310:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1789049577.679502:0:14310:0:(service.c:3467:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:2.0:1789049577.679507:0:14310:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:2.0:1789049577.683430:0:14310:0:(service.c:3467:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:2.0:1789049577.683445:0:14310:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:2.0:1789049577.688689:0:14310:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1789049577.689081:0:14310:0:(service.c:3467:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:2.0:1789049577.689087:0:14310:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:2.0:1789049577.689809:0:14310:0:(service.c:3467:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:2.0:1789049577.689817:0:14310:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:3.0:1789049577.715701:0:14310:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1789049577.716540:0:14310:0:(service.c:3467:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:3.0:1789049577.716548:0:14310:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:3.0:1789049577.718379:0:14310:0:(service.c:3467:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:3.0:1789049577.718392:0:14310:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:3.0:1789049577.721337:0:14310:0:(service.c:3467:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:3.0:1789049577.721353:0:14310:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:3.0:1789049577.722288:0:14310:0:(obd_config.c:826:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:3.0:1789049577.722311:0:14310:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-mdt1/mdt1 10000000:01000000:3.0:1789049577.722318:0:14310:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.206.126@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:3.0:1789049577.722442:0:14310:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.206.126@tcp ctxt 0 is initialized 00000020:01000004:3.0:1789049577.722498:0:14310:0:(tgt_mount.c:1416:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.206.126@tcp, index=0000, flags=0x20005 00000020:01000004:3.0:1789049577.722503:0:14310:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:3.0:1789049577.722504:0:14310:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1789049577.722506:0:14310:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789049577.722507:0:14310:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1789049577.722508:0:14310:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789049577.722509:0:14310:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789049577.722511:0:14310:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1789049577.722512:0:14310:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1789049577.722514:0:14310:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789049577.722515:0:14310:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1789049577.722517:0:14310:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020005 00000020:01000004:3.0:1789049577.722519:0:14310:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1789049577.722521:0:14310:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1789049577.722522:0:14310:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789049577.722523:0:14310:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1789049577.722524:0:14310:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789049577.722525:0:14310:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789049577.722526:0:14310:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1789049577.722527:0:14310:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1789049577.722529:0:14310:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789049577.722530:0:14310:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1789049577.722560:0:14310:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:3.0:1789049577.722577:0:14310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb7c5c34e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:817823bd-3ba1-432d-9714-f03a15bff403:14310:1875954110645760:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1789049577.722639:0:14310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789049577.722693:0:14310:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cb7c6d8fc00 going to sleep for 11 seconds 00000100:00100000:2.0:1789049577.722770:0:14323:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954110645760 00000100:00100000:2.0:1789049577.722777:0:14323:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954110645760 00000100:00100000:2.0:1789049577.722821:0:14323:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1789049577.722831:0:14323:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8f73fa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:817823bd-3ba1-432d-9714-f03a15bff403+5:14310:x1875954110645760:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1789049577.722926:0:14323:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:2.0:1789049577.722929:0:14323:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:2.0:1789049577.722931:0:14323:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-MDT0000 is running on 0@lo 10000000:01000000:2.0:1789049577.723555:0:14343:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:3.0:1789049577.724137:0:14323:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 5 20000000:01000000:3.0:1789049577.725694:0:14344:0:(mgs_llog.c:340:mgs_fsdb_handler()) MDT index is 0 20000000:01000000:3.0:1789049577.725701:0:14344:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0000_UUID is 0 (0) 20000000:01000000:3.0:1789049577.725704:0:14344:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0001_UUID is 1 (1) 00000040:00080000:3.0:1789049577.725739:0:14344:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 20000000:01000000:2.0:1789049577.726443:0:14323:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:2.0:1789049577.726454:0:14323:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:2.0:1789049577.736175:0:14323:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8f73fa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:817823bd-3ba1-432d-9714-f03a15bff403+5:14310:x1875954110645760:12345-0@lo:253:mount.lustre.0 Request processed in 13336us (13526us total) trans 0 rc 0/0 00000100:00100000:2.0:1789049577.736203:0:14323:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1789049577.736415:0:14310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb7c5c34e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:817823bd-3ba1-432d-9714-f03a15bff403:14310:1875954110645760:0@lo:253:mount.lustre.0 10000000:01000000:3.0:1789049577.736430:0:14310:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:3.0:1789049577.736432:0:14310:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1789049577.736434:0:14310:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1789049577.736435:0:14310:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789049577.736436:0:14310:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1789049577.736438:0:14310:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789049577.736439:0:14310:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789049577.736440:0:14310:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1789049577.736442:0:14310:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1789049577.736443:0:14310:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789049577.736444:0:14310:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:3.0:1789049577.736461:0:14310:0:(tgt_mount.c:101:server_register_mount()) register mount ffff8cb8d1a86000 from lustre-MDT0000 10000000:01000000:3.0:1789049577.736496:0:14310:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:3.0:1789049577.736499:0:14310:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:3.0:1789049577.736503:0:14310:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-sptlrpc-ffff8cb900ba8000 10000000:01000000:3.0:1789049577.736507:0:14310:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1789049577.736514:0:14310:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff8cb900ba8000 from 1 10000000:01000000:3.0:1789049577.736518:0:14310:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:3.0:1789049577.736565:0:14310:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.126@tcp lock: ffff8cb8c6b35e00/0xf4f48ce5e1bbfd8a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14310 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049577.736576:0:14310:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.126@tcp lock: ffff8cb8c6b35e00/0xf4f48ce5e1bbfd8a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14310 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049577.736598:0:14310:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.126@tcp lock: ffff8cb8c6b35e00/0xf4f48ce5e1bbfd8a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14310 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789049577.736617:0:14310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb7c5c34e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:817823bd-3ba1-432d-9714-f03a15bff403:14310:1875954110645888:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1789049577.736652:0:14310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789049577.736690:0:14310:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cb7c6d8f180 going to sleep for 11 seconds 00000100:00100000:2.0:1789049577.736804:0:14322:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954110645888 00000100:00100000:2.0:1789049577.736811:0:14322:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954110645888 00000100:00100000:2.0:1789049577.736899:0:14322:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1789049577.736910:0:14322:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8f73fb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:817823bd-3ba1-432d-9714-f03a15bff403+5:14310:x1875954110645888:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1789049577.736923:0:14322:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789049577.736938:0:14322:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cb900e63600/0xf4f48ce5e1bbfd91 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xf4f48ce5e1bbfd8a expref: -99 pid: 14322 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049577.736961:0:14322:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cb900e63600/0xf4f48ce5e1bbfd91 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf4f48ce5e1bbfd8a expref: 6 pid: 14322 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049577.736972:0:14322:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cb900e63600/0xf4f48ce5e1bbfd91 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf4f48ce5e1bbfd8a expref: 6 pid: 14322 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049577.736981:0:14322:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cb900e63600, rc 0) 00000100:00100000:2.0:1789049577.737029:0:14322:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8f73fb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:817823bd-3ba1-432d-9714-f03a15bff403+6:14310:x1875954110645888:12345-0@lo:101:mount.lustre.0 Request processed in 122us (376us total) trans 0 rc 0/0 00000100:00100000:2.0:1789049577.737036:0:14322:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1789049577.737063:0:14310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb7c5c34e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:817823bd-3ba1-432d-9714-f03a15bff403:14310:1875954110645888:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1789049577.737078:0:14310:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.126@tcp lock: ffff8cb8c6b35e00/0xf4f48ce5e1bbfd8a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf4f48ce5e1bbfd91 expref: -99 pid: 14310 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049577.737088:0:14310:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.126@tcp lock: ffff8cb8c6b35e00/0xf4f48ce5e1bbfd8a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xf4f48ce5e1bbfd91 expref: -99 pid: 14310 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789049577.737137:0:14310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb8f7b90700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:817823bd-3ba1-432d-9714-f03a15bff403:14310:1875954110646016:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789049577.738398:0:14310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789049577.738488:0:14310:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cb8d1a2b300 going to sleep for 11 seconds 00000100:00100000:3.0:1789049577.742056:0:14323:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954110646016 00000100:00100000:3.0:1789049577.742070:0:14323:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954110646016 00000100:00100000:3.0:1789049577.743038:0:14323:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1789049577.743060:0:14323:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8f73f8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:817823bd-3ba1-432d-9714-f03a15bff403+6:14310:x1875954110646016:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789049577.743355:0:14323:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8f73f8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:817823bd-3ba1-432d-9714-f03a15bff403+6:14310:x1875954110646016:12345-0@lo:501:mount.lustre.0 Request processed in 306us (4959us total) trans 0 rc -2/-2 00000100:00100000:3.0:1789049577.743363:0:14323:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1789049577.743471:0:14310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb8f7b90700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:817823bd-3ba1-432d-9714-f03a15bff403:14310:1875954110646016:0@lo:501:mount.lustre.0 10000000:01000000:1.0:1789049577.743521:0:14310:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.126@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:1.0:1789049577.743547:0:14310:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.126@tcp lock: ffff8cb8c6b35e00/0xf4f48ce5e1bbfd8a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf4f48ce5e1bbfd91 expref: -99 pid: 14310 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049577.743568:0:14310:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.126@tcp lock: ffff8cb8c6b35e00/0xf4f48ce5e1bbfd8a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf4f48ce5e1bbfd91 expref: -99 pid: 14310 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789049577.743577:0:14310:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff8cb8d1a86000 10000000:01000000:1.0:1789049577.743581:0:14310:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:1.0:1789049577.743586:0:14310:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff8cb8d1a86000 10000000:01000000:1.0:1789049577.743589:0:14310:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:1.0:1789049577.743591:0:14310:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff8cb8d1a86000 from 1 10000000:01000000:1.0:1789049577.743594:0:14310:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:1.0:1789049577.743625:0:14310:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.126@tcp lock: ffff8cb8c28c2a00/0xf4f48ce5e1bbfd98 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14310 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049577.743633:0:14310:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.126@tcp lock: ffff8cb8c28c2a00/0xf4f48ce5e1bbfd98 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14310 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049577.743642:0:14310:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.126@tcp lock: ffff8cb8c28c2a00/0xf4f48ce5e1bbfd98 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14310 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789049577.743662:0:14310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb900e43100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:817823bd-3ba1-432d-9714-f03a15bff403:14310:1875954110646144:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1789049577.743699:0:14310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789049577.745565:0:14310:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cb8dbb6b300 going to sleep for 11 seconds 00000100:00100000:0.0:1789049577.745625:0:14321:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954110646144 00000100:00100000:0.0:1789049577.745633:0:14321:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954110646144 00000100:00100000:0.0:1789049577.745680:0:14321:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1789049577.745690:0:14321:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8f73f8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:817823bd-3ba1-432d-9714-f03a15bff403+6:14310:x1875954110646144:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1789049577.745708:0:14321:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789049577.745729:0:14321:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cb7c4c38400/0xf4f48ce5e1bbfd9f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xf4f48ce5e1bbfd98 expref: -99 pid: 14321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049577.745772:0:14321:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cb7c4c38400/0xf4f48ce5e1bbfd9f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf4f48ce5e1bbfd98 expref: 7 pid: 14321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049577.745787:0:14321:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cb7c4c38400/0xf4f48ce5e1bbfd9f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf4f48ce5e1bbfd98 expref: 7 pid: 14321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049577.745795:0:14321:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cb7c4c38400, rc 0) 00000100:00100000:0.0:1789049577.746112:0:14321:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8f73f8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:817823bd-3ba1-432d-9714-f03a15bff403+7:14310:x1875954110646144:12345-0@lo:101:mount.lustre.0 Request processed in 422us (2411us total) trans 0 rc 0/0 00000100:00100000:0.0:1789049577.746121:0:14321:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1789049577.746387:0:14310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb900e43100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:817823bd-3ba1-432d-9714-f03a15bff403:14310:1875954110646144:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1789049577.746403:0:14310:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.126@tcp lock: ffff8cb8c28c2a00/0xf4f48ce5e1bbfd98 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf4f48ce5e1bbfd9f expref: -99 pid: 14310 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049577.746413:0:14310:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.126@tcp lock: ffff8cb8c28c2a00/0xf4f48ce5e1bbfd98 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xf4f48ce5e1bbfd9f expref: -99 pid: 14310 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789049577.746443:0:14310:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.126@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:1.0:1789049577.746461:0:14310:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.126@tcp lock: ffff8cb8c28c2a00/0xf4f48ce5e1bbfd98 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf4f48ce5e1bbfd9f expref: -99 pid: 14310 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049577.746470:0:14310:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.126@tcp lock: ffff8cb8c28c2a00/0xf4f48ce5e1bbfd98 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf4f48ce5e1bbfd9f expref: -99 pid: 14310 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789049577.746485:0:14310:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:1.0:1789049577.746489:0:14310:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1789049577.746495:0:14310:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff8cb8d1a86000 10000000:01000000:1.0:1789049577.746498:0:14310:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:1.0:1789049577.746501:0:14310:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:1.0:1789049577.746504:0:14310:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:1.0:1789049577.746528:0:14310:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.126@tcp lock: ffff8cb8c28c3600/0xf4f48ce5e1bbfda6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14310 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049577.746540:0:14310:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.126@tcp lock: ffff8cb8c28c3600/0xf4f48ce5e1bbfda6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14310 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049577.746548:0:14310:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.126@tcp lock: ffff8cb8c28c3600/0xf4f48ce5e1bbfda6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14310 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789049577.746568:0:14310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb900e43100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:817823bd-3ba1-432d-9714-f03a15bff403:14310:1875954110646272:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1789049577.746601:0:14310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789049577.746663:0:14310:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cb8dbb6b300 going to sleep for 11 seconds 00000100:00100000:0.0:1789049577.747106:0:14321:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954110646272 00000100:00100000:0.0:1789049577.747112:0:14321:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954110646272 00000100:00100000:0.0:1789049577.747180:0:14321:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1789049577.747189:0:14321:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb7c47f6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:817823bd-3ba1-432d-9714-f03a15bff403+7:14310:x1875954110646272:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1789049577.747198:0:14321:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789049577.747209:0:14321:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cb7c4c38000/0xf4f48ce5e1bbfdad lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xf4f48ce5e1bbfda6 expref: -99 pid: 14321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049577.747226:0:14321:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cb7c4c38000/0xf4f48ce5e1bbfdad lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf4f48ce5e1bbfda6 expref: 8 pid: 14321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049577.747236:0:14321:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cb7c4c38000/0xf4f48ce5e1bbfdad lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf4f48ce5e1bbfda6 expref: 8 pid: 14321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049577.747245:0:14321:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cb7c4c38000, rc 0) 00000100:00100000:0.0:1789049577.747286:0:14321:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb7c47f6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:817823bd-3ba1-432d-9714-f03a15bff403+8:14310:x1875954110646272:12345-0@lo:101:mount.lustre.0 Request processed in 98us (684us total) trans 0 rc 0/0 00000100:00100000:0.0:1789049577.747293:0:14321:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1789049577.747362:0:14310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb900e43100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:817823bd-3ba1-432d-9714-f03a15bff403:14310:1875954110646272:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1789049577.747374:0:14310:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.126@tcp lock: ffff8cb8c28c3600/0xf4f48ce5e1bbfda6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf4f48ce5e1bbfdad expref: -99 pid: 14310 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049577.747389:0:14310:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.126@tcp lock: ffff8cb8c28c3600/0xf4f48ce5e1bbfda6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xf4f48ce5e1bbfdad expref: -99 pid: 14310 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789049577.747443:0:14310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb900e43100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:817823bd-3ba1-432d-9714-f03a15bff403:14310:1875954110646400:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789049577.747470:0:14310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789049577.747571:0:14310:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cb8dbb6b300 going to sleep for 11 seconds 00000100:00100000:3.0:1789049577.747616:0:14323:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954110646400 00000100:00100000:3.0:1789049577.747621:0:14323:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954110646400 00000100:00100000:3.0:1789049577.747645:0:14323:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1789049577.747653:0:14323:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb7c47f4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:817823bd-3ba1-432d-9714-f03a15bff403+8:14310:x1875954110646400:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789049577.748242:0:14323:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb7c47f4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:817823bd-3ba1-432d-9714-f03a15bff403+9:14310:x1875954110646400:12345-0@lo:501:mount.lustre.0 Request processed in 588us (769us total) trans 0 rc 0/0 00000100:00100000:3.0:1789049577.748250:0:14323:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1789049577.748409:0:14310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb900e43100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:817823bd-3ba1-432d-9714-f03a15bff403:14310:1875954110646400:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789049577.748440:0:14310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb900e43100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:817823bd-3ba1-432d-9714-f03a15bff403:14310:1875954110646528:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1789049577.748489:0:14310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789049577.748516:0:14310:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cb8dbb6b300 going to sleep for 11 seconds 00000100:00100000:1.0:1789049577.748533:0:14321:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954110646528 00000100:00100000:1.0:1789049577.748537:0:14321:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954110646528 00000100:00100000:1.0:1789049577.748596:0:14321:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1789049577.748604:0:14321:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb7c47f5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:817823bd-3ba1-432d-9714-f03a15bff403+9:14310:x1875954110646528:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1789049577.748950:0:14321:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb7c47f5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:817823bd-3ba1-432d-9714-f03a15bff403+9:14310:x1875954110646528:12345-0@lo:503:mount.lustre.0 Request processed in 346us (470us total) trans 0 rc 0/0 00000100:00100000:1.0:1789049577.748958:0:14321:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1789049577.749028:0:14310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb900e43100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:817823bd-3ba1-432d-9714-f03a15bff403:14310:1875954110646528:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1789049577.749561:0:14345:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb7c5c35500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:817823bd-3ba1-432d-9714-f03a15bff403:14345:1875954110646656:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789049577.749599:0:14345:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789049577.749661:0:14345:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cb7c6d8f180 going to sleep for 11 seconds 00000100:00100000:0.0:1789049577.749695:0:14323:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954110646656 00000100:00100000:0.0:1789049577.749700:0:14323:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954110646656 00000100:00100000:0.0:1789049577.749770:0:14323:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1789049577.749778:0:14323:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb7c47f7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:817823bd-3ba1-432d-9714-f03a15bff403+9:14345:x1875954110646656:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789049577.750510:0:14323:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb7c47f7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:817823bd-3ba1-432d-9714-f03a15bff403+9:14345:x1875954110646656:12345-0@lo:502:llog_process_th.0 Request processed in 714us (890us total) trans 0 rc 0/0 00000100:00100000:0.0:1789049577.750518:0:14323:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1789049577.751105:0:14345:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb7c5c35500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:817823bd-3ba1-432d-9714-f03a15bff403:14345:1875954110646656:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1789049577.751136:0:14345:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789049577.751153:0:14345:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789049577.751156:0:14345:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:3.0:1789049577.751161:0:14345:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:3.0:1789049577.751164:0:14345:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1789049577.751177:0:14345:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (ffff8cb8c7c6b380) 00000020:00000080:3.0:1789049577.751197:0:14345:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:3.0:1789049577.751202:0:14345:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:3.0:1789049577.751266:0:14345:0:(osd_handler.c:1574:osd_obd_connect()) connect #2 00000020:00000080:3.0:1789049577.751273:0:14345:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xf4f48ce5e1bbfdbb 00000020:00000080:3.0:1789049577.751463:0:14345:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:3.0:1789049577.751467:0:14345:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789049577.751471:0:14345:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789049577.751473:0:14345:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:3.0:1789049577.751488:0:14345:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789049577.751492:0:14345:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789049577.751494:0:14345:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:3.0:1789049577.751497:0:14345:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1789049577.751504:0:14345:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (ffff8cb8c7c699c0) 00000020:00000080:3.0:1789049577.751513:0:14345:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:3.0:1789049577.751517:0:14345:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:3.0:1789049577.751519:0:14345:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:3.0:1789049577.751522:0:14345:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:3.0:1789049577.751527:0:14345:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:3.0:1789049577.751565:0:14345:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8cb8d1a86000 from lustre-MDT0000, refs=3 00000020:00000080:3.0:1789049577.751577:0:14345:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (ffff8cb8c7c6cd40) 00000020:00000080:3.0:1789049577.751583:0:14345:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:3.0:1789049577.751634:0:14345:0:(lod_dev.c:2292:lod_obd_connect()) connect #0 00000020:00000080:3.0:1789049577.751639:0:14345:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xf4f48ce5e1bbfdd0 00000020:00000080:3.0:1789049577.751719:0:14345:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:3.0:1789049577.751724:0:14345:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:3.0:1789049577.751728:0:14345:0:(genops.c:1384:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0xf4f48ce5e1bbfdd7 00080000:01000000:3.0:1789049577.751733:0:14345:0:(osd_handler.c:1574:osd_obd_connect()) connect #3 00000020:00000080:3.0:1789049577.751735:0:14345:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xf4f48ce5e1bbfdde 00010000:00010000:3.0:1789049577.823151:0:14345:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-1 is initialized 00000001:00000004:3.0:1789049577.823542:0:14345:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 4294967534 00000001:00080000:3.0:1789049577.824000:0:14345:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:3.0:1789049577.825490:0:14345:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (ffff8cb8c62ab380) 00000020:00000080:3.0:1789049577.825513:0:14345:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:3.0:1789049577.825596:0:14345:0:(osd_handler.c:1574:osd_obd_connect()) connect #4 00000020:00000080:3.0:1789049577.825602:0:14345:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xf4f48ce5e1bbfdec 00000020:00000080:0.0:1789049577.826443:0:14345:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:0.0:1789049577.834022:0:14345:0:(genops.c:1384:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0xf4f48ce5e1bbfdf3 00000020:00000080:0.0:1789049577.834351:0:14345:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:0.0:1789049577.834362:0:14345:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789049577.834368:0:14345:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789049577.834370:0:14345:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:0.0:1789049577.834385:0:14345:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789049577.834391:0:14345:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789049577.834393:0:14345:0:(obd_config.c:1563:class_process_config()) marker 8 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:0.0:1789049577.834397:0:14345:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:0.0:1789049577.834430:0:14345:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:0.0:1789049577.834442:0:14345:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789049577.834445:0:14345:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789049577.834447:0:14345:0:(obd_config.c:1563:class_process_config()) marker 8 (0x2) lustre-MDT0000 mdt.identity_upcall 00000020:01000000:0.0:1789049577.834449:0:14345:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:0.0:1789049577.834451:0:14345:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #10 00000020:01000000:0.0:1789049577.834453:0:14345:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1789049577.834454:0:14345:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1789049577.834456:0:14345:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:0.0:1789049577.834458:0:14345:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789049577.834459:0:14345:0:(obd_config.c:1563:class_process_config()) marker 10 (0x6) lustre sys.timeout 00000020:01000000:0.0:1789049577.834461:0:14345:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1789049577.834470:0:14345:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-mdt1/mdt1 00000020:00000080:0.0:1789049577.834484:0:14345:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789049577.834486:0:14345:0:(obd_config.c:1563:class_process_config()) marker 12 (0x1) lustre-OST0000 add osc 00000020:00000080:0.0:1789049577.834491:0:14345:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:0.0:1789049577.834496:0:14345:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.206.126@tcp to nid 0x20000c0a8ce7e (192.168.206.126@tcp) 00000020:01000000:0.0:1789049577.834518:0:14345:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:0.0:1789049577.834521:0:14345:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1789049577.834536:0:14345:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff8cb8c5958000) 00000020:00000080:0.0:1789049577.834551:0:14345:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type osp with refcount 2 00000020:00000080:0.0:1789049577.834682:0:14345:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:0.0:1789049577.834732:0:14345:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:0.0:1789049577.834738:0:14345:0:(osd_handler.c:1574:osd_obd_connect()) connect #5 00000020:00000080:0.0:1789049577.834744:0:14345:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xf4f48ce5e1bbfe01 00010000:00080000:0.0:1789049577.834775:0:14345:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8cb8c8369000@lustre-OST0000-osc-MDT0000: add connection 192.168.206.126@tcp at head 00010000:00010000:0.0:1789049577.835028:0:14345:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-1 is initialized 00000040:01000000:0.0:1789049577.835326:0:14345:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:0.0:1789049577.835369:0:14345:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:0.0:1789049577.839240:0:14345:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1789049577.839307:0:14345:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].2, 64 off8320 00000040:00080000:0.0:1789049577.839458:0:14345:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1, 64 off8256 00000040:00080000:3.0:1789049577.840085:0:14349:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:3.0:1789049577.840090:0:14349:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xa:0x0] at index 2 of catalog [0x1:0x2:0x0] 00000020:00000080:0.0:1789049577.840837:0:14345:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1789049577.840943:0:14345:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:0.0:1789049577.840976:0:14345:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:0.0:1789049577.840993:0:14345:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xf4f48ce5e1bbfe08 00000100:00080000:0.0:1789049577.841003:0:14345:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1789049577.841014:0:14345:0:(import.c:666:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff8cb8c8369000 using connection 192.168.206.126@tcp/0@lo 00000100:00100000:0.0:1789049577.841046:0:14345:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8cb8f7b93800 x1875954110646784/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1789049577.841064:0:14345:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:0.0:1789049577.841149:0:14345:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789049577.841158:0:14345:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789049577.841161:0:14345:0:(obd_config.c:1563:class_process_config()) marker 12 (0x2) lustre-OST0000 add osc 00000020:01000000:0.0:1789049577.841164:0:14345:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:0.0:1789049577.841167:0:14345:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #16 00000020:01000000:0.0:1789049577.841168:0:14345:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1789049577.841170:0:14345:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1789049577.841171:0:14345:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:0.0:1789049577.841174:0:14345:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789049577.841175:0:14345:0:(obd_config.c:1563:class_process_config()) marker 16 (0x6) lustre sys.timeout 00000020:01000000:0.0:1789049577.841177:0:14345:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1789049577.841181:0:14345:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-mdt1/mdt1 00000020:00000080:0.0:1789049577.841184:0:14345:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789049577.841186:0:14345:0:(obd_config.c:1563:class_process_config()) marker 18 (0x1) lustre-OST0001 add osc 00000020:00000080:0.0:1789049577.841188:0:14345:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:0.0:1789049577.841192:0:14345:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.206.126@tcp to nid 0x20000c0a8ce7e (192.168.206.126@tcp) 00000020:01000000:0.0:1789049577.841211:0:14345:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:0.0:1789049577.841213:0:14345:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1789049577.841225:0:14345:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff8cb8c59599c0) 00000020:00000080:0.0:1789049577.841235:0:14345:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osp with refcount 2 00000020:00000080:0.0:1789049577.841239:0:14345:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:0.0:1789049577.841286:0:14345:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:0.0:1789049577.841292:0:14345:0:(osd_handler.c:1574:osd_obd_connect()) connect #6 00000020:00000080:0.0:1789049577.841297:0:14345:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xf4f48ce5e1bbfe16 00010000:00080000:0.0:1789049577.841324:0:14345:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8cb8c3fca000@lustre-OST0001-osc-MDT0000: add connection 192.168.206.126@tcp at head 00010000:00010000:0.0:1789049577.841742:0:14345:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-2 is initialized 00000040:01000000:0.0:1789049577.841919:0:14345:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:0.0:1789049577.841940:0:14345:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:0.0:1789049577.842319:0:14345:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1789049577.842454:0:14345:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].2, 64 off8320 00000040:00080000:0.0:1789049577.842533:0:14345:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xc:0x0].1, 64 off8256 00000100:00100000:3.0:1789049577.842679:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb8f7b93800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3307:1875954110646784:0@lo:8:llog_process_th.0 00000400:00000100:3.0:1789049577.842725:0:3307:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875954110646784 offset 0 length 520: 4 00000040:00080000:1.0:1789049577.847231:0:14351:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:1.0:1789049577.847239:0:14351:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xc:0x0] at index 2 of catalog [0x1:0x5:0x0] 00000020:00000080:1.0:1789049577.848077:0:14345:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1789049577.848088:0:14345:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:1.0:1789049577.848118:0:14345:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:1.0:1789049577.848137:0:14345:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xf4f48ce5e1bbfe1d 00000100:00080000:1.0:1789049577.848148:0:14345:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1789049577.848161:0:14345:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff8cb8c3fca000 using connection 192.168.206.126@tcp/0@lo 00000100:00100000:1.0:1789049577.848203:0:14345:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8cb900e42d80 x1875954110646912/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1789049577.848220:0:14345:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:1.0:1789049577.848272:0:14345:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789049577.848276:0:14345:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789049577.848278:0:14345:0:(obd_config.c:1563:class_process_config()) marker 18 (0x2) lustre-OST0001 add osc 00000020:01000000:1.0:1789049577.848281:0:14345:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789049577.848284:0:14345:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789049577.848286:0:14345:0:(obd_config.c:1563:class_process_config()) marker 23 (0x1) lustre sys.timeout 00000020:00000080:1.0:1789049577.848288:0:14345:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1789049577.848290:0:14345:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:1.0:1789049577.848292:0:14345:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789049577.848294:0:14345:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789049577.848296:0:14345:0:(obd_config.c:1563:class_process_config()) marker 23 (0x2) lustre sys.timeout 00000020:01000000:1.0:1789049577.848298:0:14345:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789049577.848299:0:14345:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789049577.848301:0:14345:0:(obd_config.c:1563:class_process_config()) marker 27 (0x1) lustre sys.jobid_var 00000020:00000080:1.0:1789049577.848304:0:14345:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:1.0:1789049577.848333:0:14345:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb900e42a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:817823bd-3ba1-432d-9714-f03a15bff403:14345:1875954110647040:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789049577.848629:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb900e42d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3307:1875954110646912:0@lo:8:llog_process_th.0 00000400:00000100:3.0:1789049577.848678:0:3307:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875954110646912 offset 0 length 520: 4 00000100:00100000:1.0:1789049577.848932:0:14345:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789049577.848951:0:14345:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cb8dbb6bc00 going to sleep for 11 seconds 00000100:00100000:0.0:1789049577.849022:0:14323:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954110647040 00000100:00100000:0.0:1789049577.849029:0:14323:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954110647040 00000100:00100000:0.0:1789049577.849061:0:14323:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1789049577.849075:0:14323:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb7c47f7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:817823bd-3ba1-432d-9714-f03a15bff403+9:14345:x1875954110647040:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789049577.854507:0:14323:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb7c47f7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:817823bd-3ba1-432d-9714-f03a15bff403+9:14345:x1875954110647040:12345-0@lo:502:llog_process_th.0 Request processed in 5425us (5567us total) trans 0 rc 0/0 00000100:00100000:0.0:1789049577.854521:0:14323:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1789049577.854730:0:14345:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb900e42a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:817823bd-3ba1-432d-9714-f03a15bff403:14345:1875954110647040:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1789049577.854767:0:14345:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789049577.854774:0:14345:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789049577.854775:0:14345:0:(obd_config.c:1563:class_process_config()) marker 27 (0x2) lustre sys.jobid_var 00000040:00080000:1.0:1789049577.854780:0:14345:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 37 count 37 00000020:01000000:0.0:1789049577.855416:0:14310:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-36 (rc=0) 10000000:01000000:0.0:1789049577.855438:0:14310:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.126@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:0.0:1789049577.855499:0:14310:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.126@tcp lock: ffff8cb8c28c3600/0xf4f48ce5e1bbfda6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf4f48ce5e1bbfdad expref: -99 pid: 14310 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049577.855512:0:14310:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.126@tcp lock: ffff8cb8c28c3600/0xf4f48ce5e1bbfda6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf4f48ce5e1bbfdad expref: -99 pid: 14310 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789049577.855519:0:14310:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8cb8d1a86000 from 1 10000000:01000000:0.0:1789049577.855522:0:14310:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1789049577.855619:0:14310:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.126@tcp lock: ffff8cb7c4c38c00/0xf4f48ce5e1bbfe24 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14310 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049577.855628:0:14310:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.126@tcp lock: ffff8cb7c4c38c00/0xf4f48ce5e1bbfe24 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14310 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049577.855637:0:14310:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.126@tcp lock: ffff8cb7c4c38c00/0xf4f48ce5e1bbfe24 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14310 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789049577.855656:0:14310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb8f7b93b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:817823bd-3ba1-432d-9714-f03a15bff403:14310:1875954110647168:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1789049577.855702:0:14310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789049577.855740:0:14310:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cb8c5975a80 going to sleep for 11 seconds 00000100:00100000:3.0:1789049577.864798:0:14322:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954110647168 00000100:00100000:3.0:1789049577.864810:0:14322:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954110647168 00000100:00100000:3.0:1789049577.864873:0:14322:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1789049577.864882:0:14322:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb7c47f4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:817823bd-3ba1-432d-9714-f03a15bff403+9:14310:x1875954110647168:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1789049577.864897:0:14322:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789049577.864917:0:14322:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cb8c6b35a00/0xf4f48ce5e1bbfe2b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xf4f48ce5e1bbfe24 expref: -99 pid: 14322 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049577.864941:0:14322:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cb8c6b35a00/0xf4f48ce5e1bbfe2b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf4f48ce5e1bbfe24 expref: 10 pid: 14322 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049577.864952:0:14322:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cb8c6b35a00/0xf4f48ce5e1bbfe2b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf4f48ce5e1bbfe24 expref: 10 pid: 14322 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049577.864960:0:14322:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cb8c6b35a00, rc 0) 00000100:00100000:3.0:1789049577.865026:0:14322:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb7c47f4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:817823bd-3ba1-432d-9714-f03a15bff403+10:14310:x1875954110647168:12345-0@lo:101:mount.lustre.0 Request processed in 144us (9323us total) trans 0 rc 0/0 00000100:00100000:3.0:1789049577.865045:0:14322:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1789049577.865192:0:14310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb8f7b93b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:817823bd-3ba1-432d-9714-f03a15bff403:14310:1875954110647168:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1789049577.865211:0:14310:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.126@tcp lock: ffff8cb7c4c38c00/0xf4f48ce5e1bbfe24 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf4f48ce5e1bbfe2b expref: -99 pid: 14310 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049577.865228:0:14310:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.126@tcp lock: ffff8cb7c4c38c00/0xf4f48ce5e1bbfe24 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xf4f48ce5e1bbfe2b expref: -99 pid: 14310 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789049577.865792:0:14310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb8f7b93b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:817823bd-3ba1-432d-9714-f03a15bff403:14310:1875954110647296:0@lo:256:mount.lustre.0 00000100:00100000:0.0:1789049577.865837:0:14310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789049577.867065:0:14310:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cb8c5975a80 going to sleep for 11 seconds 00000100:00100000:3.0:1789049577.867078:0:14323:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954110647296 00000100:00100000:3.0:1789049577.867087:0:14323:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954110647296 00000100:00100000:3.0:1789049577.867138:0:14323:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1789049577.867148:0:14323:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb7c47f6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:817823bd-3ba1-432d-9714-f03a15bff403+10:14310:x1875954110647296:12345-0@lo:256:mount.lustre.0 20000000:01000000:3.0:1789049577.867169:0:14323:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:3.0:1789049577.867176:0:14323:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 0, version 1 00000100:00100000:3.0:1789049577.867276:0:14323:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb7c47f6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:817823bd-3ba1-432d-9714-f03a15bff403+10:14310:x1875954110647296:12345-0@lo:256:mount.lustre.0 Request processed in 129us (1437us total) trans 0 rc 0/0 00000100:00100000:3.0:1789049577.867284:0:14323:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1789049577.867674:0:14310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb8f7b93b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:817823bd-3ba1-432d-9714-f03a15bff403:14310:1875954110647296:0@lo:256:mount.lustre.0 10000000:01000000:0.0:1789049577.868510:0:14310:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.126@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1789049577.868533:0:14310:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.126@tcp lock: ffff8cb7c4c38c00/0xf4f48ce5e1bbfe24 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf4f48ce5e1bbfe2b expref: -99 pid: 14310 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049577.868545:0:14310:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.126@tcp lock: ffff8cb7c4c38c00/0xf4f48ce5e1bbfe24 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf4f48ce5e1bbfe2b expref: -99 pid: 14310 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789049577.868552:0:14310:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8cb8d1a86000 from 1 10000000:01000000:0.0:1789049577.868555:0:14310:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1789049577.868586:0:14310:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.126@tcp lock: ffff8cb7c4c39a00/0xf4f48ce5e1bbfe32 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14310 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049577.868593:0:14310:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.126@tcp lock: ffff8cb7c4c39a00/0xf4f48ce5e1bbfe32 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14310 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049577.868603:0:14310:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.126@tcp lock: ffff8cb7c4c39a00/0xf4f48ce5e1bbfe32 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14310 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789049577.868621:0:14310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb8f7b93b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:817823bd-3ba1-432d-9714-f03a15bff403:14310:1875954110647424:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1789049577.868662:0:14310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789049577.868697:0:14310:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cb8c5975a80 going to sleep for 11 seconds 00000100:00100000:3.0:1789049577.868823:0:14322:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954110647424 00000100:00100000:3.0:1789049577.868829:0:14322:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954110647424 00000100:00100000:3.0:1789049577.868878:0:14322:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1789049577.868886:0:14322:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb7c47f4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:817823bd-3ba1-432d-9714-f03a15bff403+10:14310:x1875954110647424:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1789049577.868896:0:14322:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789049577.868908:0:14322:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cb8c6b34000/0xf4f48ce5e1bbfe39 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xf4f48ce5e1bbfe32 expref: -99 pid: 14322 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049577.868929:0:14322:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cb8c6b34000/0xf4f48ce5e1bbfe39 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf4f48ce5e1bbfe32 expref: 11 pid: 14322 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049577.868939:0:14322:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cb8c6b34000/0xf4f48ce5e1bbfe39 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf4f48ce5e1bbfe32 expref: 11 pid: 14322 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049577.868948:0:14322:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cb8c6b34000, rc 0) 00000100:00100000:3.0:1789049577.868988:0:14322:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb7c47f4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:817823bd-3ba1-432d-9714-f03a15bff403+11:14310:x1875954110647424:12345-0@lo:101:mount.lustre.0 Request processed in 103us (325us total) trans 0 rc 0/0 00000100:00100000:3.0:1789049577.868995:0:14322:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1789049577.869078:0:14310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb8f7b93b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:817823bd-3ba1-432d-9714-f03a15bff403:14310:1875954110647424:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1789049577.869091:0:14310:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.126@tcp lock: ffff8cb7c4c39a00/0xf4f48ce5e1bbfe32 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf4f48ce5e1bbfe39 expref: -99 pid: 14310 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049577.869111:0:14310:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.126@tcp lock: ffff8cb7c4c39a00/0xf4f48ce5e1bbfe32 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xf4f48ce5e1bbfe39 expref: -99 pid: 14310 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789049577.869160:0:14310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb900e42a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:817823bd-3ba1-432d-9714-f03a15bff403:14310:1875954110647552:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789049577.869189:0:14310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789049577.869219:0:14310:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cb8c12ede40 going to sleep for 11 seconds 00000100:00100000:3.0:1789049577.869345:0:14321:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954110647552 00000100:00100000:3.0:1789049577.869350:0:14321:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954110647552 00000100:00100000:3.0:1789049577.869380:0:14321:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1789049577.869387:0:14321:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb7c47f5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:817823bd-3ba1-432d-9714-f03a15bff403+11:14310:x1875954110647552:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789049577.869768:0:14321:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb7c47f5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:817823bd-3ba1-432d-9714-f03a15bff403+11:14310:x1875954110647552:12345-0@lo:501:mount.lustre.0 Request processed in 381us (577us total) trans 0 rc 0/0 00000100:00100000:3.0:1789049577.869775:0:14321:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1789049577.870077:0:14310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb900e42a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:817823bd-3ba1-432d-9714-f03a15bff403:14310:1875954110647552:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789049577.870109:0:14310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb900e42a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:817823bd-3ba1-432d-9714-f03a15bff403:14310:1875954110647680:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1789049577.870151:0:14310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789049577.870179:0:14310:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cb8c12ede40 going to sleep for 11 seconds 00000100:00100000:0.0:1789049577.870286:0:14323:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954110647680 00000100:00100000:0.0:1789049577.870291:0:14323:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954110647680 00000100:00100000:0.0:1789049577.870325:0:14323:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1789049577.870333:0:14323:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb7c47f6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:817823bd-3ba1-432d-9714-f03a15bff403+11:14310:x1875954110647680:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1789049577.870494:0:14323:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb7c47f6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:817823bd-3ba1-432d-9714-f03a15bff403+11:14310:x1875954110647680:12345-0@lo:503:mount.lustre.0 Request processed in 162us (342us total) trans 0 rc 0/0 00000100:00100000:0.0:1789049577.870502:0:14323:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1789049577.870574:0:14310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb900e42a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:817823bd-3ba1-432d-9714-f03a15bff403:14310:1875954110647680:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1789049577.871368:0:14353:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb900e42a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:817823bd-3ba1-432d-9714-f03a15bff403:14353:1875954110647808:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789049577.871422:0:14353:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789049577.871456:0:14353:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cb8c12ed240 going to sleep for 11 seconds 00000100:00100000:2.0:1789049577.871468:0:14322:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954110647808 00000100:00100000:2.0:1789049577.871484:0:14322:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954110647808 00000100:00100000:2.0:1789049577.871524:0:14322:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1789049577.871534:0:14322:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb7c47f5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:817823bd-3ba1-432d-9714-f03a15bff403+11:14353:x1875954110647808:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789049577.871794:0:14322:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb7c47f5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:817823bd-3ba1-432d-9714-f03a15bff403+11:14353:x1875954110647808:12345-0@lo:502:llog_process_th.0 Request processed in 261us (371us total) trans 0 rc 0/0 00000100:00100000:2.0:1789049577.871801:0:14322:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1789049577.871810:0:14353:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb900e42a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:817823bd-3ba1-432d-9714-f03a15bff403:14353:1875954110647808:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1789049577.871834:0:14353:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789049577.871875:0:14353:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789049577.871877:0:14353:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:1.0:1789049577.871886:0:14353:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8cb8d1a86000 00000020:00000080:1.0:1789049577.871889:0:14353:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1789049577.871896:0:14353:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789049577.871899:0:14353:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789049577.871900:0:14353:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:1.0:1789049577.871903:0:14353:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789049577.871905:0:14353:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789049577.872021:0:14353:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:1.0:1789049577.872027:0:14353:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8cb8d1a86000 00000020:00000080:1.0:1789049577.872029:0:14353:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1789049577.872085:0:14353:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789049577.872089:0:14353:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789049577.872090:0:14353:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:1.0:1789049577.872093:0:14353:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789049577.872096:0:14353:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789049577.872097:0:14353:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1789049577.872100:0:14353:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8cb8d1a86000 00000020:00000080:1.0:1789049577.872102:0:14353:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1789049577.872138:0:14353:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb900e42a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:817823bd-3ba1-432d-9714-f03a15bff403:14353:1875954110647936:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789049577.872172:0:14353:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789049577.872199:0:14353:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cb8c12ed240 going to sleep for 11 seconds 00000100:00100000:3.0:1789049577.873060:0:14321:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954110647936 00000100:00100000:3.0:1789049577.873069:0:14321:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954110647936 00000100:00100000:3.0:1789049577.873120:0:14321:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1789049577.873129:0:14321:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb7c47f5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:817823bd-3ba1-432d-9714-f03a15bff403+11:14353:x1875954110647936:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789049577.873316:0:14321:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb7c47f5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:817823bd-3ba1-432d-9714-f03a15bff403+11:14353:x1875954110647936:12345-0@lo:502:llog_process_th.0 Request processed in 188us (1142us total) trans 0 rc 0/0 00000100:00100000:3.0:1789049577.873324:0:14321:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1789049577.873341:0:14353:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb900e42a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:817823bd-3ba1-432d-9714-f03a15bff403:14353:1875954110647936:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1789049577.873368:0:14353:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789049577.873374:0:14353:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789049577.873375:0:14353:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:1.0:1789049577.873379:0:14353:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:0.0:1789049577.873823:0:14310:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-9 (rc=0) 10000000:01000000:0.0:1789049577.874033:0:14310:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.126@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1789049577.874090:0:14310:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.126@tcp lock: ffff8cb7c4c39a00/0xf4f48ce5e1bbfe32 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf4f48ce5e1bbfe39 expref: -99 pid: 14310 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049577.874102:0:14310:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.126@tcp lock: ffff8cb7c4c39a00/0xf4f48ce5e1bbfe32 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf4f48ce5e1bbfe39 expref: -99 pid: 14310 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789049577.874143:0:14310:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:0.0:1789049577.874146:0:14310:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff8cb8d1a86000 10000000:01000000:0.0:1789049577.874149:0:14310:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff8cb8d1a86000 10000000:01000000:0.0:1789049577.874152:0:14310:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1789049577.874157:0:14310:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8cb8d1a86000 from 1 10000000:01000000:0.0:1789049577.874159:0:14310:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1789049577.874184:0:14310:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.126@tcp lock: ffff8cb7c4c39400/0xf4f48ce5e1bbfe40 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14310 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049577.874192:0:14310:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.126@tcp lock: ffff8cb7c4c39400/0xf4f48ce5e1bbfe40 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14310 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049577.874201:0:14310:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.126@tcp lock: ffff8cb7c4c39400/0xf4f48ce5e1bbfe40 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14310 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789049577.874227:0:14310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb8f7b91880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:817823bd-3ba1-432d-9714-f03a15bff403:14310:1875954110648064:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1789049577.874261:0:14310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789049577.874294:0:14310:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cb8c5975240 going to sleep for 11 seconds 00000100:00100000:1.0:1789049577.874341:0:14322:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954110648064 00000100:00100000:1.0:1789049577.874346:0:14322:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954110648064 00000100:00100000:1.0:1789049577.874375:0:14322:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1789049577.874382:0:14322:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb7c47f7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:817823bd-3ba1-432d-9714-f03a15bff403+11:14310:x1875954110648064:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1789049577.874391:0:14322:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789049577.874402:0:14322:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cb8c28c3a00/0xf4f48ce5e1bbfe47 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xf4f48ce5e1bbfe40 expref: -99 pid: 14322 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049577.874421:0:14322:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cb8c28c3a00/0xf4f48ce5e1bbfe47 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf4f48ce5e1bbfe40 expref: 12 pid: 14322 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049577.874441:0:14322:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cb8c28c3a00/0xf4f48ce5e1bbfe47 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf4f48ce5e1bbfe40 expref: 12 pid: 14322 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049577.874449:0:14322:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cb8c28c3a00, rc 0) 00000100:00100000:1.0:1789049577.874488:0:14322:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb7c47f7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:817823bd-3ba1-432d-9714-f03a15bff403+12:14310:x1875954110648064:12345-0@lo:101:mount.lustre.0 Request processed in 95us (215us total) trans 0 rc 0/0 00000100:00100000:1.0:1789049577.874494:0:14322:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1789049577.874556:0:14310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb8f7b91880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:817823bd-3ba1-432d-9714-f03a15bff403:14310:1875954110648064:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1789049577.874567:0:14310:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.126@tcp lock: ffff8cb7c4c39400/0xf4f48ce5e1bbfe40 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf4f48ce5e1bbfe47 expref: -99 pid: 14310 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049577.874576:0:14310:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.126@tcp lock: ffff8cb7c4c39400/0xf4f48ce5e1bbfe40 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xf4f48ce5e1bbfe47 expref: -99 pid: 14310 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789049577.874613:0:14310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb8f7b91880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:817823bd-3ba1-432d-9714-f03a15bff403:14310:1875954110648192:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789049577.874634:0:14310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789049577.874652:0:14310:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cb8c5975240 going to sleep for 11 seconds 00000100:00100000:1.0:1789049577.874733:0:14321:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954110648192 00000100:00100000:1.0:1789049577.874737:0:14321:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954110648192 00000100:00100000:1.0:1789049577.874762:0:14321:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1789049577.874768:0:14321:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8f7989450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:817823bd-3ba1-432d-9714-f03a15bff403+12:14310:x1875954110648192:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789049577.875101:0:14321:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8f7989450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:817823bd-3ba1-432d-9714-f03a15bff403+12:14310:x1875954110648192:12345-0@lo:501:mount.lustre.0 Request processed in 332us (465us total) trans 0 rc 0/0 00000100:00100000:1.0:1789049577.875108:0:14321:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1789049577.875181:0:14310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb8f7b91880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:817823bd-3ba1-432d-9714-f03a15bff403:14310:1875954110648192:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789049577.875204:0:14310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb8f7b91880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:817823bd-3ba1-432d-9714-f03a15bff403:14310:1875954110648320:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1789049577.875235:0:14310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789049577.875259:0:14310:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cb8c5975240 going to sleep for 11 seconds 00000100:00100000:1.0:1789049577.875333:0:14323:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954110648320 00000100:00100000:1.0:1789049577.875337:0:14323:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954110648320 00000100:00100000:1.0:1789049577.875363:0:14323:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1789049577.875369:0:14323:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8f7988050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:817823bd-3ba1-432d-9714-f03a15bff403+12:14310:x1875954110648320:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1789049577.875491:0:14323:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8f7988050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:817823bd-3ba1-432d-9714-f03a15bff403+12:14310:x1875954110648320:12345-0@lo:503:mount.lustre.0 Request processed in 121us (254us total) trans 0 rc 0/0 00000100:00100000:1.0:1789049577.875497:0:14323:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1789049577.875615:0:14310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb8f7b91880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:817823bd-3ba1-432d-9714-f03a15bff403:14310:1875954110648320:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1789049577.876212:0:14354:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb8f7b91880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:817823bd-3ba1-432d-9714-f03a15bff403:14354:1875954110648448:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789049577.876246:0:14354:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789049577.876272:0:14354:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cb8c5975e40 going to sleep for 11 seconds 00000100:00100000:1.0:1789049577.876311:0:14322:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954110648448 00000100:00100000:1.0:1789049577.876316:0:14322:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954110648448 00000100:00100000:1.0:1789049577.876343:0:14322:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1789049577.876349:0:14322:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8f798a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:817823bd-3ba1-432d-9714-f03a15bff403+12:14354:x1875954110648448:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789049577.876510:0:14322:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8f798a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:817823bd-3ba1-432d-9714-f03a15bff403+12:14354:x1875954110648448:12345-0@lo:502:llog_process_th.0 Request processed in 160us (263us total) trans 0 rc 0/0 00000100:00100000:1.0:1789049577.876523:0:14322:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1789049577.876599:0:14354:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb8f7b91880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:817823bd-3ba1-432d-9714-f03a15bff403:14354:1875954110648448:0@lo:502:llog_process_th.0 00000020:01000004:0.0:1789049577.876649:0:14354:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:0.0:1789049577.876680:0:14354:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (ffff8cb8c595cd40) 00000020:00000080:0.0:1789049577.876700:0:14354:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type lwp with refcount 2 00000020:01000004:0.0:1789049577.876767:0:14354:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8cb8d1a86000 from lustre-MDT0000, refs=4 00000020:01000004:0.0:1789049577.876771:0:14354:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8cb8d1a86000 from lustre-MDT0000, refs=4 00000020:01000004:0.0:1789049577.876774:0:14354:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8cb8d1a86000 4 00010000:00080000:0.0:1789049577.876800:0:14354:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8cb7c4c10800@lustre-MDT0000-lwp-MDT0000: add connection 192.168.206.126@tcp at head 00010000:00010000:0.0:1789049577.879320:0:14354:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-3 is initialized 00000020:00000080:0.0:1789049577.879498:0:14354:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:0.0:1789049577.879536:0:14354:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1789049577.879548:0:14354:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0xf4f48ce5e1bbfe55 00000100:00080000:0.0:1789049577.879558:0:14354:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1789049577.879569:0:14354:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff8cb7c4c10800 using connection 192.168.206.126@tcp/0@lo 00000100:00100000:0.0:1789049577.879603:0:14354:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8cb8f7b91880 x1875954110648576/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1789049577.879682:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb8f7b91880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3307:1875954110648576:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1789049577.879742:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1789049577.879838:0:14354:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:1.0:1789049577.880426:0:14327:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954110648576 00000100:00100000:1.0:1789049577.880435:0:14327:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954110648576 00000100:00100000:1.0:1789049577.880467:0:14327:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1789049577.880485:0:14327:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb7c5c35500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3307:x1875954110648576:12345-0@lo:38:llog_process_th.0 00000100:00100000:1.0:1789049577.880608:0:14327:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb7c5c35500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3307:x1875954110648576:12345-0@lo:38:llog_process_th.0 Request processed in 133us (865us total) trans 0 rc -11/-11 00000100:00100000:1.0:1789049577.880616:0:14327:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1789049577.880840:0:3307:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1789049577.883027:0:3307:0:(import.c:65:import_set_state_nolock()) ffff8cb7c4c10800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1789049577.883034:0:3307:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:3.0:1789049577.883039:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb8f7b91880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3307:1875954110648576:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1789049577.883991:0:14354:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb8f7b92300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:817823bd-3ba1-432d-9714-f03a15bff403:14354:1875954110648704:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789049577.884063:0:14354:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789049577.884105:0:14354:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cb8c59756c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789049577.884120:0:14321:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954110648704 00000100:00100000:3.0:1789049577.884128:0:14321:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954110648704 00000100:00100000:3.0:1789049577.884170:0:14321:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1789049577.884178:0:14321:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8f7988c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:817823bd-3ba1-432d-9714-f03a15bff403+12:14354:x1875954110648704:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789049577.884405:0:14321:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8f7988c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:817823bd-3ba1-432d-9714-f03a15bff403+12:14354:x1875954110648704:12345-0@lo:502:llog_process_th.0 Request processed in 227us (341us total) trans 0 rc 0/0 00000100:00100000:3.0:1789049577.884421:0:14321:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1789049577.884426:0:14354:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb8f7b92300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:817823bd-3ba1-432d-9714-f03a15bff403:14354:1875954110648704:0@lo:502:llog_process_th.0 00000040:00080000:0.0:1789049577.884448:0:14354:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:3.0:1789049577.884542:0:14310:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-41 (rc=0) 10000000:01000000:3.0:1789049577.884561:0:14310:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.126@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1789049577.884574:0:14310:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.126@tcp lock: ffff8cb7c4c39400/0xf4f48ce5e1bbfe40 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf4f48ce5e1bbfe47 expref: -99 pid: 14310 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049577.884585:0:14310:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.126@tcp lock: ffff8cb7c4c39400/0xf4f48ce5e1bbfe40 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf4f48ce5e1bbfe47 expref: -99 pid: 14310 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:3.0:1789049577.884628:0:14310:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:3.0:1789049577.884630:0:14310:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1789049577.884631:0:14310:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789049577.884633:0:14310:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1789049577.884634:0:14310:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789049577.884635:0:14310:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789049577.884637:0:14310:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1789049577.884638:0:14310:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1789049577.884640:0:14310:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789049577.884641:0:14310:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1789049577.884644:0:14310:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020005 00000020:01000004:3.0:1789049577.884646:0:14310:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1789049577.884648:0:14310:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1789049577.884649:0:14310:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789049577.884650:0:14310:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1789049577.884651:0:14310:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789049577.884652:0:14310:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789049577.884653:0:14310:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1789049577.884654:0:14310:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1789049577.884655:0:14310:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789049577.884655:0:14310:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1789049577.884669:0:14310:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:3.0:1789049577.884679:0:14310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb7c5c35180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:817823bd-3ba1-432d-9714-f03a15bff403:14310:1875954110648832:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1789049577.884709:0:14310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789049577.888055:0:14310:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cb8ff336600 going to sleep for 11 seconds 00000100:00100000:0.0:1789049577.890693:0:14323:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954110648832 00000100:00100000:0.0:1789049577.890705:0:14323:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954110648832 00000100:00100000:0.0:1789049577.890750:0:14323:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1789049577.890759:0:14323:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8f7989050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:817823bd-3ba1-432d-9714-f03a15bff403+12:14310:x1875954110648832:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1789049577.890797:0:14323:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:0.0:1789049577.890809:0:14323:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:0.0:1789049577.932448:0:14323:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1789049577.932514:0:14323:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:2.0:1789049577.933166:0:14343:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1789049577.933179:0:14343:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:2.0:1789049577.933200:0:14343:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8cb900e62a00/0xf4f48ce5e1bbfe5c lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14343 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049577.933218:0:14343:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8cb8c6b35a00/0xf4f48ce5e1bbfe2b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf4f48ce5e1bbfe24 expref: 12 pid: 14322 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049577.933226:0:14343:0:(ldlm_resource.c:1751:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8cb900e62a00/0xf4f48ce5e1bbfe5c lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14343 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049577.933265:0:14343:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8cb8c6b35a00/0xf4f48ce5e1bbfe2b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf4f48ce5e1bbfe24 expref: 12 pid: 14322 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049577.933280:0:14343:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8cb8c6b35a00/0xf4f48ce5e1bbfe2b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf4f48ce5e1bbfe24 expref: 12 pid: 14322 timeout: 503 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789049577.933293:0:14343:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb900e97100 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14343:1875954110648960:0@lo:104: 00000100:00100000:2.0:1789049577.933353:0:14343:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789049577.933398:0:14343:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cb8d0b1be40 going to sleep for 11 seconds 00000100:00100000:0.0:1789049577.933537:0:14311:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954110648960 00000100:00100000:0.0:1789049577.933545:0:14311:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954110648960 00000100:00100000:0.0:1789049577.933589:0:14311:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1789049577.933599:0:14311:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb900e97b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:817823bd-3ba1-432d-9714-f03a15bff403+3:14343:x1875954110648960:12345-0@lo:104: 00010000:00010000:0.0:1789049577.933611:0:14311:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.126@tcp lock: ffff8cb7c4c38c00/0xf4f48ce5e1bbfe24 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xf4f48ce5e1bbfe2b expref: -99 pid: 14310 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049577.933673:0:14311:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1789049577.933679:0:14311:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb900e97b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:817823bd-3ba1-432d-9714-f03a15bff403+3:14343:x1875954110648960:12345-0@lo:104: Request processed in 83us (327us total) trans 0 rc 0/0 00000100:00100000:0.0:1789049577.933686:0:14311:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00010000:0.0:1789049577.933706:0:14317:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789049577.933712:0:14317:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.126@tcp lock: ffff8cb7c4c38c00/0xf4f48ce5e1bbfe24 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xf4f48ce5e1bbfe2b expref: -99 pid: 14310 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049577.933719:0:14317:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cb7c4c38c00 already unused, calling callback (ffffffffc1ca3c20) 10000000:00010000:0.0:1789049577.933722:0:14317:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.126@tcp lock: ffff8cb7c4c38c00/0xf4f48ce5e1bbfe24 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xf4f48ce5e1bbfe2b expref: -99 pid: 14310 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049577.933731:0:14317:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.126@tcp lock: ffff8cb7c4c38c00/0xf4f48ce5e1bbfe24 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xf4f48ce5e1bbfe2b expref: -99 pid: 14310 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789049577.933738:0:14317:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.126@tcp lock: ffff8cb7c4c38c00/0xf4f48ce5e1bbfe24 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xf4f48ce5e1bbfe2b expref: -99 pid: 14310 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789049577.933744:0:14317:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1789049577.933769:0:14317:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.126@tcp lock: ffff8cb7c4c38c00/0xf4f48ce5e1bbfe24 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf4f48ce5e1bbfe2b expref: -99 pid: 14310 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049577.933776:0:14317:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789049577.933801:0:14317:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.126@tcp lock: ffff8cb7c4c38c00/0xf4f48ce5e1bbfe24 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf4f48ce5e1bbfe2b expref: -99 pid: 14310 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049577.933808:0:14317:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.126@tcp lock: ffff8cb7c4c38c00/0xf4f48ce5e1bbfe24 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf4f48ce5e1bbfe2b expref: -99 pid: 14310 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049577.933832:0:14317:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789049577.933834:0:14317:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789049577.933836:0:14317:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789049577.933889:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb8f7b92300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:817823bd-3ba1-432d-9714-f03a15bff403:3311:1875954110649088:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789049577.933918:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789049577.933957:0:14313:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954110649088 00000100:00100000:0.0:1789049577.933961:0:14313:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954110649088 00010000:00010000:0.0:1789049577.933977:0:14313:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8cb8c6b35a00/0xf4f48ce5e1bbfe2b lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf4f48ce5e1bbfe24 expref: 13 pid: 14322 timeout: 503 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789049577.933998:0:14313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1789049577.934004:0:14313:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8f7b92680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:817823bd-3ba1-432d-9714-f03a15bff403+13:3311:x1875954110649088:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789049577.934014:0:14313:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789049577.934018:0:14313:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8cb8c6b35a00/0xf4f48ce5e1bbfe2b lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf4f48ce5e1bbfe24 expref: 13 pid: 14322 timeout: 503 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049577.934027:0:14313:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8cb8c6b35a00/0xf4f48ce5e1bbfe2b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf4f48ce5e1bbfe24 expref: 13 pid: 14322 timeout: 503 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049577.934041:0:14313:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8cb900e62a00/0xf4f48ce5e1bbfe5c lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 14343 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049577.934049:0:14313:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cb900e62a00/0xf4f48ce5e1bbfe5c lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 14343 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1789049577.934070:0:14313:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.000892003s 00010000:00010000:0.0:1789049577.934075:0:14313:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8cb900e62a00/0xf4f48ce5e1bbfe5c lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14343 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049577.934082:0:14313:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8cb900e62a00/0xf4f48ce5e1bbfe5c lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14343 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049577.934089:0:14313:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8cb900e62a00/0xf4f48ce5e1bbfe5c lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14343 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049577.934096:0:14313:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8cb900e62a00/0xf4f48ce5e1bbfe5c lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14343 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049577.934101:0:14313:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cb900e62a00 already unused, calling callback (ffffffffc166a8f0) 00010000:00010000:0.0:1789049577.934105:0:14313:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8cb900e62a00/0xf4f48ce5e1bbfe5c lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14343 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049577.934112:0:14313:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8cb900e62a00/0xf4f48ce5e1bbfe5c lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14343 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049577.934120:0:14313:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8cb900e62a00/0xf4f48ce5e1bbfe5c lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14343 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049577.934129:0:14313:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789049577.934159:0:14313:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8f7b92680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:817823bd-3ba1-432d-9714-f03a15bff403+13:3311:x1875954110649088:12345-0@lo:103:ldlm_bl.0 Request processed in 155us (241us total) trans 0 rc 0/0 00000100:00100000:0.0:1789049577.934166:0:14313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1789049577.934200:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb8f7b92300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:817823bd-3ba1-432d-9714-f03a15bff403:3311:1875954110649088:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789049577.934315:0:14343:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cb8c6b35a00/0xf4f48ce5e1bbfe2b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf4f48ce5e1bbfe24 expref: 12 pid: 14322 timeout: 503 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789049577.934326:0:14343:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb900e97100 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14343:1875954110648960:0@lo:104: 00010000:00010000:3.0:1789049577.934340:0:14343:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8cb900e62a00/0xf4f48ce5e1bbfe5c lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14343 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049577.934348:0:14343:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8cb900e62a00/0xf4f48ce5e1bbfe5c lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14343 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049577.934354:0:14343:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8cb900e62a00/0xf4f48ce5e1bbfe5c lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14343 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049577.934361:0:14343:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cb900e62a00/0xf4f48ce5e1bbfe5c lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14343 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789049577.942664:0:14323:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8f7989050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:817823bd-3ba1-432d-9714-f03a15bff403+11:14310:x1875954110648832:12345-0@lo:253:mount.lustre.0 Request processed in 51899us (57946us total) trans 0 rc 0/0 00000100:00100000:2.0:1789049577.942679:0:14323:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1789049577.942738:0:14310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb7c5c35180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:817823bd-3ba1-432d-9714-f03a15bff403:14310:1875954110648832:0@lo:253:mount.lustre.0 10000000:01000000:3.0:1789049577.942753:0:14310:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:3.0:1789049577.942756:0:14310:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1789049577.942758:0:14310:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1789049577.942760:0:14310:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789049577.942761:0:14310:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1789049577.942762:0:14310:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789049577.942764:0:14310:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789049577.942765:0:14310:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1789049577.942767:0:14310:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1789049577.942772:0:14310:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789049577.942774:0:14310:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:3.0:1789049577.942790:0:14310:0:(tgt_mount.c:2694:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:3.0:1789049577.949153:0:14310:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/8/4) registered 00080000:10000000:3.0:1789049577.949317:0:14310:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:3.0:1789049577.949691:0:14310:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/8/4) registered 00080000:10000000:3.0:1789049577.950103:0:14310:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:3.0:1789049577.950467:0:14310:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/8/4) registered 00080000:10000000:3.0:1789049577.950637:0:14310:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00080000:10000000:1.0:1789049577.951533:0:14310:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/8/4) registered 00080000:10000000:1.0:1789049577.951696:0:14310:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8/1) registered 00080000:10000000:1.0:1789049577.952105:0:14310:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/8/4) registered 00080000:10000000:1.0:1789049577.952290:0:14310:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8/1) registered 00080000:10000000:1.0:1789049577.952597:0:14310:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xf:0x0] (8/8/4) registered 00080000:10000000:1.0:1789049577.952752:0:14310:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8/1) registered 00000020:00080000:0.0:1789049577.980266:0:14310:0:(update_trans.c:1496:distribute_txn_commit_batchid_init()) lustre-MDT0000: committed batchid 8 00000040:01000000:3.0:1789049577.981074:0:14310:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000040:01000000:3.0:1789049577.981367:0:14367:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000040:00080000:3.0:1789049577.981446:0:14367:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1789049577.983133:0:14367:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00000004:00080000:3.0:1789049577.983210:0:14367:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000004:00080000:3.0:1789049577.983214:0:14367:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00000040:01000000:1.0:1789049577.985072:0:14310:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:1.0:1789049577.985194:0:14310:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:1.0:1789049577.985616:0:14310:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:1.0:1789049577.985624:0:14310:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:1.0:1789049577.985741:0:14310:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000020:00080000:0.0:1789049577.986720:0:14366:0:(update_trans.c:1538:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 8 00000020:00080000:0.0:1789049577.986725:0:14366:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000040:00080000:1.0:1789049577.987240:0:14310:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:1.0:1789049577.989280:0:14310:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:1.0:1789049577.989348:0:14310:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00080000:10000000:1.0:1789049577.991341:0:14310:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x36:0x0] (8/8/4) registered 00000001:00000004:1.0:1789049577.996424:0:14310:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934592 00000001:00080000:3.0:1789049578.025714:0:14310:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:3.0:1789049578.025750:0:14310:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffac750166f988 00100000:10000000:3.0:1789049578.025758:0:14310:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000020:01000004:3.0:1789049578.026917:0:14310:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:3.0:1789049578.026934:0:14310:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.206.126@tcp: cl_mgc_mutex unlock 00000020:01000004:3.0:1789049578.026946:0:14310:0:(tgt_mount.c:2460:server_fill_super_common()) Server sb, dev=46 00000080:00000004:3.0:1789049578.026970:0:14310:0:(super25.c:182:lustre_fill_super()) lustre-mdt1/mdt1: Mount complete 00010000:00010000:0.0:1789049578.592572:0:14316:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1789049578.788412:0:14325:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1789049578.788420:0:14325:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8cb8d1a86000 from 6 10000000:01000000:1.0:1789049578.788424:0:14325:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1789049578.788465:0:14325:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.126@tcp lock: ffff8cb8c28c2200/0xf4f48ce5e1bbfe63 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14325 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049578.788498:0:14325:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.126@tcp lock: ffff8cb8c28c2200/0xf4f48ce5e1bbfe63 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14325 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049578.788510:0:14325:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.126@tcp lock: ffff8cb8c28c2200/0xf4f48ce5e1bbfe63 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14325 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789049578.788535:0:14325:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb900e42a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:817823bd-3ba1-432d-9714-f03a15bff403:14325:1875954110649216:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1789049578.788600:0:14325:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789049578.788650:0:14325:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cb8c5761c00 going to sleep for 11 seconds 00000100:00100000:2.0:1789049578.788699:0:14322:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954110649216 00000100:00100000:2.0:1789049578.788708:0:14322:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954110649216 00000100:00100000:2.0:1789049578.788760:0:14322:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1789049578.788768:0:14322:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8f798ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:817823bd-3ba1-432d-9714-f03a15bff403+11:14325:x1875954110649216:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789049578.788782:0:14322:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789049578.788794:0:14322:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cb900e62800/0xf4f48ce5e1bbfe6a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xf4f48ce5e1bbfe63 expref: -99 pid: 14322 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049578.788828:0:14322:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cb900e62800/0xf4f48ce5e1bbfe6a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf4f48ce5e1bbfe63 expref: 12 pid: 14322 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049578.788838:0:14322:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cb900e62800/0xf4f48ce5e1bbfe6a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf4f48ce5e1bbfe63 expref: 12 pid: 14322 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049578.788871:0:14322:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cb900e62800, rc 0) 00000100:00100000:2.0:1789049578.788913:0:14322:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8f798ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:817823bd-3ba1-432d-9714-f03a15bff403+12:14325:x1875954110649216:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 145us (312us total) trans 0 rc 0/0 00000100:00100000:2.0:1789049578.788920:0:14322:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1789049578.788962:0:14325:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb900e42a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:817823bd-3ba1-432d-9714-f03a15bff403:14325:1875954110649216:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789049578.788976:0:14325:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.126@tcp lock: ffff8cb8c28c2200/0xf4f48ce5e1bbfe63 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf4f48ce5e1bbfe6a expref: -99 pid: 14325 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049578.788984:0:14325:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.126@tcp lock: ffff8cb8c28c2200/0xf4f48ce5e1bbfe63 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xf4f48ce5e1bbfe6a expref: -99 pid: 14325 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789049578.789032:0:14325:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb900e96300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:817823bd-3ba1-432d-9714-f03a15bff403:14325:1875954110649344:0@lo:256:ll_cfg_requeue.0 00000100:00100000:2.0:1789049578.789062:0:14325:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789049578.789077:0:14325:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cb8d00da780 going to sleep for 11 seconds 00000100:00100000:2.0:1789049578.789090:0:14323:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954110649344 00000100:00100000:2.0:1789049578.789094:0:14323:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954110649344 00000100:00100000:2.0:1789049578.789115:0:14323:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1789049578.789121:0:14323:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8f798b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:817823bd-3ba1-432d-9714-f03a15bff403+12:14325:x1875954110649344:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:2.0:1789049578.789134:0:14323:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1789049578.789161:0:14323:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1789049578.789168:0:14323:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 6 00000100:00100000:2.0:1789049578.789240:0:14323:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8f798b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:817823bd-3ba1-432d-9714-f03a15bff403+12:14325:x1875954110649344:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 119us (177us total) trans 0 rc 0/0 00000100:00100000:2.0:1789049578.789247:0:14323:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1789049578.789290:0:14325:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb900e96300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:817823bd-3ba1-432d-9714-f03a15bff403:14325:1875954110649344:0@lo:256:ll_cfg_requeue.0 10000000:01000000:2.0:1789049578.789325:0:14325:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.126@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1789049578.789332:0:14325:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.126@tcp lock: ffff8cb8c28c2200/0xf4f48ce5e1bbfe63 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf4f48ce5e1bbfe6a expref: -99 pid: 14325 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049578.789340:0:14325:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.126@tcp lock: ffff8cb8c28c2200/0xf4f48ce5e1bbfe63 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf4f48ce5e1bbfe6a expref: -99 pid: 14325 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1789049578.907837:0:14362:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1789049579.622053:0:14317:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1789049579.932836:0:14362:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1789049580.635189:0:14316:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789049581.662437:0:14317:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1789049582.473571:0:14609:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg626-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:3.0:1789049582.687770:0:14316:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1789049583.003483:0:12636:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1789049583.003489:0:12636:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1789049583.003492:0:12636:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1789049583.003495:0:12636:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1789049583.003497:0:12636:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:1.0:1789049583.003500:0:12636:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1789049583.003503:0:12636:0:(import.c:65:import_set_state_nolock()) ffff8cb7c4c10800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1789049583.003517:0:12636:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff8cb7c4c10800 using connection 192.168.206.126@tcp/0@lo 00000100:00100000:1.0:1789049583.003538:0:12636:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8cb900e43480 x1875954110649600/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1789049583.003616:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb900e43b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:817823bd-3ba1-432d-9714-f03a15bff403:3308:1875954110649472:0@lo:400:kworker.0 00000100:00100000:3.0:1789049583.003680:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789049583.003744:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb900e43480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3307:1875954110649600:0@lo:38:kworker.0 00000100:00100000:3.0:1789049583.003771:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789049583.003955:0:14329:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954110649600 00000100:00100000:3.0:1789049583.003962:0:14329:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954110649600 00000100:00100000:3.0:1789049583.003991:0:14329:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1789049583.003999:0:14329:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb7c5c35180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3307:x1875954110649600:12345-0@lo:38:kworker.0 00010000:00080000:3.0:1789049583.004022:0:14329:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo t0 exp 0000000000000000 cur 409 last 0 00000020:00000080:3.0:1789049583.004144:0:14329:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0xf4f48ce5e1bbfe71 00000004:00100000:3.0:1789049583.004242:0:14329:0:(mdt_handler.c:7315:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1789049583.004363:0:14329:0:(import.c:65:import_set_state_nolock()) ffff8cb7c4c44800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1789049583.004414:0:14329:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb7c5c35180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1875954110649600:12345-0@lo:38:kworker.0 Request processed in 414us (642us total) trans 0 rc 0/0 00000100:00100000:3.0:1789049583.004421:0:14329:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:3.0:1789049583.004470:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff8cb900e43480 x1875954110649600/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1789049593 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1789049583.004484:0:3307:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 2 00000100:00080000:3.0:1789049583.004490:0:3307:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:3.0:1789049583.004494:0:3307:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:3.0:1789049583.004496:0:3307:0:(import.c:65:import_set_state_nolock()) ffff8cb7c4c10800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1789049583.004502:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb900e43480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3307:1875954110649600:0@lo:38:kworker.0 00000100:00100000:1.0:1789049583.004690:0:14323:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954110649472 00000100:00100000:1.0:1789049583.004695:0:14323:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954110649472 00000100:00100000:1.0:1789049583.004731:0:14323:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1789049583.004739:0:14323:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8f7989850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:817823bd-3ba1-432d-9714-f03a15bff403+12:3308:x1875954110649472:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789049583.004782:0:14323:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8f7989850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:817823bd-3ba1-432d-9714-f03a15bff403+12:3308:x1875954110649472:12345-0@lo:400:kworker.0 Request processed in 45us (1102us total) trans 0 rc 0/0 00000100:00100000:1.0:1789049583.004789:0:14323:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1789049583.005428:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb900e43b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:817823bd-3ba1-432d-9714-f03a15bff403:3308:1875954110649472:0@lo:400:kworker.0 00010000:00010000:1.0:1789049583.709299:0:14317:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789049584.731076:0:14316:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1789049585.413028:0:14761:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffd112f13b0 20000000:00000080:0.0:1789049585.413047:0:14761:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff8cb901bf4000 uarg=0000000000000000 20000000:01000000:0.0:1789049585.413076:0:14761:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='debug_raw_pointers=Y' 20000000:01000000:0.0:1789049585.413083:0:14761:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'debug_raw_pointers=Y' 20000000:01000000:0.0:1789049585.413087:0:14761:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/debug_raw_pointers=Y del=0 00000040:00080000:3.0:1789049585.418343:0:14762:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 2 count 10 20000000:00000400:1.0:1789049585.418549:0:14761:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/debug_raw_pointers=Y (mode = 0) failed: rc = -17 10000000:01000000:1.0:1789049585.433411:0:14761:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:1.0:1789049585.433453:0:14761:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8cb8c28c2400/0xf4f48ce5e1bbfe78 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049585.433472:0:14761:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8cb8c6b34000/0xf4f48ce5e1bbfe39 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf4f48ce5e1bbfe32 expref: 11 pid: 14322 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049585.433489:0:14761:0:(ldlm_resource.c:1751:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8cb8c28c2400/0xf4f48ce5e1bbfe78 lrc: 4/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049585.433530:0:14761:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8cb8c6b34000/0xf4f48ce5e1bbfe39 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf4f48ce5e1bbfe32 expref: 11 pid: 14322 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049585.433545:0:14761:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8cb8c6b34000/0xf4f48ce5e1bbfe39 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf4f48ce5e1bbfe32 expref: 11 pid: 14322 timeout: 511 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789049585.433559:0:14761:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb900e41500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:14761:1875954110649728:0@lo:104: 00000100:00100000:1.0:1789049585.433619:0:14761:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789049585.433672:0:14761:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cb8d0ccd240 going to sleep for 11 seconds 00000100:00100000:2.0:1789049585.433901:0:14312:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954110649728 00000100:00100000:2.0:1789049585.434293:0:14312:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954110649728 00000100:00100000:2.0:1789049585.434346:0:14312:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1789049585.434357:0:14312:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb900e41180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:817823bd-3ba1-432d-9714-f03a15bff403+3:14761:x1875954110649728:12345-0@lo:104: 00010000:00010000:2.0:1789049585.434370:0:14312:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.126@tcp lock: ffff8cb7c4c39a00/0xf4f48ce5e1bbfe32 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xf4f48ce5e1bbfe39 expref: -99 pid: 14310 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049585.434596:0:14312:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1789049585.434603:0:14312:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb900e41180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:817823bd-3ba1-432d-9714-f03a15bff403+3:14761:x1875954110649728:12345-0@lo:104: Request processed in 248us (984us total) trans 0 rc 0/0 00000100:00100000:2.0:1789049585.434611:0:14312:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00010000:3.0:1789049585.434665:0:14317:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789049585.434673:0:14317:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.126@tcp lock: ffff8cb7c4c39a00/0xf4f48ce5e1bbfe32 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xf4f48ce5e1bbfe39 expref: -99 pid: 14310 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049585.434680:0:14317:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cb7c4c39a00 already unused, calling callback (ffffffffc1ca3c20) 10000000:00010000:3.0:1789049585.434684:0:14317:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.126@tcp lock: ffff8cb7c4c39a00/0xf4f48ce5e1bbfe32 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xf4f48ce5e1bbfe39 expref: -99 pid: 14310 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049585.434692:0:14317:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.126@tcp lock: ffff8cb7c4c39a00/0xf4f48ce5e1bbfe32 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xf4f48ce5e1bbfe39 expref: -99 pid: 14310 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789049585.434714:0:14317:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.126@tcp lock: ffff8cb7c4c39a00/0xf4f48ce5e1bbfe32 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xf4f48ce5e1bbfe39 expref: -99 pid: 14310 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789049585.434720:0:14317:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1789049585.434757:0:14317:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.126@tcp lock: ffff8cb7c4c39a00/0xf4f48ce5e1bbfe32 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf4f48ce5e1bbfe39 expref: -99 pid: 14310 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049585.434763:0:14317:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789049585.434795:0:14317:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.126@tcp lock: ffff8cb7c4c39a00/0xf4f48ce5e1bbfe32 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf4f48ce5e1bbfe39 expref: -99 pid: 14310 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049585.434802:0:14317:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.126@tcp lock: ffff8cb7c4c39a00/0xf4f48ce5e1bbfe32 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf4f48ce5e1bbfe39 expref: -99 pid: 14310 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049585.434818:0:14317:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789049585.434820:0:14317:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789049585.434822:0:14317:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789049585.434833:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb7c5c34000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:817823bd-3ba1-432d-9714-f03a15bff403:3309:1875954110649856:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789049585.434881:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789049585.435054:0:14313:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954110649856 00000100:00100000:3.0:1789049585.435059:0:14313:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954110649856 00010000:00010000:3.0:1789049585.435080:0:14313:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8cb8c6b34000/0xf4f48ce5e1bbfe39 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf4f48ce5e1bbfe32 expref: 12 pid: 14322 timeout: 511 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789049585.435102:0:14313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1789049585.435109:0:14313:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb7c5c35f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:817823bd-3ba1-432d-9714-f03a15bff403+12:3309:x1875954110649856:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789049585.435119:0:14313:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789049585.435124:0:14313:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8cb8c6b34000/0xf4f48ce5e1bbfe39 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf4f48ce5e1bbfe32 expref: 12 pid: 14322 timeout: 511 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049585.435141:0:14313:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8cb8c6b34000/0xf4f48ce5e1bbfe39 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf4f48ce5e1bbfe32 expref: 12 pid: 14322 timeout: 511 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049585.435158:0:14313:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8cb8c28c2400/0xf4f48ce5e1bbfe78 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 14761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049585.435165:0:14313:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cb8c28c2400/0xf4f48ce5e1bbfe78 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 14761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049585.435180:0:14313:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8cb8c28c2400/0xf4f48ce5e1bbfe78 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049585.435188:0:14313:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8cb8c28c2400/0xf4f48ce5e1bbfe78 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049585.435194:0:14313:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8cb8c28c2400/0xf4f48ce5e1bbfe78 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049585.435200:0:14313:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8cb8c28c2400/0xf4f48ce5e1bbfe78 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049585.435205:0:14313:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cb8c28c2400 already unused, calling callback (ffffffffc166a8f0) 00010000:00010000:3.0:1789049585.435210:0:14313:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8cb8c28c2400/0xf4f48ce5e1bbfe78 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049585.435217:0:14313:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8cb8c28c2400/0xf4f48ce5e1bbfe78 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049585.435226:0:14313:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8cb8c28c2400/0xf4f48ce5e1bbfe78 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049585.435247:0:14313:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789049585.435278:0:14313:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb7c5c35f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:817823bd-3ba1-432d-9714-f03a15bff403+12:3309:x1875954110649856:12345-0@lo:103:ldlm_bl.0 Request processed in 169us (396us total) trans 0 rc 0/0 00000100:00100000:3.0:1789049585.435285:0:14313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1789049585.435317:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb7c5c34000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:817823bd-3ba1-432d-9714-f03a15bff403:3309:1875954110649856:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789049585.436634:0:14761:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cb8c6b34000/0xf4f48ce5e1bbfe39 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf4f48ce5e1bbfe32 expref: 11 pid: 14322 timeout: 511 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789049585.436649:0:14761:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb900e41500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:14761:1875954110649728:0@lo:104: 00010000:00010000:1.0:1789049585.436667:0:14761:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8cb8c28c2400/0xf4f48ce5e1bbfe78 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049585.436688:0:14761:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8cb8c28c2400/0xf4f48ce5e1bbfe78 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049585.436695:0:14761:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8cb8c28c2400/0xf4f48ce5e1bbfe78 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049585.436701:0:14761:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cb8c28c2400/0xf4f48ce5e1bbfe78 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049585.754979:0:14316:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1789049586.778965:0:14325:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1789049586.778972:0:14325:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8cb8d1a86000 from 10 10000000:01000000:2.0:1789049586.778978:0:14325:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1789049586.779023:0:14325:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.126@tcp lock: ffff8cb900e63a00/0xf4f48ce5e1bbfe7f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14325 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049586.779051:0:14325:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.126@tcp lock: ffff8cb900e63a00/0xf4f48ce5e1bbfe7f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14325 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049586.779062:0:14325:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.126@tcp lock: ffff8cb900e63a00/0xf4f48ce5e1bbfe7f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14325 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789049586.779087:0:14325:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb900e96300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:817823bd-3ba1-432d-9714-f03a15bff403:14325:1875954110649984:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1789049586.779157:0:14325:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789049586.779210:0:14325:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cb8df429180 going to sleep for 11 seconds 00000100:00100000:1.0:1789049586.779403:0:14321:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954110649984 00000100:00100000:1.0:1789049586.779410:0:14321:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954110649984 00000100:00100000:1.0:1789049586.779467:0:14321:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1789049586.779484:0:14321:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb900dc5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:817823bd-3ba1-432d-9714-f03a15bff403+11:14325:x1875954110649984:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789049586.779497:0:14321:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789049586.779510:0:14321:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cb8c28c2c00/0xf4f48ce5e1bbfe86 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xf4f48ce5e1bbfe7f expref: -99 pid: 14321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049586.779531:0:14321:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cb8c28c2c00/0xf4f48ce5e1bbfe86 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf4f48ce5e1bbfe7f expref: 12 pid: 14321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049586.779542:0:14321:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cb8c28c2c00/0xf4f48ce5e1bbfe86 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf4f48ce5e1bbfe7f expref: 12 pid: 14321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049586.779550:0:14321:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cb8c28c2c00, rc 0) 00000100:00100000:1.0:1789049586.779593:0:14321:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb900dc5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:817823bd-3ba1-432d-9714-f03a15bff403+12:14325:x1875954110649984:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 118us (436us total) trans 0 rc 0/0 00000100:00100000:1.0:1789049586.779599:0:14321:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1789049586.779914:0:14325:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb900e96300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:817823bd-3ba1-432d-9714-f03a15bff403:14325:1875954110649984:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789049586.779929:0:14325:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.126@tcp lock: ffff8cb900e63a00/0xf4f48ce5e1bbfe7f lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf4f48ce5e1bbfe86 expref: -99 pid: 14325 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049586.779938:0:14325:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.126@tcp lock: ffff8cb900e63a00/0xf4f48ce5e1bbfe7f lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xf4f48ce5e1bbfe86 expref: -99 pid: 14325 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789049586.779994:0:14325:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb7c5c34000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:817823bd-3ba1-432d-9714-f03a15bff403:14325:1875954110650112:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789049586.780024:0:14325:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789049586.780053:0:14325:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cb900bbe900 going to sleep for 11 seconds 00010000:00010000:1.0:1789049586.780199:0:14317:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789049586.780436:0:14322:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954110650112 00000100:00100000:2.0:1789049586.780442:0:14322:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954110650112 00000100:00100000:2.0:1789049586.780489:0:14322:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1789049586.780497:0:14322:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb900dc4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:817823bd-3ba1-432d-9714-f03a15bff403+12:14325:x1875954110650112:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789049586.780866:0:14322:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb900dc4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:817823bd-3ba1-432d-9714-f03a15bff403+12:14325:x1875954110650112:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 369us (840us total) trans 0 rc 0/0 00000100:00100000:2.0:1789049586.780874:0:14322:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1789049586.781075:0:14325:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb7c5c34000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:817823bd-3ba1-432d-9714-f03a15bff403:14325:1875954110650112:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789049586.781110:0:14325:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb7c5c34000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:817823bd-3ba1-432d-9714-f03a15bff403:14325:1875954110650240:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789049586.781150:0:14325:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789049586.781179:0:14325:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cb900bbe900 going to sleep for 11 seconds 00000100:00100000:2.0:1789049586.781541:0:14323:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954110650240 00000100:00100000:2.0:1789049586.781547:0:14323:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954110650240 00000100:00100000:2.0:1789049586.781624:0:14323:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1789049586.781633:0:14323:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb900dc7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:817823bd-3ba1-432d-9714-f03a15bff403+12:14325:x1875954110650240:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789049586.781818:0:14323:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb900dc7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:817823bd-3ba1-432d-9714-f03a15bff403+12:14325:x1875954110650240:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 186us (667us total) trans 0 rc 0/0 00000100:00100000:2.0:1789049586.781826:0:14323:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1789049586.781928:0:14325:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb7c5c34000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:817823bd-3ba1-432d-9714-f03a15bff403:14325:1875954110650240:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1789049586.786154:0:14822:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:3.0:1789049586.786502:0:14325:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:3.0:1789049586.786524:0:14325:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.126@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1789049586.786534:0:14325:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.126@tcp lock: ffff8cb900e63a00/0xf4f48ce5e1bbfe7f lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf4f48ce5e1bbfe86 expref: -99 pid: 14325 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049586.786560:0:14325:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.126@tcp lock: ffff8cb900e63a00/0xf4f48ce5e1bbfe7f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf4f48ce5e1bbfe86 expref: -99 pid: 14325 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789049587.099126:0:3307:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789049577/real 1789049577] req@ffff8cb900e42d80 x1875954110646912/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789049587 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789049587.099164:0:3307:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8cb900e42d80 x1875954110646912/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789049587 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789049587.099176:0:3307:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789049577/real 1789049577] req@ffff8cb8f7b93800 x1875954110646784/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789049587 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789049587.099189:0:3307:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8cb8f7b93800 x1875954110646784/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789049587 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1789049587.099210:0:3307:0:(import.c:65:import_set_state_nolock()) ffff8cb8c3fca000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1789049587.099239:0:3307:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:1.0:1789049587.099243:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb900e42d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3307:1875954110646912:0@lo:8:llog_process_th.0 00000100:00080000:1.0:1789049587.099250:0:3307:0:(import.c:65:import_set_state_nolock()) ffff8cb8c8369000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1789049587.099256:0:3307:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:1.0:1789049587.099259:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb8f7b93800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3307:1875954110646784:0@lo:8:llog_process_th.0 00000100:00080000:2.0:1789049587.099548:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1789049587.099553:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:2.0:1789049587.099571:0:36:0:(import.c:65:import_set_state_nolock()) ffff8cb8c8369000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1789049587.099577:0:36:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 403 00000100:00080000:2.0:1789049587.099583:0:36:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1789049587.099596:0:36:0:(import.c:666:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff8cb8c8369000 using connection 192.168.206.126@tcp/0@lo 00000100:00100000:2.0:1789049587.099618:0:36:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8cb900e97480 x1875954110650496/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1789049587.099631:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1789049587.099635:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1789049587.099637:0:36:0:(import.c:65:import_set_state_nolock()) ffff8cb8c3fca000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1789049587.099640:0:36:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 403 00000100:00080000:2.0:1789049587.099643:0:36:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1789049587.099646:0:36:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff8cb8c3fca000 using connection 192.168.206.126@tcp/0@lo 00000100:00100000:2.0:1789049587.099655:0:36:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8cb900e94e00 x1875954110650624/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1789049587.099717:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb900e95500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3311:1875954110650752:0@lo:400:kworker.0 00000100:00100000:1.0:1789049587.099796:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789049587.099915:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789049587.099921:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb900e96a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:817823bd-3ba1-432d-9714-f03a15bff403:3311:1875954110650368:0@lo:400:kworker.0 00000100:00100000:1.0:1789049587.099953:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789049587.099989:0:14322:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954110650368 00000100:00100000:1.0:1789049587.099998:0:14322:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954110650368 00000100:00100000:1.0:1789049587.100042:0:14322:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1789049587.100050:0:14322:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb900dc6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:817823bd-3ba1-432d-9714-f03a15bff403+12:3311:x1875954110650368:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789049587.100098:0:14322:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb900dc6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:817823bd-3ba1-432d-9714-f03a15bff403+12:3311:x1875954110650368:12345-0@lo:400:kworker.0 Request processed in 48us (143us total) trans 0 rc 0/0 00000100:00100000:1.0:1789049587.100114:0:14322:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1789049587.100166:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb900e96a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:817823bd-3ba1-432d-9714-f03a15bff403:3311:1875954110650368:0@lo:400:kworker.0 00000100:00100000:1.0:1789049587.100181:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb900e97480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3307:1875954110650496:0@lo:8:kworker.0 00000400:00000100:1.0:1789049587.100204:0:3307:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875954110650496 offset 0 length 520: 4 00000100:00100000:1.0:1789049587.100216:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb900e94e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3307:1875954110650624:0@lo:8:kworker.0 00000400:00000100:1.0:1789049587.100234:0:3307:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875954110650624 offset 0 length 520: 4 00000100:00100000:2.0:1789049587.100333:0:14328:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954110650752 00000100:00100000:2.0:1789049587.100338:0:14328:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954110650752 00000100:00100000:2.0:1789049587.100377:0:14328:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1789049587.100384:0:14328:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb900e42d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1875954110650752:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789049587.100437:0:14328:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb900e42d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1875954110650752:12345-0@lo:400:kworker.0 Request processed in 54us (642us total) trans 0 rc 0/0 00000100:00100000:2.0:1789049587.100443:0:14328:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:1.0:1789049587.100576:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff8cb900e95500 x1875954110650752/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789049603 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789049587.100588:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb900e95500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3311:1875954110650752:0@lo:400:kworker.0 00010000:00010000:2.0:1789049587.804092:0:14316:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789049588.833274:0:14317:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1789049589.147676:0:14362:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1789049589.851963:0:14316:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1789049590.480887:0:15010:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:2.0:1789049590.480890:0:15010:0:(obd_mount.c:926:lmd_print()) device: lustre-ost1/ost1 00000080:01200004:2.0:1789049590.481037:0:15010:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff8cb8cdf0e000 00000020:01000004:2.0:1789049590.481051:0:15010:0:(tgt_mount.c:2502:osd_start()) Attempting to start lustre-OST0000, type=osd-zfs, lsifl=200002, mountfl=0 00000020:01000004:2.0:1789049590.481062:0:15010:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-zfs) 00000020:00000080:2.0:1789049590.481079:0:15010:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (ffff8cb900bab380) 00000020:00000080:2.0:1789049590.481094:0:15010:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type osd-zfs with refcount 2 00100000:10000000:2.0:1789049590.507630:0:15010:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:2.0:1789049590.508523:0:15010:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0000: registered index [0x200000001:0x3:0x0] (8/24) 00100000:10000000:2.0:1789049590.510729:0:15010:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:2.0:1789049590.511798:0:15010:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00100000:10000000:2.0:1789049590.512072:0:15010:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0000: registered index [0x200000003:0x3:0x0] (8/32) 00100000:10000000:2.0:1789049590.512446:0:15010:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled lustre-OST0000 under 451: rc = 0 00100000:10000000:2.0:1789049590.512531:0:15010:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled lustre-client under 451: rc = 0 00100000:10000000:2.0:1789049590.512628:0:15010:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled params under 451: rc = 0 00100000:10000000:2.0:1789049590.513048:0:15010:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x20000 under 771: rc = 0 00100000:10000000:2.0:1789049590.513392:0:15010:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x1020000-OST0000 under 771: rc = 0 00100000:10000000:2.0:1789049590.515244:0:15010:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x20000-OST0000 under 771: rc = 0 00100000:10000000:2.0:1789049590.515620:0:15010:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x1020000 under 771: rc = 0 00100000:10000000:3.0:1789049590.516219:0:15010:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x2020000-OST0000 under 771: rc = 0 00100000:10000000:3.0:1789049590.516582:0:15010:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x2020000 under 771: rc = 0 00000020:00000080:3.0:1789049590.517321:0:15010:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:3.0:1789049590.517332:0:15010:0:(osd_handler.c:1574:osd_obd_connect()) connect #0 00000020:00000080:3.0:1789049590.517343:0:15010:0:(genops.c:1384:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0xf4f48ce5e1bbfe94 00000020:01000004:3.0:1789049590.517351:0:15010:0:(tgt_mount.c:2587:server_fill_super()) Found service lustre-OST0000 on device lustre-ost1/ost1 00000020:01000004:3.0:1789049590.517371:0:15010:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.206.126@tcp:Set MGC reconnect 1 10000000:01000000:3.0:1789049590.517374:0:15010:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.206.126@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:3.0:1789049590.517380:0:15010:0:(tgt_mount.c:1808:server_start_targets()) starting target lustre-OST0000 00000020:01000004:3.0:1789049590.517384:0:15010:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD OSS (typ=ost) 00000020:00000080:3.0:1789049590.517479:0:15010:0:(genops.c:413:class_newdev()) Allocate new device OSS (ffff8cb8c62a99c0) 00000020:00000080:3.0:1789049590.517491:0:15010:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type ost with refcount 2 00000100:00100000:3.0:1789049590.518645:0:15010:0:(service.c:155:ptlrpc_grow_req_bufs()) ost: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1789049590.518798:0:15010:0:(service.c:3467:ptlrpc_start_thread()) ost[0] started 0 min 3 max 116 00000100:00100000:3.0:1789049590.518804:0:15010:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost00_000' 00000100:00100000:0.0:1789049590.521616:0:15010:0:(service.c:3467:ptlrpc_start_thread()) ost[0] started 1 min 3 max 116 00000100:00100000:0.0:1789049590.521626:0:15010:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost00_001' 00000100:00100000:3.0:1789049590.522036:0:15010:0:(service.c:3467:ptlrpc_start_thread()) ost[0] started 2 min 3 max 116 00000100:00100000:3.0:1789049590.522043:0:15010:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost00_002' 00000100:00100000:3.0:1789049590.528333:0:15010:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_create: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1789049590.528587:0:15010:0:(service.c:3467:ptlrpc_start_thread()) ost_create[0] started 0 min 2 max 16 00000100:00100000:3.0:1789049590.528593:0:15010:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_create00_000' 00000100:00100000:3.0:1789049590.529464:0:15010:0:(service.c:3467:ptlrpc_start_thread()) ost_create[0] started 1 min 2 max 16 00000100:00100000:3.0:1789049590.529473:0:15010:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_create00_001' 00000100:00100000:3.0:1789049590.572578:0:15010:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1789049590.573117:0:15010:0:(service.c:3467:ptlrpc_start_thread()) ost_io[0] started 0 min 3 max 116 00000100:00100000:3.0:1789049590.573124:0:15010:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_io00_000' 00000100:00100000:3.0:1789049590.577086:0:15010:0:(service.c:3467:ptlrpc_start_thread()) ost_io[0] started 1 min 3 max 116 00000100:00100000:3.0:1789049590.577106:0:15010:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_io00_001' 00000100:00100000:2.0:1789049590.583760:0:15010:0:(service.c:3467:ptlrpc_start_thread()) ost_io[0] started 2 min 3 max 116 00000100:00100000:2.0:1789049590.583773:0:15010:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_io00_002' 00000100:00100000:0.0:1789049590.586241:0:15010:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_seq: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1789049590.587235:0:15010:0:(service.c:3467:ptlrpc_start_thread()) ost_seq[0] started 0 min 2 max 16 00000100:00100000:0.0:1789049590.587242:0:15010:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_seq00_000' 00000100:00100000:0.0:1789049590.587817:0:15010:0:(service.c:3467:ptlrpc_start_thread()) ost_seq[0] started 1 min 2 max 16 00000100:00100000:0.0:1789049590.587825:0:15010:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_seq00_001' 00000100:00100000:3.0:1789049590.640157:0:15010:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1789049590.640347:0:15010:0:(service.c:3467:ptlrpc_start_thread()) ost_out[0] started 0 min 2 max 16 00000100:00100000:3.0:1789049590.640353:0:15010:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_out00_000' 00000100:00100000:3.0:1789049590.642006:0:15010:0:(service.c:3467:ptlrpc_start_thread()) ost_out[0] started 1 min 2 max 16 00000100:00100000:3.0:1789049590.642019:0:15010:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_out00_001' 00000020:00000080:3.0:1789049590.642454:0:15010:0:(obd_config.c:826:class_setup()) finished setup of obd OSS (uuid OSS_uuid) 00000020:01000004:3.0:1789049590.642474:0:15010:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost1/ost1 10000000:01000000:3.0:1789049590.642480:0:15010:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.206.126@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00000040:01000000:3.0:1789049590.665012:0:15010:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.206.126@tcp ctxt 0 is initialized 00000020:01000004:3.0:1789049590.665052:0:15010:0:(tgt_mount.c:1416:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.206.126@tcp, index=0000, flags=0x20002 00000020:01000004:3.0:1789049590.665057:0:15010:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:3.0:1789049590.665058:0:15010:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1789049590.665060:0:15010:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789049590.665061:0:15010:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1789049590.665062:0:15010:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789049590.665064:0:15010:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789049590.665065:0:15010:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1789049590.665067:0:15010:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789049590.665068:0:15010:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1789049590.665072:0:15010:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020002 00000020:01000004:3.0:1789049590.665074:0:15010:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1789049590.665075:0:15010:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1789049590.665076:0:15010:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789049590.665077:0:15010:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1789049590.665078:0:15010:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789049590.665079:0:15010:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789049590.665081:0:15010:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1789049590.665081:0:15010:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789049590.665083:0:15010:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1789049590.665107:0:15010:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:3.0:1789049590.665125:0:15010:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb7c5c34000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:817823bd-3ba1-432d-9714-f03a15bff403:15010:1875954110650880:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1789049590.665202:0:15010:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789049590.665256:0:15010:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cb8d11320c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789049590.665398:0:14323:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954110650880 00000100:00100000:2.0:1789049590.665414:0:14323:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954110650880 00000100:00100000:2.0:1789049590.665471:0:14323:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1789049590.665481:0:14323:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb900dc6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:817823bd-3ba1-432d-9714-f03a15bff403+12:15010:x1875954110650880:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1789049590.665509:0:14323:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:2.0:1789049590.665512:0:14323:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0000 is running on 0@lo 20000000:01000000:2.0:1789049590.665517:0:14323:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:1.0:1789049590.679907:0:14323:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb900dc6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:817823bd-3ba1-432d-9714-f03a15bff403+12:15010:x1875954110650880:12345-0@lo:253:mount.lustre.0 Request processed in 14419us (14696us total) trans 0 rc 0/0 00000100:00100000:1.0:1789049590.679921:0:14323:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1789049590.681123:0:15010:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb7c5c34000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:817823bd-3ba1-432d-9714-f03a15bff403:15010:1875954110650880:0@lo:253:mount.lustre.0 10000000:01000000:3.0:1789049590.681158:0:15010:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:3.0:1789049590.681162:0:15010:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1789049590.681163:0:15010:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1789049590.681165:0:15010:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789049590.681166:0:15010:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1789049590.681167:0:15010:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789049590.681168:0:15010:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789049590.681170:0:15010:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1789049590.681172:0:15010:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789049590.681173:0:15010:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:2.0:1789049590.681304:0:15010:0:(tgt_mount.c:101:server_register_mount()) register mount ffff8cb8cdf0e000 from lustre-OST0000 10000000:01000000:2.0:1789049590.681348:0:15010:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:2.0:1789049590.681351:0:15010:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:2.0:1789049590.681358:0:15010:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff8cb900ba8000 local copy 00010000:00010000:2.0:1789049590.681368:0:15010:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.126@tcp lock: ffff8cb8c6b35e00/0xf4f48ce5e1bbfd8a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf4f48ce5e1bbfd91 expref: -99 pid: 14310 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789049590.681629:0:15010:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb900e97800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:817823bd-3ba1-432d-9714-f03a15bff403:15010:1875954110651008:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789049590.681680:0:15010:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789049590.681781:0:15010:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cb8d0ccd780 going to sleep for 11 seconds 00000100:00100000:1.0:1789049590.682173:0:14321:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954110651008 00000100:00100000:1.0:1789049590.682181:0:14321:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954110651008 00000100:00100000:1.0:1789049590.682267:0:14321:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1789049590.682277:0:14321:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb900dc5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:817823bd-3ba1-432d-9714-f03a15bff403+12:15010:x1875954110651008:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789049590.682553:0:14321:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb900dc5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:817823bd-3ba1-432d-9714-f03a15bff403+12:15010:x1875954110651008:12345-0@lo:501:mount.lustre.0 Request processed in 277us (871us total) trans 0 rc -2/-2 00000100:00100000:1.0:1789049590.682561:0:14321:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1789049590.682643:0:15010:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb900e97800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:817823bd-3ba1-432d-9714-f03a15bff403:15010:1875954110651008:0@lo:501:mount.lustre.0 10000000:01000000:3.0:1789049590.682661:0:15010:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.206.126@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:3.0:1789049590.682878:0:15010:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.206.126@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:3.0:1789049590.682885:0:15010:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.126@tcp lock: ffff8cb8c6b35e00/0xf4f48ce5e1bbfd8a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf4f48ce5e1bbfd91 expref: -99 pid: 14310 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049590.682896:0:15010:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.126@tcp lock: ffff8cb8c6b35e00/0xf4f48ce5e1bbfd8a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf4f48ce5e1bbfd91 expref: -99 pid: 14310 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789049590.682918:0:15010:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff8cb8cdf0e000 10000000:01000000:3.0:1789049590.682922:0:15010:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:3.0:1789049590.682927:0:15010:0:(mgc_request.c:194:do_config_log_add()) do adding config log nodemap-ffff8cb900ba8000 10000000:01000000:3.0:1789049590.682929:0:15010:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 10000000:01000000:3.0:1789049590.682933:0:15010:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff8cb900ba8000 from 1 10000000:01000000:3.0:1789049590.682936:0:15010:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:3.0:1789049590.682962:0:15010:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.126@tcp lock: ffff8cb8c6b34a00/0xf4f48ce5e1bbfea2 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15010 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049590.682970:0:15010:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.126@tcp lock: ffff8cb8c6b34a00/0xf4f48ce5e1bbfea2 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15010 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049590.682980:0:15010:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.126@tcp lock: ffff8cb8c6b34a00/0xf4f48ce5e1bbfea2 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15010 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789049590.683004:0:15010:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb7c5c34000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:817823bd-3ba1-432d-9714-f03a15bff403:15010:1875954110651136:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1789049590.683052:0:15010:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789049590.683761:0:15010:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cb8d11320c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789049590.683998:0:14322:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954110651136 00000100:00100000:2.0:1789049590.684005:0:14322:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954110651136 00000100:00100000:2.0:1789049590.684232:0:14322:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1789049590.684241:0:14322:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb900dc4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:817823bd-3ba1-432d-9714-f03a15bff403+12:15010:x1875954110651136:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1789049590.684255:0:14322:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789049590.684270:0:14322:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cb900e62c00/0xf4f48ce5e1bbfea9 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xf4f48ce5e1bbfea2 expref: -99 pid: 14322 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049590.684292:0:14322:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cb900e62c00/0xf4f48ce5e1bbfea9 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf4f48ce5e1bbfea2 expref: 13 pid: 14322 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049590.684303:0:14322:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cb900e62c00/0xf4f48ce5e1bbfea9 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf4f48ce5e1bbfea2 expref: 13 pid: 14322 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049590.684311:0:14322:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cb900e62c00, rc 0) 00000100:00100000:2.0:1789049590.684355:0:14322:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb900dc4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:817823bd-3ba1-432d-9714-f03a15bff403+13:15010:x1875954110651136:12345-0@lo:101:mount.lustre.0 Request processed in 115us (1302us total) trans 0 rc 0/0 00000100:00100000:2.0:1789049590.684361:0:14322:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1789049590.686229:0:15010:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb7c5c34000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:817823bd-3ba1-432d-9714-f03a15bff403:15010:1875954110651136:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1789049590.686265:0:15010:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.126@tcp lock: ffff8cb8c6b34a00/0xf4f48ce5e1bbfea2 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf4f48ce5e1bbfea9 expref: -99 pid: 15010 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049590.686278:0:15010:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.126@tcp lock: ffff8cb8c6b34a00/0xf4f48ce5e1bbfea2 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xf4f48ce5e1bbfea9 expref: -99 pid: 15010 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789049590.686301:0:15010:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.126@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:3.0:1789049590.686323:0:15010:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.126@tcp lock: ffff8cb8c6b34a00/0xf4f48ce5e1bbfea2 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf4f48ce5e1bbfea9 expref: -99 pid: 15010 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049590.686332:0:15010:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.126@tcp lock: ffff8cb8c6b34a00/0xf4f48ce5e1bbfea2 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf4f48ce5e1bbfea9 expref: -99 pid: 15010 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789049590.686339:0:15010:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:3.0:1789049590.686344:0:15010:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1789049590.686349:0:15010:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:3.0:1789049590.686352:0:15010:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:3.0:1789049590.686380:0:15010:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.126@tcp lock: ffff8cb8c6b35a00/0xf4f48ce5e1bbfeb0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15010 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049590.686387:0:15010:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.126@tcp lock: ffff8cb8c6b35a00/0xf4f48ce5e1bbfeb0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15010 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049590.686397:0:15010:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.126@tcp lock: ffff8cb8c6b35a00/0xf4f48ce5e1bbfeb0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15010 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789049590.686437:0:15010:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb7c5c34000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:817823bd-3ba1-432d-9714-f03a15bff403:15010:1875954110651264:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1789049590.686490:0:15010:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789049590.686530:0:15010:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cb8d11320c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789049590.687102:0:14322:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954110651264 00000100:00100000:2.0:1789049590.687109:0:14322:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954110651264 00000100:00100000:2.0:1789049590.687196:0:14322:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1789049590.687205:0:14322:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb900dc6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:817823bd-3ba1-432d-9714-f03a15bff403+13:15010:x1875954110651264:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1789049590.687219:0:14322:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789049590.687237:0:14322:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cb900e62e00/0xf4f48ce5e1bbfeb7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xf4f48ce5e1bbfeb0 expref: -99 pid: 14322 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049590.687257:0:14322:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cb900e62e00/0xf4f48ce5e1bbfeb7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf4f48ce5e1bbfeb0 expref: 14 pid: 14322 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049590.687268:0:14322:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cb900e62e00/0xf4f48ce5e1bbfeb7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf4f48ce5e1bbfeb0 expref: 14 pid: 14322 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049590.687276:0:14322:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cb900e62e00, rc 0) 00000100:00100000:2.0:1789049590.687326:0:14322:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb900dc6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:817823bd-3ba1-432d-9714-f03a15bff403+14:15010:x1875954110651264:12345-0@lo:101:mount.lustre.0 Request processed in 122us (835us total) trans 0 rc 0/0 00000100:00100000:2.0:1789049590.687333:0:14322:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1789049590.687403:0:15010:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb7c5c34000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:817823bd-3ba1-432d-9714-f03a15bff403:15010:1875954110651264:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1789049590.687426:0:15010:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.126@tcp lock: ffff8cb8c6b35a00/0xf4f48ce5e1bbfeb0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xf4f48ce5e1bbfeb7 expref: -99 pid: 15010 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049590.687435:0:15010:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.126@tcp lock: ffff8cb8c6b35a00/0xf4f48ce5e1bbfeb0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xf4f48ce5e1bbfeb7 expref: -99 pid: 15010 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1789049590.689275:0:15010:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000040:00080000:2.0:1789049590.691149:0:15010:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1789049590.691609:0:15010:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].1, 224 off8416 00000040:00080000:2.0:1789049590.691657:0:15010:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].2, 128 off8544 00000040:00080000:2.0:1789049590.691691:0:15010:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].3, 112 off8656 00000040:00080000:2.0:1789049590.691946:0:15010:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].4, 224 off8880 00000040:00080000:2.0:1789049590.691986:0:15010:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].5, 224 off9104 00000040:00080000:2.0:1789049590.692138:0:15010:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].6, 80 off9184 00000040:00080000:2.0:1789049590.692277:0:15010:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].7, 224 off9408 00000040:00080000:2.0:1789049590.692284:0:15010:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 8 00000100:00100000:2.0:1789049590.692368:0:15010:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb900e94000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:817823bd-3ba1-432d-9714-f03a15bff403:15010:1875954110651392:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789049590.692503:0:15010:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789049590.692593:0:15010:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cb8d0b1b3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789049590.692632:0:14323:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954110651392 00000100:00100000:0.0:1789049590.692640:0:14323:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954110651392 00000100:00100000:0.0:1789049590.692686:0:14323:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1789049590.692694:0:14323:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb900dc4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:817823bd-3ba1-432d-9714-f03a15bff403+14:15010:x1875954110651392:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789049590.693566:0:14323:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb900dc4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:817823bd-3ba1-432d-9714-f03a15bff403+14:15010:x1875954110651392:12345-0@lo:501:mount.lustre.0 Request processed in 870us (1061us total) trans 0 rc 0/0 00000100:00100000:1.0:1789049590.693575:0:14323:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1789049590.693778:0:15010:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb900e94000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:817823bd-3ba1-432d-9714-f03a15bff403:15010:1875954110651392:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789049590.693818:0:15010:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb900e94000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:817823bd-3ba1-432d-9714-f03a15bff403:15010:1875954110651520:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1789049590.693890:0:15010:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789049590.693923:0:15010:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cb8d0b1b3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789049590.694083:0:14322:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954110651520 00000100:00100000:0.0:1789049590.694089:0:14322:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954110651520 00000100:00100000:0.0:1789049590.694122:0:14322:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1789049590.694129:0:14322:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb900dc7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:817823bd-3ba1-432d-9714-f03a15bff403+14:15010:x1875954110651520:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1789049590.694620:0:14322:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb900dc7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:817823bd-3ba1-432d-9714-f03a15bff403+14:15010:x1875954110651520:12345-0@lo:503:mount.lustre.0 Request processed in 490us (728us total) trans 0 rc 0/0 00000100:00100000:0.0:1789049590.694626:0:14322:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1789049590.694691:0:15010:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb900e94000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:817823bd-3ba1-432d-9714-f03a15bff403:15010:1875954110651520:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1789049590.696377:0:15010:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1789049590.696520:0:15010:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb900e94000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:817823bd-3ba1-432d-9714-f03a15bff403:15010:1875954110651648:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1789049590.696587:0:15010:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789049590.700304:0:15010:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cb8d0b1b3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789049590.700506:0:14323:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954110651648 00000100:00100000:1.0:1789049590.700519:0:14323:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954110651648 00000100:00100000:1.0:1789049590.700620:0:14323:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1789049590.700631:0:14323:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb900dc5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:817823bd-3ba1-432d-9714-f03a15bff403+14:15010:x1875954110651648:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1789049590.700958:0:14323:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb900dc5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:817823bd-3ba1-432d-9714-f03a15bff403+14:15010:x1875954110651648:12345-0@lo:502:mount.lustre.0 Request processed in 329us (4370us total) trans 0 rc 0/0 00000100:00100000:1.0:1789049590.700966:0:14323:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1789049590.701063:0:15010:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb900e94000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:817823bd-3ba1-432d-9714-f03a15bff403:15010:1875954110651648:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1789049590.701315:0:15010:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].1, 224 off8416 00000040:00080000:2.0:1789049590.701360:0:15010:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].2, 128 off8544 00000040:00080000:2.0:1789049590.701386:0:15010:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].3, 112 off8656 00000040:00080000:2.0:1789049590.701455:0:15010:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].4, 224 off8880 00000040:00080000:2.0:1789049590.701482:0:15010:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].5, 224 off9104 00000040:00080000:2.0:1789049590.701505:0:15010:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].6, 80 off9184 00000040:00080000:2.0:1789049590.701539:0:15010:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].7, 224 off9408 00000040:00080000:2.0:1789049590.701563:0:15010:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].8, 224 off9632 00000040:00080000:2.0:1789049590.701587:0:15010:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].9, 80 off9712 00000040:00080000:2.0:1789049590.701621:0:15010:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].10, 224 off9936 00000040:00080000:2.0:1789049590.701647:0:15010:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].11, 224 off10160 00000040:00080000:2.0:1789049590.701683:0:15010:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].12, 120 off10280 00000100:00100000:2.0:1789049590.701715:0:15010:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb900e94000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:817823bd-3ba1-432d-9714-f03a15bff403:15010:1875954110651776:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1789049590.701763:0:15010:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789049590.702332:0:15010:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cb8d0b1b3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789049590.702460:0:14322:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954110651776 00000100:00100000:0.0:1789049590.702474:0:14322:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954110651776 00000100:00100000:0.0:1789049590.702508:0:14322:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1789049590.702514:0:14322:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb900dc5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:817823bd-3ba1-432d-9714-f03a15bff403+14:15010:x1875954110651776:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1789049590.702683:0:14322:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb900dc5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:817823bd-3ba1-432d-9714-f03a15bff403+14:15010:x1875954110651776:12345-0@lo:502:mount.lustre.0 Request processed in 168us (919us total) trans 0 rc 0/0 00000100:00100000:0.0:1789049590.702690:0:14322:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1789049590.702780:0:15010:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb900e94000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:817823bd-3ba1-432d-9714-f03a15bff403:15010:1875954110651776:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1789049590.702896:0:15010:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].13, 224 off10504 00000040:00080000:2.0:1789049590.702908:0:15010:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 13 count 14 00000020:01000000:2.0:1789049590.704165:0:15024:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1789049590.704174:0:15024:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-ost1/ost1 00000020:00000080:2.0:1789049590.704246:0:15024:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789049590.704248:0:15024:0:(obd_config.c:1563:class_process_config()) marker 11 (0x1) lustre-OST0000 add ost 00000020:00000080:2.0:1789049590.704259:0:15024:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1789049590.704283:0:15024:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (ffff8cb7c6033380) 00000020:00000080:2.0:1789049590.704304:0:15024:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type obdfilter with refcount 2 00000020:00000080:2.0:1789049590.704309:0:15024:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:2.0:1789049590.704360:0:15024:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8cb8cdf0e000 from lustre-OST0000, refs=2 00080000:01000000:2.0:1789049590.704367:0:15024:0:(osd_handler.c:1574:osd_obd_connect()) connect #1 00000020:00000080:2.0:1789049590.704372:0:15024:0:(genops.c:1384:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0xf4f48ce5e1bbfec5 00010000:00010000:2.0:1789049590.708752:0:15024:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-2 is initialized 00000001:00000004:2.0:1789049590.709676:0:15024:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 4294967324 00080000:10000000:2.0:1789049590.715010:0:15024:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0xb:0x0] (8/8/4) registered 00000020:00000080:0.0:1789049590.716610:0:15024:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:0.0:1789049590.716620:0:15024:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789049590.716625:0:15024:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789049590.716627:0:15024:0:(obd_config.c:1563:class_process_config()) marker 11 (0x2) lustre-OST0000 add ost 00000020:01000000:0.0:1789049590.716630:0:15024:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:0.0:1789049590.716632:0:15024:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #15 00000020:01000000:0.0:1789049590.716633:0:15024:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1789049590.716634:0:15024:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1789049590.716636:0:15024:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:0.0:1789049590.716637:0:15024:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789049590.716639:0:15024:0:(obd_config.c:1563:class_process_config()) marker 15 (0x6) lustre sys.timeout 00000020:01000000:0.0:1789049590.716640:0:15024:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789049590.716643:0:15024:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789049590.716644:0:15024:0:(obd_config.c:1563:class_process_config()) marker 21 (0x1) lustre sys.timeout 00000020:00000080:0.0:1789049590.716646:0:15024:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1789049590.716647:0:15024:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:0.0:1789049590.716649:0:15024:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789049590.716651:0:15024:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789049590.716652:0:15024:0:(obd_config.c:1563:class_process_config()) marker 21 (0x2) lustre sys.timeout 00000020:01000000:0.0:1789049590.716654:0:15024:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789049590.716656:0:15024:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789049590.716657:0:15024:0:(obd_config.c:1563:class_process_config()) marker 25 (0x1) lustre sys.jobid_var 00000020:00000080:0.0:1789049590.716660:0:15024:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:0.0:1789049590.716711:0:15024:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789049590.716714:0:15024:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789049590.716715:0:15024:0:(obd_config.c:1563:class_process_config()) marker 25 (0x2) lustre sys.jobid_var 00000040:00080000:0.0:1789049590.716718:0:15024:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 14 count 14 00000020:01000000:2.0:1789049590.718553:0:15010:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-13 (rc=0) 10000000:01000000:2.0:1789049590.718586:0:15010:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.126@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:2.0:1789049590.718607:0:15010:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.126@tcp lock: ffff8cb8c6b35a00/0xf4f48ce5e1bbfeb0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xf4f48ce5e1bbfeb7 expref: -99 pid: 15010 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049590.718621:0:15010:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.126@tcp lock: ffff8cb8c6b35a00/0xf4f48ce5e1bbfeb0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xf4f48ce5e1bbfeb7 expref: -99 pid: 15010 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789049590.718628:0:15010:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8cb8cdf0e000 from 1 10000000:01000000:2.0:1789049590.718631:0:15010:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1789049590.718667:0:15010:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.126@tcp lock: ffff8cb900e63800/0xf4f48ce5e1bbfecc lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15010 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049590.718674:0:15010:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.126@tcp lock: ffff8cb900e63800/0xf4f48ce5e1bbfecc lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15010 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049590.718685:0:15010:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.126@tcp lock: ffff8cb900e63800/0xf4f48ce5e1bbfecc lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15010 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789049590.718707:0:15010:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb900e94000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:817823bd-3ba1-432d-9714-f03a15bff403:15010:1875954110651904:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1789049590.718767:0:15010:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789049590.718813:0:15010:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cb8c3987780 going to sleep for 11 seconds 00000100:00100000:3.0:1789049590.718911:0:14322:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954110651904 00000100:00100000:3.0:1789049590.718919:0:14322:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954110651904 00000100:00100000:3.0:1789049590.718958:0:14322:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1789049590.718967:0:14322:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb900dc7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:817823bd-3ba1-432d-9714-f03a15bff403+14:15010:x1875954110651904:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1789049590.718980:0:14322:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789049590.718992:0:14322:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cb8c6b35000/0xf4f48ce5e1bbfed3 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xf4f48ce5e1bbfecc expref: -99 pid: 14322 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049590.719013:0:14322:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cb8c6b35000/0xf4f48ce5e1bbfed3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf4f48ce5e1bbfecc expref: 15 pid: 14322 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049590.719022:0:14322:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cb8c6b35000/0xf4f48ce5e1bbfed3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf4f48ce5e1bbfecc expref: 15 pid: 14322 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049590.719029:0:14322:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cb8c6b35000, rc 0) 00000100:00100000:3.0:1789049590.719064:0:14322:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb900dc7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:817823bd-3ba1-432d-9714-f03a15bff403+15:15010:x1875954110651904:12345-0@lo:101:mount.lustre.0 Request processed in 98us (296us total) trans 0 rc 0/0 00000100:00100000:3.0:1789049590.719077:0:14322:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1789049590.720021:0:15010:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb900e94000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:817823bd-3ba1-432d-9714-f03a15bff403:15010:1875954110651904:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1789049590.720040:0:15010:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.126@tcp lock: ffff8cb900e63800/0xf4f48ce5e1bbfecc lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf4f48ce5e1bbfed3 expref: -99 pid: 15010 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049590.720049:0:15010:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.126@tcp lock: ffff8cb900e63800/0xf4f48ce5e1bbfecc lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xf4f48ce5e1bbfed3 expref: -99 pid: 15010 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1789049590.720515:0:15010:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000040:00080000:2.0:1789049590.720768:0:15010:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1789049590.721204:0:15010:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 224 off8416 00000040:00080000:2.0:1789049590.721252:0:15010:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 112 off8528 00000040:00080000:2.0:1789049590.721316:0:15010:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].3, 224 off8752 00000040:00080000:2.0:1789049590.721324:0:15010:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 3 count 4 00000100:00100000:2.0:1789049590.721383:0:15010:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb900e94000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:817823bd-3ba1-432d-9714-f03a15bff403:15010:1875954110652032:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789049590.722089:0:15010:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789049590.722170:0:15010:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cb8c3987780 going to sleep for 11 seconds 00000100:00100000:3.0:1789049590.730040:0:14321:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954110652032 00000100:00100000:3.0:1789049590.730055:0:14321:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954110652032 00000100:00100000:3.0:1789049590.730107:0:14321:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1789049590.730117:0:14321:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb900dc7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:817823bd-3ba1-432d-9714-f03a15bff403+15:15010:x1875954110652032:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789049590.730397:0:14321:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb900dc7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:817823bd-3ba1-432d-9714-f03a15bff403+15:15010:x1875954110652032:12345-0@lo:501:mount.lustre.0 Request processed in 282us (8308us total) trans 0 rc 0/0 00000100:00100000:3.0:1789049590.730415:0:14321:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1789049590.730570:0:15010:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb900e94000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:817823bd-3ba1-432d-9714-f03a15bff403:15010:1875954110652032:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789049590.730611:0:15010:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb900e94000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:817823bd-3ba1-432d-9714-f03a15bff403:15010:1875954110652160:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1789049590.730651:0:15010:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789049590.730687:0:15010:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cb8c3987780 going to sleep for 11 seconds 00000100:00100000:3.0:1789049590.730740:0:14323:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954110652160 00000100:00100000:3.0:1789049590.730744:0:14323:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954110652160 00000100:00100000:3.0:1789049590.730773:0:14323:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1789049590.730781:0:14323:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb900dc6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:817823bd-3ba1-432d-9714-f03a15bff403+15:15010:x1875954110652160:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1789049590.731030:0:14323:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb900dc6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:817823bd-3ba1-432d-9714-f03a15bff403+15:15010:x1875954110652160:12345-0@lo:503:mount.lustre.0 Request processed in 249us (376us total) trans 0 rc 0/0 00000100:00100000:3.0:1789049590.731037:0:14323:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1789049590.731270:0:15010:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb900e94000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:817823bd-3ba1-432d-9714-f03a15bff403:15010:1875954110652160:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1789049590.732198:0:15010:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1789049590.732270:0:15010:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb900e94000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:817823bd-3ba1-432d-9714-f03a15bff403:15010:1875954110652288:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1789049590.732321:0:15010:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789049590.732349:0:15010:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cb8c3987780 going to sleep for 11 seconds 00000100:00100000:3.0:1789049590.732838:0:14323:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954110652288 00000100:00100000:3.0:1789049590.732869:0:14323:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954110652288 00000100:00100000:3.0:1789049590.732920:0:14323:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1789049590.732928:0:14323:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb900dc4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:817823bd-3ba1-432d-9714-f03a15bff403+15:15010:x1875954110652288:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1789049590.733145:0:14323:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb900dc4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:817823bd-3ba1-432d-9714-f03a15bff403+15:15010:x1875954110652288:12345-0@lo:502:mount.lustre.0 Request processed in 217us (822us total) trans 0 rc 0/0 00000100:00100000:3.0:1789049590.733152:0:14323:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1789049590.733924:0:15010:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb900e94000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:817823bd-3ba1-432d-9714-f03a15bff403:15010:1875954110652288:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1789049590.734229:0:15010:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 00000040:00080000:2.0:1789049590.734285:0:15010:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 112 off8528 00000040:00080000:2.0:1789049590.734345:0:15010:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 224 off8752 00000040:00080000:2.0:1789049590.734383:0:15010:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8976 00000040:00080000:2.0:1789049590.734436:0:15010:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 112 off9088 00000040:00080000:2.0:1789049590.734486:0:15010:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 224 off9312 00000040:00080000:2.0:1789049590.734516:0:15010:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9536 00000040:00080000:2.0:1789049590.734539:0:15010:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 128 off9664 00000100:00100000:2.0:1789049590.734571:0:15010:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb900e94000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:817823bd-3ba1-432d-9714-f03a15bff403:15010:1875954110652416:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1789049590.734633:0:15010:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789049590.734670:0:15010:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cb8c3987780 going to sleep for 11 seconds 00000100:00100000:3.0:1789049590.735081:0:14322:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954110652416 00000100:00100000:3.0:1789049590.735088:0:14322:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954110652416 00000100:00100000:3.0:1789049590.735132:0:14322:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1789049590.735139:0:14322:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8d6a27850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:817823bd-3ba1-432d-9714-f03a15bff403+15:15010:x1875954110652416:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1789049590.735299:0:14322:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8d6a27850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:817823bd-3ba1-432d-9714-f03a15bff403+15:15010:x1875954110652416:12345-0@lo:502:mount.lustre.0 Request processed in 160us (665us total) trans 0 rc 0/0 00000100:00100000:3.0:1789049590.735306:0:14322:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1789049590.735488:0:15010:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb900e94000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:817823bd-3ba1-432d-9714-f03a15bff403:15010:1875954110652416:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1789049590.735578:0:15010:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9888 00000040:00080000:2.0:1789049590.735588:0:15010:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 9 count 10 00000020:01000000:3.0:1789049590.741680:0:15028:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789049590.741691:0:15028:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789049590.741693:0:15028:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:3.0:1789049590.741699:0:15028:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8cb8cdf0e000 00000020:00000080:3.0:1789049590.741701:0:15028:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1789049590.741707:0:15028:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789049590.741709:0:15028:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789049590.741710:0:15028:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:3.0:1789049590.741712:0:15028:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789049590.741714:0:15028:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789049590.741715:0:15028:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:3.0:1789049590.741718:0:15028:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8cb8cdf0e000 00000020:00000080:3.0:1789049590.741719:0:15028:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1789049590.741770:0:15028:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789049590.741773:0:15028:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789049590.741774:0:15028:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:3.0:1789049590.741776:0:15028:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789049590.741778:0:15028:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789049590.741779:0:15028:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1789049590.741782:0:15028:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8cb8cdf0e000 00000020:00000080:3.0:1789049590.741783:0:15028:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1789049590.741808:0:15028:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789049590.741811:0:15028:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789049590.741812:0:15028:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:3.0:1789049590.741814:0:15028:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 10 count 10 00000020:01000000:0.0:1789049590.746038:0:15010:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-9 (rc=0) 10000000:01000000:0.0:1789049590.746075:0:15010:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.126@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1789049590.746125:0:15010:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.126@tcp lock: ffff8cb900e63800/0xf4f48ce5e1bbfecc lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf4f48ce5e1bbfed3 expref: -99 pid: 15010 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049590.746138:0:15010:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.126@tcp lock: ffff8cb900e63800/0xf4f48ce5e1bbfecc lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf4f48ce5e1bbfed3 expref: -99 pid: 15010 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789049590.746184:0:15010:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:0.0:1789049590.746187:0:15010:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff8cb8cdf0e000 10000000:01000000:0.0:1789049590.746190:0:15010:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff8cb8cdf0e000 10000000:01000000:0.0:1789049590.746194:0:15010:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1789049590.746199:0:15010:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8cb8cdf0e000 from 1 10000000:01000000:0.0:1789049590.746201:0:15010:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1789049590.746234:0:15010:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.126@tcp lock: ffff8cb7c4c39200/0xf4f48ce5e1bbfeda lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15010 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049590.746242:0:15010:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.126@tcp lock: ffff8cb7c4c39200/0xf4f48ce5e1bbfeda lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15010 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049590.746252:0:15010:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.126@tcp lock: ffff8cb7c4c39200/0xf4f48ce5e1bbfeda lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15010 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789049590.746276:0:15010:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb8f7b92300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:817823bd-3ba1-432d-9714-f03a15bff403:15010:1875954110652544:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1789049590.746335:0:15010:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789049590.753260:0:15010:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cb8d0ccd240 going to sleep for 11 seconds 00000100:00100000:2.0:1789049590.753479:0:14321:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954110652544 00000100:00100000:2.0:1789049590.753488:0:14321:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954110652544 00000100:00100000:2.0:1789049590.753974:0:14321:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1789049590.753986:0:14321:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8d6a24850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:817823bd-3ba1-432d-9714-f03a15bff403+15:15010:x1875954110652544:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1789049590.754003:0:14321:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789049590.754030:0:14321:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cb900e63e00/0xf4f48ce5e1bbfee1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xf4f48ce5e1bbfeda expref: -99 pid: 14321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049590.754055:0:14321:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cb900e63e00/0xf4f48ce5e1bbfee1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf4f48ce5e1bbfeda expref: 16 pid: 14321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049590.754067:0:14321:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cb900e63e00/0xf4f48ce5e1bbfee1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf4f48ce5e1bbfeda expref: 16 pid: 14321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049590.754076:0:14321:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cb900e63e00, rc 0) 00000100:00100000:2.0:1789049590.754146:0:14321:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8d6a24850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:817823bd-3ba1-432d-9714-f03a15bff403+16:15010:x1875954110652544:12345-0@lo:101:mount.lustre.0 Request processed in 163us (7810us total) trans 0 rc 0/0 00000100:00100000:2.0:1789049590.754153:0:14321:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1789049590.761528:0:15010:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb8f7b92300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:817823bd-3ba1-432d-9714-f03a15bff403:15010:1875954110652544:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1789049590.761554:0:15010:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.126@tcp lock: ffff8cb7c4c39200/0xf4f48ce5e1bbfeda lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xf4f48ce5e1bbfee1 expref: -99 pid: 15010 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049590.761578:0:15010:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.126@tcp lock: ffff8cb7c4c39200/0xf4f48ce5e1bbfeda lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xf4f48ce5e1bbfee1 expref: -99 pid: 15010 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1789049590.762372:0:15010:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 30 count 30 00000040:00080000:0.0:1789049590.763363:0:15010:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1789049590.763622:0:15010:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 00000040:00080000:0.0:1789049590.763665:0:15010:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 120 off8536 00000040:00080000:0.0:1789049590.763699:0:15010:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 168 off8704 00000040:00080000:0.0:1789049590.763745:0:15010:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8928 00000040:00080000:0.0:1789049590.763782:0:15010:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9152 00000040:00080000:0.0:1789049590.764162:0:15010:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 120 off9272 00000040:00080000:0.0:1789049590.764205:0:15010:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 168 off9440 00000040:00080000:0.0:1789049590.764238:0:15010:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9664 00000040:00080000:0.0:1789049590.764299:0:15010:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 224 off9888 00000040:00080000:0.0:1789049590.764348:0:15010:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 120 off10008 00000040:00080000:0.0:1789049590.765440:0:15010:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 224 off10232 00000040:00080000:0.0:1789049590.765525:0:15010:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 224 off10456 00000040:00080000:0.0:1789049590.765561:0:15010:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 88 off10544 00000040:00080000:0.0:1789049590.765595:0:15010:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].14, 128 off10672 00000040:00080000:0.0:1789049590.765645:0:15010:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].15, 144 off10816 00000040:00080000:0.0:1789049590.765682:0:15010:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].16, 160 off10976 00000040:00080000:0.0:1789049590.765714:0:15010:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].17, 224 off11200 00000040:00080000:0.0:1789049590.765761:0:15010:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].18, 224 off11424 00000040:00080000:0.0:1789049590.765798:0:15010:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].19, 80 off11504 00000040:00080000:0.0:1789049590.768671:0:15010:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].20, 224 off11728 00000040:00080000:0.0:1789049590.768812:0:15010:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].21, 224 off11952 00000040:00080000:0.0:1789049590.768874:0:15010:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].22, 88 off12040 00000040:00080000:0.0:1789049590.768910:0:15010:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].23, 128 off12168 00000040:00080000:0.0:1789049590.768959:0:15010:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].24, 144 off12312 00000040:00080000:0.0:1789049590.768997:0:15010:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].25, 128 off12440 00000040:00080000:0.0:1789049590.769052:0:15010:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].26, 224 off12664 00000040:00080000:0.0:1789049590.769325:0:15010:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].27, 224 off12888 00000040:00080000:0.0:1789049590.769360:0:15010:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].28, 80 off12968 00000040:00080000:0.0:1789049590.769459:0:15010:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].29, 224 off13192 00000040:00080000:0.0:1789049590.769468:0:15010:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 29 count 30 00000100:00100000:0.0:1789049590.769557:0:15010:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb8f7b92300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:817823bd-3ba1-432d-9714-f03a15bff403:15010:1875954110652672:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789049590.769616:0:15010:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789049590.769658:0:15010:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cb8d0ccd240 going to sleep for 11 seconds 00000100:00100000:3.0:1789049590.769997:0:14323:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954110652672 00000100:00100000:3.0:1789049590.770006:0:14323:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954110652672 00000100:00100000:3.0:1789049590.770050:0:14323:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1789049590.770070:0:14323:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8d6a25450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:817823bd-3ba1-432d-9714-f03a15bff403+16:15010:x1875954110652672:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789049590.770297:0:14323:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8d6a25450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:817823bd-3ba1-432d-9714-f03a15bff403+16:15010:x1875954110652672:12345-0@lo:501:mount.lustre.0 Request processed in 229us (681us total) trans 0 rc 0/0 00000100:00100000:3.0:1789049590.770305:0:14323:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1789049590.770442:0:15010:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb8f7b92300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:817823bd-3ba1-432d-9714-f03a15bff403:15010:1875954110652672:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789049590.770479:0:15010:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb900e94000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:817823bd-3ba1-432d-9714-f03a15bff403:15010:1875954110652800:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1789049590.770517:0:15010:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789049590.770540:0:15010:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cb8c3987480 going to sleep for 11 seconds 00000100:00100000:3.0:1789049590.770713:0:14321:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954110652800 00000100:00100000:3.0:1789049590.770717:0:14321:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954110652800 00000100:00100000:3.0:1789049590.770740:0:14321:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1789049590.770747:0:14321:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8d6a24450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:817823bd-3ba1-432d-9714-f03a15bff403+16:15010:x1875954110652800:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1789049590.771036:0:14321:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8d6a24450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:817823bd-3ba1-432d-9714-f03a15bff403+16:15010:x1875954110652800:12345-0@lo:503:mount.lustre.0 Request processed in 288us (517us total) trans 0 rc 0/0 00000100:00100000:3.0:1789049590.771043:0:14321:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1789049590.771097:0:15010:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb900e94000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:817823bd-3ba1-432d-9714-f03a15bff403:15010:1875954110652800:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1789049590.771533:0:15010:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1789049590.771596:0:15010:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb7c5c34000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:817823bd-3ba1-432d-9714-f03a15bff403:15010:1875954110652928:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1789049590.771630:0:15010:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789049590.771652:0:14321:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954110652928 00000100:00100000:3.0:1789049590.771656:0:14321:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954110652928 00000100:00100000:3.0:1789049590.771679:0:14321:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1789049590.771687:0:14321:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8d6a26c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:817823bd-3ba1-432d-9714-f03a15bff403+16:15010:x1875954110652928:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1789049590.771907:0:14321:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8d6a26c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:817823bd-3ba1-432d-9714-f03a15bff403+16:15010:x1875954110652928:12345-0@lo:502:mount.lustre.0 Request processed in 221us (276us total) trans 0 rc 0/0 00000100:00100000:3.0:1789049590.772167:0:14321:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1789049590.772214:0:15010:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cb8d1132a80 going to sleep for 11 seconds 00000100:00100000:3.0:1789049590.772231:0:15010:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb7c5c34000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:817823bd-3ba1-432d-9714-f03a15bff403:15010:1875954110652928:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1789049590.772461:0:15010:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 00000040:00080000:3.0:1789049590.772512:0:15010:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 120 off8536 00000040:00080000:3.0:1789049590.772555:0:15010:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 168 off8704 00000040:00080000:3.0:1789049590.772600:0:15010:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8928 00000040:00080000:3.0:1789049590.772636:0:15010:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 224 off9152 00000040:00080000:3.0:1789049590.772679:0:15010:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 120 off9272 00000040:00080000:3.0:1789049590.772713:0:15010:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 168 off9440 00000040:00080000:3.0:1789049590.772743:0:15010:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 224 off9664 00000040:00080000:3.0:1789049590.772788:0:15010:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 224 off9888 00000040:00080000:3.0:1789049590.772824:0:15010:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 120 off10008 00000040:00080000:3.0:1789049590.773247:0:15010:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].11, 224 off10232 00000040:00080000:3.0:1789049590.773306:0:15010:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].12, 224 off10456 00000040:00080000:3.0:1789049590.773345:0:15010:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].13, 88 off10544 00000040:00080000:3.0:1789049590.773378:0:15010:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].14, 128 off10672 00000040:00080000:3.0:1789049590.773458:0:15010:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].15, 144 off10816 00000040:00080000:3.0:1789049590.773496:0:15010:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].16, 160 off10976 00000040:00080000:3.0:1789049590.773528:0:15010:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].17, 224 off11200 00000040:00080000:3.0:1789049590.773578:0:15010:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].18, 224 off11424 00000040:00080000:3.0:1789049590.773612:0:15010:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].19, 80 off11504 00000040:00080000:3.0:1789049590.773644:0:15010:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].20, 224 off11728 00000040:00080000:3.0:1789049590.773684:0:15010:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].21, 224 off11952 00000040:00080000:3.0:1789049590.773716:0:15010:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].22, 88 off12040 00000040:00080000:3.0:1789049590.773758:0:15010:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].23, 128 off12168 00000040:00080000:3.0:1789049590.773806:0:15010:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].24, 144 off12312 00000040:00080000:3.0:1789049590.773974:0:15010:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].25, 128 off12440 00000040:00080000:3.0:1789049590.774018:0:15010:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].26, 224 off12664 00000040:00080000:3.0:1789049590.774131:0:15010:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].27, 224 off12888 00000040:00080000:3.0:1789049590.774170:0:15010:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].28, 80 off12968 00000040:00080000:3.0:1789049590.774204:0:15010:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].29, 224 off13192 00000040:00080000:3.0:1789049590.774254:0:15010:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].30, 224 off13416 00000040:00080000:3.0:1789049590.774306:0:15010:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].31, 88 off13504 00000040:00080000:3.0:1789049590.774343:0:15010:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].32, 128 off13632 00000040:00080000:3.0:1789049590.774378:0:15010:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].33, 144 off13776 00000040:00080000:3.0:1789049590.774438:0:15010:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].34, 128 off13904 00000040:00080000:3.0:1789049590.774476:0:15010:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].35, 224 off14128 00000040:00080000:3.0:1789049590.774534:0:15010:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].36, 224 off14352 00000040:00080000:3.0:1789049590.774569:0:15010:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].37, 80 off14432 00000040:00080000:3.0:1789049590.774599:0:15010:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].38, 224 off14656 00000040:00080000:3.0:1789049590.774641:0:15010:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].39, 224 off14880 00000040:00080000:3.0:1789049590.774674:0:15010:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].40, 120 off15000 00000100:00100000:3.0:1789049590.774717:0:15010:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb7c5c34000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:817823bd-3ba1-432d-9714-f03a15bff403:15010:1875954110653056:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1789049590.774786:0:15010:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789049590.775008:0:15010:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cb8d1132a80 going to sleep for 11 seconds 00000100:00100000:0.0:1789049590.779386:0:14322:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954110653056 00000100:00100000:0.0:1789049590.779399:0:14322:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954110653056 00000100:00100000:0.0:1789049590.779458:0:14322:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1789049590.779467:0:14322:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8d6a27450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:817823bd-3ba1-432d-9714-f03a15bff403+16:15010:x1875954110653056:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1789049590.779715:0:14322:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8d6a27450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:817823bd-3ba1-432d-9714-f03a15bff403+16:15010:x1875954110653056:12345-0@lo:502:mount.lustre.0 Request processed in 244us (4924us total) trans 0 rc 0/0 00000100:00100000:0.0:1789049590.779725:0:14322:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1789049590.780314:0:15010:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb7c5c34000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:817823bd-3ba1-432d-9714-f03a15bff403:15010:1875954110653056:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1789049590.780430:0:15010:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].41, 224 off15224 00000040:00080000:3.0:1789049590.780445:0:15010:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 41 count 42 00000020:01000004:3.0:1789049590.782165:0:15033:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:3.0:1789049590.782183:0:15033:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff8cb8c62a8000) 00000020:00000080:3.0:1789049590.782204:0:15033:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type lwp with refcount 2 00000020:01000004:3.0:1789049590.782302:0:15033:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8cb8cdf0e000 from lustre-OST0000, refs=3 00000020:01000004:3.0:1789049590.782306:0:15033:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8cb8cdf0e000 from lustre-OST0000, refs=3 00000020:01000004:3.0:1789049590.782308:0:15033:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8cb8cdf0e000 3 00010000:00080000:3.0:1789049590.782337:0:15033:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8cb7c6dcf800@lustre-MDT0000-lwp-OST0000: add connection 192.168.206.126@tcp at head 00010000:00010000:3.0:1789049590.785232:0:15033:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-4 is initialized 00000020:00000080:3.0:1789049590.785503:0:15033:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:3.0:1789049590.785538:0:15033:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1789049590.785550:0:15033:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0xf4f48ce5e1bbfeef 00000100:00080000:3.0:1789049590.785559:0:15033:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1789049590.785568:0:15033:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8cb7c6dcf800 using connection 192.168.206.126@tcp/0@lo 00000100:00100000:3.0:1789049590.785599:0:15033:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8cb7c5c34000 x1875954110653184/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1789049590.785628:0:15033:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00100000:1.0:1789049590.787382:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb7c5c34000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3307:1875954110653184:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1789049590.787461:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1789049590.787677:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1789049590.787681:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1789049590.787683:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1789049590.787686:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1789049590.787863:0:14327:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954110653184 00000100:00100000:3.0:1789049590.787885:0:14327:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954110653184 00000100:00100000:3.0:1789049590.787921:0:14327:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1789049590.787927:0:14327:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb900e41500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3307:x1875954110653184:12345-0@lo:38:llog_process_th.0 00010000:00080000:3.0:1789049590.787951:0:14327:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 416 last 0 00000020:00000080:3.0:1789049590.787985:0:14327:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0xf4f48ce5e1bbfef6 00000004:00100000:3.0:1789049590.787999:0:14327:0:(mdt_handler.c:7315:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1789049590.788026:0:14327:0:(import.c:65:import_set_state_nolock()) ffff8cb7c6dce800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1789049590.788084:0:14327:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb900e41500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1875954110653184:12345-0@lo:38:llog_process_th.0 Request processed in 156us (623us total) trans 0 rc 0/0 00000100:00100000:3.0:1789049590.788091:0:14327:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1789049590.788112:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789049590.788120:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb8f7b92a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3309:1875954110653312:0@lo:400:kworker.0 00000100:00100000:3.0:1789049590.788142:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000040:00080000:3.0:1789049590.788268:0:15033:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 42 count 42 00000100:00100000:0.0:1789049590.788605:0:14328:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954110653312 00000100:00100000:0.0:1789049590.788610:0:14328:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954110653312 00000100:00100000:0.0:1789049590.788646:0:14328:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1789049590.788652:0:14328:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb7c5c35880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1875954110653312:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789049590.788696:0:14328:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb7c5c35880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1875954110653312:12345-0@lo:400:kworker.0 Request processed in 41us (550us total) trans 0 rc 0/0 00000100:00100000:0.0:1789049590.788702:0:14328:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000020:01000000:0.0:1789049590.788723:0:15010:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-41 (rc=0) 10000000:01000000:0.0:1789049590.788757:0:15010:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.126@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1789049590.788768:0:15010:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.126@tcp lock: ffff8cb7c4c39200/0xf4f48ce5e1bbfeda lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xf4f48ce5e1bbfee1 expref: -99 pid: 15010 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049590.788778:0:15010:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.126@tcp lock: ffff8cb7c4c39200/0xf4f48ce5e1bbfeda lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xf4f48ce5e1bbfee1 expref: -99 pid: 15010 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:0.0:1789049590.788817:0:15010:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:0.0:1789049590.788820:0:15010:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1789049590.788821:0:15010:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789049590.788822:0:15010:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1789049590.788823:0:15010:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789049590.788825:0:15010:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789049590.788826:0:15010:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1789049590.788828:0:15010:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789049590.788829:0:15010:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1789049590.788833:0:15010:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020002 00000020:01000004:0.0:1789049590.788835:0:15010:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1789049590.788836:0:15010:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1789049590.788837:0:15010:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789049590.788838:0:15010:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1789049590.788839:0:15010:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789049590.788858:0:15010:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789049590.788859:0:15010:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1789049590.788860:0:15010:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789049590.788861:0:15010:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1789049590.788887:0:15010:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:0.0:1789049590.788899:0:15010:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb8f7b93480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:817823bd-3ba1-432d-9714-f03a15bff403:15010:1875954110653440:0@lo:253:mount.lustre.0 00000100:00100000:0.0:1789049590.788943:0:15010:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789049590.788957:0:15010:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cb8d1127cc0 going to sleep for 11 seconds 00010000:00080000:1.0:1789049590.790032:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff8cb7c5c34000 x1875954110653184/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1789049600 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789049590.790043:0:3307:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1789049590.790052:0:3307:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 2 00000100:00080000:1.0:1789049590.790058:0:3307:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:1.0:1789049590.790063:0:3307:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:1.0:1789049590.790065:0:3307:0:(import.c:65:import_set_state_nolock()) ffff8cb7c6dcf800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1789049590.790071:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb7c5c34000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3307:1875954110653184:0@lo:38:llog_process_th.0 00010000:00080000:3.0:1789049590.790242:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff8cb8f7b92a00 x1875954110653312/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789049606 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789049590.790251:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb8f7b92a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3309:1875954110653312:0@lo:400:kworker.0 00000100:00100000:3.0:1789049590.790276:0:14323:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954110653440 00000100:00100000:3.0:1789049590.790280:0:14323:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954110653440 00000100:00100000:3.0:1789049590.790316:0:14323:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1789049590.790323:0:14323:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8d6a26450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:817823bd-3ba1-432d-9714-f03a15bff403+16:15010:x1875954110653440:12345-0@lo:253:mount.lustre.0 20000000:01000000:3.0:1789049590.790344:0:14323:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:3.0:1789049590.790356:0:14323:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:0.0:1789049590.847647:0:14323:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1789049590.847686:0:14323:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 20000000:01000000:3.0:1789049590.853474:0:14343:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:3.0:1789049590.853484:0:14343:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:3.0:1789049590.853505:0:14343:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8cb8c6b34400/0xf4f48ce5e1bbfefd lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14343 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049590.853540:0:14343:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8cb900e62800/0xf4f48ce5e1bbfe6a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf4f48ce5e1bbfe63 expref: 16 pid: 14322 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049590.853549:0:14343:0:(ldlm_resource.c:1751:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8cb8c6b34400/0xf4f48ce5e1bbfefd lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14343 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049590.853588:0:14343:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8cb900e62800/0xf4f48ce5e1bbfe6a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf4f48ce5e1bbfe63 expref: 16 pid: 14322 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049590.853603:0:14343:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8cb900e62800/0xf4f48ce5e1bbfe6a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf4f48ce5e1bbfe63 expref: 16 pid: 14322 timeout: 516 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789049590.853618:0:14343:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb7c5c36d80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14343:1875954110653568:0@lo:104: 00000100:00100000:3.0:1789049590.853675:0:14343:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789049590.853717:0:14343:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cb8d660d180 going to sleep for 11 seconds 00000100:00100000:0.0:1789049590.853776:0:14311:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954110653568 00000100:00100000:0.0:1789049590.853784:0:14311:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954110653568 00000100:00100000:0.0:1789049590.853831:0:14311:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1789049590.853883:0:14311:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb7c5c34700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:817823bd-3ba1-432d-9714-f03a15bff403+3:14343:x1875954110653568:12345-0@lo:104: 00010000:00010000:0.0:1789049590.853896:0:14311:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.126@tcp lock: ffff8cb8c28c2200/0xf4f48ce5e1bbfe63 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xf4f48ce5e1bbfe6a expref: -99 pid: 14325 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049590.853945:0:14311:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1789049590.853950:0:14311:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb7c5c34700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:817823bd-3ba1-432d-9714-f03a15bff403+3:14343:x1875954110653568:12345-0@lo:104: Request processed in 71us (276us total) trans 0 rc 0/0 00000100:00100000:0.0:1789049590.853958:0:14311:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00010000:0.0:1789049590.853978:0:14317:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789049590.853983:0:14317:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.126@tcp lock: ffff8cb8c28c2200/0xf4f48ce5e1bbfe63 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xf4f48ce5e1bbfe6a expref: -99 pid: 14325 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049590.853989:0:14317:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cb8c28c2200 already unused, calling callback (ffffffffc1ca3c20) 10000000:00010000:0.0:1789049590.853992:0:14317:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.126@tcp lock: ffff8cb8c28c2200/0xf4f48ce5e1bbfe63 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xf4f48ce5e1bbfe6a expref: -99 pid: 14325 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049590.854000:0:14317:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.126@tcp lock: ffff8cb8c28c2200/0xf4f48ce5e1bbfe63 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xf4f48ce5e1bbfe6a expref: -99 pid: 14325 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789049590.854006:0:14317:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.126@tcp lock: ffff8cb8c28c2200/0xf4f48ce5e1bbfe63 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xf4f48ce5e1bbfe6a expref: -99 pid: 14325 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789049590.854012:0:14317:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1789049590.854037:0:14317:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.126@tcp lock: ffff8cb8c28c2200/0xf4f48ce5e1bbfe63 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf4f48ce5e1bbfe6a expref: -99 pid: 14325 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049590.854043:0:14317:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789049590.854072:0:14317:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.126@tcp lock: ffff8cb8c28c2200/0xf4f48ce5e1bbfe63 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf4f48ce5e1bbfe6a expref: -99 pid: 14325 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049590.854090:0:14317:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.126@tcp lock: ffff8cb8c28c2200/0xf4f48ce5e1bbfe63 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf4f48ce5e1bbfe6a expref: -99 pid: 14325 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049590.854104:0:14317:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789049590.854106:0:14317:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789049590.854108:0:14317:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789049590.854126:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb8f7b90a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:817823bd-3ba1-432d-9714-f03a15bff403:3309:1875954110653696:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789049590.854155:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789049590.854192:0:14315:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954110653696 00000100:00100000:0.0:1789049590.854196:0:14315:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954110653696 00010000:00010000:0.0:1789049590.854212:0:14315:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8cb900e62800/0xf4f48ce5e1bbfe6a lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf4f48ce5e1bbfe63 expref: 17 pid: 14322 timeout: 516 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789049590.854233:0:14315:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1789049590.854240:0:14315:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8f7b90e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:817823bd-3ba1-432d-9714-f03a15bff403+17:3309:x1875954110653696:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789049590.854250:0:14315:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789049590.854255:0:14315:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8cb900e62800/0xf4f48ce5e1bbfe6a lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf4f48ce5e1bbfe63 expref: 17 pid: 14322 timeout: 516 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049590.854264:0:14315:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8cb900e62800/0xf4f48ce5e1bbfe6a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf4f48ce5e1bbfe63 expref: 17 pid: 14322 timeout: 516 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049590.854279:0:14315:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8cb8c6b34400/0xf4f48ce5e1bbfefd lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 14343 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049590.854287:0:14315:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cb8c6b34400/0xf4f48ce5e1bbfefd lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 14343 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1789049590.854299:0:14315:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.000892003s 00010000:00010000:0.0:1789049590.854310:0:14315:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8cb8c6b34400/0xf4f48ce5e1bbfefd lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14343 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049590.854318:0:14315:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8cb8c6b34400/0xf4f48ce5e1bbfefd lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14343 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049590.854325:0:14315:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8cb8c6b34400/0xf4f48ce5e1bbfefd lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14343 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049590.854331:0:14315:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8cb8c6b34400/0xf4f48ce5e1bbfefd lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14343 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049590.854337:0:14315:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cb8c6b34400 already unused, calling callback (ffffffffc166a8f0) 00010000:00010000:0.0:1789049590.854340:0:14315:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8cb8c6b34400/0xf4f48ce5e1bbfefd lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14343 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049590.854348:0:14315:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8cb8c6b34400/0xf4f48ce5e1bbfefd lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14343 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049590.854356:0:14315:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8cb8c6b34400/0xf4f48ce5e1bbfefd lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14343 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049590.854366:0:14315:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789049590.854396:0:14315:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8f7b90e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:817823bd-3ba1-432d-9714-f03a15bff403+17:3309:x1875954110653696:12345-0@lo:103:ldlm_bl.0 Request processed in 157us (240us total) trans 0 rc 0/0 00000100:00100000:0.0:1789049590.854419:0:14315:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1789049590.854453:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb8f7b90a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:817823bd-3ba1-432d-9714-f03a15bff403:3309:1875954110653696:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789049590.854622:0:14343:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cb900e62800/0xf4f48ce5e1bbfe6a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf4f48ce5e1bbfe63 expref: 16 pid: 14322 timeout: 516 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789049590.854632:0:14343:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb7c5c36d80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14343:1875954110653568:0@lo:104: 00010000:00010000:1.0:1789049590.854645:0:14343:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8cb8c6b34400/0xf4f48ce5e1bbfefd lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14343 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049590.854653:0:14343:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8cb8c6b34400/0xf4f48ce5e1bbfefd lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14343 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049590.854675:0:14343:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8cb8c6b34400/0xf4f48ce5e1bbfefd lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14343 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049590.854682:0:14343:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cb8c6b34400/0xf4f48ce5e1bbfefd lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14343 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789049590.873435:0:14323:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8d6a26450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:817823bd-3ba1-432d-9714-f03a15bff403+15:15010:x1875954110653440:12345-0@lo:253:mount.lustre.0 Request processed in 83104us (84484us total) trans 0 rc 0/0 00000100:00100000:0.0:1789049590.873449:0:14323:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1789049590.873637:0:15010:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb8f7b93480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:817823bd-3ba1-432d-9714-f03a15bff403:15010:1875954110653440:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1789049590.873653:0:15010:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:2.0:1789049590.873656:0:15010:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1789049590.873658:0:15010:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1789049590.873659:0:15010:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789049590.873661:0:15010:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789049590.873662:0:15010:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789049590.873663:0:15010:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789049590.873665:0:15010:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1789049590.873667:0:15010:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789049590.873669:0:15010:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:2.0:1789049590.873683:0:15010:0:(tgt_mount.c:2694:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 00010000:00010000:1.0:1789049590.875423:0:14316:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00080000:10000000:3.0:1789049590.879570:0:15010:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:3.0:1789049590.879957:0:15010:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:3.0:1789049590.880169:0:15010:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:3.0:1789049590.880322:0:15010:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:3.0:1789049590.880480:0:15010:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:3.0:1789049590.880688:0:15010:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:1.0:1789049590.881620:0:15010:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 8589934592 00002000:00080000:0.0:1789049590.927183:0:15010:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:0.0:1789049590.927191:0:15010:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0000-osd: start master thread 00000020:01000004:0.0:1789049590.927224:0:15010:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:0.0:1789049590.927280:0:15010:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.206.126@tcp: cl_mgc_mutex unlock 00000020:01000004:0.0:1789049590.927292:0:15010:0:(tgt_mount.c:2460:server_fill_super_common()) Server sb, dev=48 00000080:00000004:0.0:1789049590.927320:0:15010:0:(super25.c:182:lustre_fill_super()) lustre-ost1/ost1: Mount complete 00010000:00010000:0.0:1789049591.899055:0:14317:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1789049592.091918:0:14325:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1789049592.091926:0:14325:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8cb8d1a86000 from 7 10000000:01000000:0.0:1789049592.091931:0:14325:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1789049592.091983:0:14325:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.126@tcp lock: ffff8cb7c4c39000/0xf4f48ce5e1bbff04 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14325 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049592.091995:0:14325:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.126@tcp lock: ffff8cb7c4c39000/0xf4f48ce5e1bbff04 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14325 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049592.092008:0:14325:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.126@tcp lock: ffff8cb7c4c39000/0xf4f48ce5e1bbff04 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14325 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789049592.092033:0:14325:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb8f7b90a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:817823bd-3ba1-432d-9714-f03a15bff403:14325:1875954110653824:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1789049592.092096:0:14325:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789049592.092170:0:14325:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cb8c7a2b780 going to sleep for 11 seconds 00000100:00100000:1.0:1789049592.094611:0:14321:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954110653824 00000100:00100000:1.0:1789049592.094626:0:14321:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954110653824 00000100:00100000:1.0:1789049592.094686:0:14321:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1789049592.094696:0:14321:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8d6a24c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:817823bd-3ba1-432d-9714-f03a15bff403+15:14325:x1875954110653824:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789049592.094713:0:14321:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789049592.094732:0:14321:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cb8c28c2800/0xf4f48ce5e1bbff0b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xf4f48ce5e1bbff04 expref: -99 pid: 14321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049592.094758:0:14321:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cb8c28c2800/0xf4f48ce5e1bbff0b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf4f48ce5e1bbff04 expref: 16 pid: 14321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049592.094780:0:14321:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cb8c28c2800/0xf4f48ce5e1bbff0b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf4f48ce5e1bbff04 expref: 16 pid: 14321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049592.094790:0:14321:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cb8c28c2800, rc 0) 00000100:00100000:1.0:1789049592.094891:0:14321:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8d6a24c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:817823bd-3ba1-432d-9714-f03a15bff403+16:14325:x1875954110653824:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 196us (2794us total) trans 0 rc 0/0 00000100:00100000:1.0:1789049592.094898:0:14321:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1789049592.095070:0:14325:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb8f7b90a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:817823bd-3ba1-432d-9714-f03a15bff403:14325:1875954110653824:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789049592.095089:0:14325:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.126@tcp lock: ffff8cb7c4c39000/0xf4f48ce5e1bbff04 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf4f48ce5e1bbff0b expref: -99 pid: 14325 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049592.095098:0:14325:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.126@tcp lock: ffff8cb7c4c39000/0xf4f48ce5e1bbff04 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xf4f48ce5e1bbff0b expref: -99 pid: 14325 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789049592.095181:0:14325:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb900e94a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:817823bd-3ba1-432d-9714-f03a15bff403:14325:1875954110653952:0@lo:256:ll_cfg_requeue.0 00000100:00100000:2.0:1789049592.095220:0:14325:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789049592.095247:0:14325:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cb8c799f3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789049592.095570:0:14323:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954110653952 00000100:00100000:1.0:1789049592.095576:0:14323:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954110653952 00000100:00100000:1.0:1789049592.095616:0:14323:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1789049592.095622:0:14323:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8d6a24050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:817823bd-3ba1-432d-9714-f03a15bff403+16:14325:x1875954110653952:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:1.0:1789049592.095635:0:14323:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1789049592.095650:0:14323:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1789049592.095653:0:14323:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 7 00000100:00100000:1.0:1789049592.095721:0:14323:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8d6a24050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:817823bd-3ba1-432d-9714-f03a15bff403+16:14325:x1875954110653952:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 99us (500us total) trans 0 rc 0/0 00000100:00100000:1.0:1789049592.095728:0:14323:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1789049592.095804:0:14325:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb900e94a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:817823bd-3ba1-432d-9714-f03a15bff403:14325:1875954110653952:0@lo:256:ll_cfg_requeue.0 10000000:01000000:2.0:1789049592.095884:0:14325:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.126@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1789049592.095892:0:14325:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.126@tcp lock: ffff8cb7c4c39000/0xf4f48ce5e1bbff04 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf4f48ce5e1bbff0b expref: -99 pid: 14325 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049592.095901:0:14325:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.126@tcp lock: ffff8cb7c4c39000/0xf4f48ce5e1bbff04 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf4f48ce5e1bbff0b expref: -99 pid: 14325 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049592.922988:0:14316:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789049593.949181:0:14317:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789049594.976575:0:14316:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1789049595.804216:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1789049595.804222:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1789049595.804225:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1789049595.804228:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1789049595.804280:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb8f7b90000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3311:1875954110654208:0@lo:400:kworker.0 00000100:00100000:0.0:1789049595.804346:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789049595.804408:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1789049595.804431:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb8f7b91180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:817823bd-3ba1-432d-9714-f03a15bff403:3311:1875954110654080:0@lo:400:kworker.0 00000100:00100000:0.0:1789049595.804462:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789049595.804495:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb8f7b91c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3308:1875954110654336:0@lo:400:kworker.0 00000100:00100000:0.0:1789049595.807102:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789049595.807177:0:14328:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954110654208 00000100:00100000:0.0:1789049595.807185:0:14328:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954110654208 00000100:00100000:0.0:1789049595.807222:0:14328:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954110654336 00000100:00100000:0.0:1789049595.807225:0:14328:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954110654336 00000100:00100000:0.0:1789049595.807249:0:14328:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1789049595.807257:0:14328:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8f7b91500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1875954110654208:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789049595.807322:0:14328:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8f7b91500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1875954110654208:12345-0@lo:400:kworker.0 Request processed in 65us (2975us total) trans 0 rc 0/0 00000100:00100000:0.0:1789049595.807329:0:14328:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1789049595.807343:0:14328:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1789049595.807349:0:14328:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8f7b90380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1875954110654336:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789049595.807387:0:14328:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8f7b90380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1875954110654336:12345-0@lo:400:kworker.0 Request processed in 28us (281us total) trans 0 rc 0/0 00000100:00100000:0.0:1789049595.807393:0:14328:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1789049595.807410:0:14323:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954110654080 00000100:00100000:0.0:1789049595.807414:0:14323:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954110654080 00000100:00100000:0.0:1789049595.807436:0:14323:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1789049595.807442:0:14323:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8d6a27050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:817823bd-3ba1-432d-9714-f03a15bff403+16:3311:x1875954110654080:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789049595.807469:0:14323:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8d6a27050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:817823bd-3ba1-432d-9714-f03a15bff403+16:3311:x1875954110654080:12345-0@lo:400:kworker.0 Request processed in 27us (3006us total) trans 0 rc 0/0 00000100:00100000:0.0:1789049595.807476:0:14323:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1789049595.807534:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb8f7b91180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:817823bd-3ba1-432d-9714-f03a15bff403:3311:1875954110654080:0@lo:400:kworker.0 00010000:00080000:0.0:1789049595.807563:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8cb8f7b90000 x1875954110654208/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789049611 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789049595.807575:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb8f7b90000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3311:1875954110654208:0@lo:400:kworker.0 00010000:00080000:0.0:1789049595.807603:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8cb8f7b91c00 x1875954110654336/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789049611 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789049595.807612:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb8f7b91c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3308:1875954110654336:0@lo:400:kworker.0 00000100:00080000:3.0:1789049595.808128:0:14324:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1789049595.997150:0:14317:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789049597.020018:0:14316:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1789049597.614246:0:15380:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg626-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:0.0:1789049598.043744:0:14317:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789049599.067456:0:14316:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1789049599.388693:0:14362:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1789049600.091282:0:14317:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1789049600.923542:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1789049600.923549:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1789049600.923551:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1789049600.923555:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1789049600.923560:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789049600.923580:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb900e94a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:817823bd-3ba1-432d-9714-f03a15bff403:3308:1875954110654464:0@lo:400:kworker.0 00000100:00100000:0.0:1789049600.923649:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789049600.923703:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb900e95c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3311:1875954110654720:0@lo:400:kworker.0 00000100:00100000:2.0:1789049600.923751:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789049600.923754:0:14321:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954110654464 00000100:00100000:0.0:1789049600.923762:0:14321:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954110654464 00000100:00100000:2.0:1789049600.923773:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1789049600.923779:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb900e95180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3311:1875954110654592:0@lo:400:kworker.0 00000100:00100000:2.0:1789049600.923802:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789049600.923803:0:14321:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1789049600.923810:0:14321:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8d6a26050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:817823bd-3ba1-432d-9714-f03a15bff403+16:3308:x1875954110654464:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789049600.923865:0:14328:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954110654720 00000100:00100000:2.0:1789049600.923869:0:14328:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954110654720 00000100:00100000:0.0:1789049600.923874:0:14321:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8d6a26050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:817823bd-3ba1-432d-9714-f03a15bff403+16:3308:x1875954110654464:12345-0@lo:400:kworker.0 Request processed in 64us (225us total) trans 0 rc 0/0 00000100:00100000:0.0:1789049600.923880:0:14321:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1789049600.923898:0:14328:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954110654592 00000100:00100000:2.0:1789049600.923901:0:14328:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954110654592 00000100:00100000:0.0:1789049600.923910:0:14329:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1789049600.923916:0:14329:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb900e95f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1875954110654720:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789049600.923952:0:14329:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb900e95f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1875954110654720:12345-0@lo:400:kworker.0 Request processed in 36us (200us total) trans 0 rc 0/0 00000100:00100000:0.0:1789049600.924102:0:14329:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1789049600.924107:0:14328:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1789049600.924114:0:14328:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb900e96d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1875954110654592:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789049600.924143:0:14328:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb900e96d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1875954110654592:12345-0@lo:400:kworker.0 Request processed in 30us (341us total) trans 0 rc 0/0 00000100:00100000:2.0:1789049600.924149:0:14328:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:0.0:1789049600.924261:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8cb900e95c00 x1875954110654720/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789049616 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789049600.924283:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb900e95c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3311:1875954110654720:0@lo:400:kworker.0 00010000:00080000:0.0:1789049600.924304:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8cb900e95180 x1875954110654592/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789049616 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789049600.924312:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb900e95180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3311:1875954110654592:0@lo:400:kworker.0 00000100:00100000:0.0:1789049600.924332:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb900e94a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:817823bd-3ba1-432d-9714-f03a15bff403:3308:1875954110654464:0@lo:400:kworker.0 00000100:00080000:3.0:1789049600.924762:0:14324:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1789049601.117545:0:14316:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789049602.018640:0:3307:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789049587/real 1789049587] req@ffff8cb900e97480 x1875954110650496/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789049602 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789049602.018680:0:3307:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8cb900e97480 x1875954110650496/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789049602 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789049602.018705:0:3307:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789049587/real 1789049587] req@ffff8cb900e94e00 x1875954110650624/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789049602 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789049602.018719:0:3307:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8cb900e94e00 x1875954110650624/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789049602 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1789049602.018737:0:3307:0:(import.c:65:import_set_state_nolock()) ffff8cb8c8369000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1789049602.022035:0:3307:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:3.0:1789049602.022045:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb900e97480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3307:1875954110650496:0@lo:8:kworker.0 00000100:00080000:3.0:1789049602.022057:0:3307:0:(import.c:65:import_set_state_nolock()) ffff8cb8c3fca000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1789049602.022135:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1789049602.022140:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:2.0:1789049602.022143:0:8:0:(import.c:65:import_set_state_nolock()) ffff8cb8c8369000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1789049602.022147:0:8:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 413 00000100:00080000:2.0:1789049602.022153:0:8:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:2.0:1789049602.022163:0:8:0:(import.c:666:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff8cb8c8369000 using connection 192.168.206.126@tcp/0@lo 00000100:00100000:2.0:1789049602.022185:0:8:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8cb900e94a80 x1875954110654976/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1789049602.022196:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1789049602.022199:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1789049602.022200:0:8:0:(import.c:65:import_set_state_nolock()) ffff8cb8c3fca000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1789049602.022204:0:8:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 413 00000100:00080000:2.0:1789049602.022206:0:8:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:2.0:1789049602.022210:0:8:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff8cb8c3fca000 using connection 192.168.206.126@tcp/0@lo 00000100:00100000:2.0:1789049602.022222:0:8:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8cb900e95180 x1875954110655104/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1789049602.022271:0:3307:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:3.0:1789049602.022277:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb900e94e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3307:1875954110650624:0@lo:8:kworker.0 00000100:00100000:2.0:1789049602.022283:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb900e95c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3309:1875954110655232:0@lo:400:kworker.0 00000100:00100000:0.0:1789049602.022294:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb900e94700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:817823bd-3ba1-432d-9714-f03a15bff403:3308:1875954110654848:0@lo:400:kworker.0 00000100:00100000:3.0:1789049602.022588:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb900e94a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3307:1875954110654976:0@lo:8:kworker.0 00000100:00100000:2.0:1789049602.023203:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789049602.023267:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb900e94000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3310:1875954110655360:0@lo:400:kworker.0 00000100:00100000:2.0:1789049602.023403:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789049602.023512:0:14329:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954110655232 00000100:00100000:2.0:1789049602.023520:0:14329:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954110655232 00000100:00100000:2.0:1789049602.023562:0:14329:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954110655360 00000100:00100000:2.0:1789049602.023565:0:14329:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954110655360 00000100:00100000:2.0:1789049602.023590:0:14329:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1789049602.023606:0:14329:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb900e97800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1875954110655232:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789049602.023659:0:14329:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb900e97800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1875954110655232:12345-0@lo:400:kworker.0 Request processed in 54us (457us total) trans 0 rc 0/0 00000100:00100000:2.0:1789049602.023666:0:14329:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1789049602.023683:0:14329:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1789049602.023689:0:14329:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb900e95500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1875954110655360:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789049602.023719:0:14329:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb900e95500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1875954110655360:12345-0@lo:400:kworker.0 Request processed in 31us (317us total) trans 0 rc 0/0 00000100:00100000:2.0:1789049602.023725:0:14329:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00080000:2.0:1789049602.023745:0:14324:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:2.0:1789049602.023770:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8cb900e95c00 x1875954110655232/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789049618 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789049602.023782:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb900e95c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3309:1875954110655232:0@lo:400:kworker.0 00010000:00080000:2.0:1789049602.023806:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8cb900e94000 x1875954110655360/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789049618 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789049602.023815:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb900e94000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3310:1875954110655360:0@lo:400:kworker.0 00000100:00100000:0.0:1789049602.026015:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789049602.026743:0:14322:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954110654848 00000100:00100000:2.0:1789049602.026753:0:14322:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954110654848 00000100:00100000:2.0:1789049602.026814:0:14322:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1789049602.026824:0:14322:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8d6a26850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:817823bd-3ba1-432d-9714-f03a15bff403+16:3308:x1875954110654848:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789049602.026917:0:14322:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8d6a26850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:817823bd-3ba1-432d-9714-f03a15bff403+16:3308:x1875954110654848:12345-0@lo:400:kworker.0 Request processed in 94us (907us total) trans 0 rc 0/0 00000100:00100000:2.0:1789049602.026924:0:14322:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1789049602.027117:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb900e94700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:817823bd-3ba1-432d-9714-f03a15bff403:3308:1875954110654848:0@lo:400:kworker.0 00000100:00100000:3.0:1789049602.027762:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789049602.027809:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb900e95180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3307:1875954110655104:0@lo:8:kworker.0 00000100:00100000:3.0:1789049602.027968:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789049602.028674:0:15011:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954110654976 00000100:00100000:0.0:1789049602.028682:0:15011:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954110654976 00000100:00100000:0.0:1789049602.028718:0:15011:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954110655104 00000100:00100000:0.0:1789049602.028722:0:15011:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954110655104 00000100:00100000:0.0:1789049602.028737:0:15011:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1789049602.028745:0:15011:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb7c5c37480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3307:x1875954110654976:12345-0@lo:8:kworker.0 00010000:00080000:0.0:1789049602.028772:0:15011:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 428 last 0 00000020:00000080:0.0:1789049602.028817:0:15011:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xf4f48ce5e1bbff12 00002000:00100000:0.0:1789049602.028831:0:15011:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff8cb7c6903800 ocd_connect_flags: 0xa044c01443000026 ocd_version: 2113a28 ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:0.0:1789049602.028835:0:15011:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00002000:00100000:0.0:1789049602.028837:0:15011:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:0.0:1789049602.029162:0:15011:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:0.0:1789049602.029186:0:15011:0:(import.c:65:import_set_state_nolock()) ffff8cb7c6900800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1789049602.029252:0:15011:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb7c5c37480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3307:x1875954110654976:12345-0@lo:8:kworker.0 Request processed in 505us (1491us total) trans 0 rc 0/0 00000100:00100000:0.0:1789049602.029270:0:15011:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1789049602.029290:0:15011:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1789049602.029294:0:15011:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb7c5c37b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3307:x1875954110655104:12345-0@lo:8:kworker.0 00010000:00020000:0.0:1789049602.029306:0:15011:0:(ldlm_lib.c:1199:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1789049602.029341:0:15011:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb7c5c37b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3307:x1875954110655104:12345-0@lo:8:kworker.0 Request processed in 45us (1372us total) trans 0 rc -19/-19 00000100:00100000:0.0:1789049602.029359:0:15011:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:3.0:1789049602.029879:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8cb900e94a80 x1875954110654976/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1789049622 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789049602.029893:0:3307:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1789049602.029902:0:3307:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 2 00000100:00080000:3.0:1789049602.029910:0:3307:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040c01443000026 00000100:00080000:3.0:1789049602.029915:0:3307:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:3.0:1789049602.029918:0:3307:0:(import.c:65:import_set_state_nolock()) ffff8cb8c8369000 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:3.0:1789049602.029941:0:3307:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:3.0:1789049602.029952:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb900e94a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3307:1875954110654976:0@lo:8:kworker.0 00000100:00080000:3.0:1789049602.029973:0:3307:0:(import.c:65:import_set_state_nolock()) ffff8cb8c3fca000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1789049602.029977:0:3307:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1789049602.029981:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb900e95180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3307:1875954110655104:0@lo:8:kworker.0 00000004:00080000:2.0:1789049602.030288:0:14350:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x240000400:0x6:0x0] 00000100:00100000:2.0:1789049602.030310:0:14350:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb900e95c00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14350:1875954110655616:0@lo:5:osp-pre-0-0.0 00000100:00100000:2.0:1789049602.030371:0:14350:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789049602.030395:0:14350:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cb8d0ccdc00 going to sleep for 11 seconds 00000100:00100000:2.0:1789049602.030410:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb900e94000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3311:1875954110655488:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789049602.030435:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789049602.030472:0:15014:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954110655616 00000100:00100000:2.0:1789049602.030477:0:15014:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954110655616 00000100:00100000:2.0:1789049602.030517:0:15014:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1789049602.030525:0:15014:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb900e96a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:14350:x1875954110655616:12345-0@lo:5:osp-pre-0-0.0 00000004:00080000:0.0:1789049602.030586:0:14349:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:0.0:1789049602.031124:0:14349:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 428083279722ns, next at 0ns, rc = 0 00000100:00100000:0.0:1789049602.031169:0:15015:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954110655488 00000100:00100000:0.0:1789049602.031174:0:15015:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954110655488 00000100:00100000:0.0:1789049602.031210:0:15015:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1789049602.031220:0:15015:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb900e96300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3311:x1875954110655488:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789049602.031245:0:15015:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789049602.031304:0:15015:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb900e96300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3311:x1875954110655488:12345-0@lo:13:osp-pre-0-0.0 Request processed in 86us (867us total) trans 0 rc 0/0 00000100:00100000:0.0:1789049602.031312:0:15015:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00080000:0.0:1789049602.034426:0:14324:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1789049602.039219:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8cb900e94000 x1875954110655488/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789049618 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789049602.039499:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb900e94000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3311:1875954110655488:0@lo:13:osp-pre-0-0.0 00002000:00080000:2.0:1789049602.040407:0:15014:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x240000400 00002000:00080000:2.0:1789049602.040417:0:15014:0:(ofd_dev.c:1646:ofd_create_hdl()) ofd_last_id() = 33 -> diff = -27 00002000:02000040:2.0:1789049602.040495:0:15014:0:(ofd_dev.c:1497:ofd_orphans_destroy()) lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x240000400:7 to 0x240000400:33) 00002000:00010000:3.0:1789049602.057307:0:15014:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x21:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1789049602.057320:0:15014:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000081843886/0xf4f48ce5e1bbff19 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049602.057339:0:15014:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x21:0x0].0x0 since=428s v=(0 0) 00010000:00010000:3.0:1789049602.057354:0:15014:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x21:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789049602.057360:0:15014:0:(ldlm_resource.c:1751:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000081843886/0xf4f48ce5e1bbff19 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049602.057378:0:15014:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000081843886/0xf4f48ce5e1bbff19 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049602.057391:0:15014:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000081843886/0xf4f48ce5e1bbff19 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049602.057399:0:15014:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000081843886/0xf4f48ce5e1bbff19 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049602.057418:0:15014:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1789049602.057920:0:15014:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x20:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1789049602.057926:0:15014:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c33e2386/0xf4f48ce5e1bbff20 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049602.057949:0:15014:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x20:0x0].0x0 since=428s v=(0 0) 00010000:00010000:3.0:1789049602.057952:0:15014:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x20:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789049602.057957:0:15014:0:(ldlm_resource.c:1751:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c33e2386/0xf4f48ce5e1bbff20 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049602.057969:0:15014:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c33e2386/0xf4f48ce5e1bbff20 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049602.057977:0:15014:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c33e2386/0xf4f48ce5e1bbff20 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049602.057984:0:15014:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c33e2386/0xf4f48ce5e1bbff20 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049602.058001:0:15014:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1789049602.062404:0:14316:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1789049602.062419:0:14316:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000081843886/0xf4f48ce5e1bbff19 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049602.062441:0:14316:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cb8c6b35800 already unused, calling callback (ffffffffc166a8f0) 00010000:00010000:2.0:1789049602.062445:0:14316:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000081843886/0xf4f48ce5e1bbff19 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049602.062456:0:14316:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000081843886/0xf4f48ce5e1bbff19 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049602.062483:0:14316:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000081843886/0xf4f48ce5e1bbff19 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049602.062506:0:14316:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000081843886/0xf4f48ce5e1bbff19 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049602.062881:0:14316:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789049602.062887:0:14316:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c33e2386/0xf4f48ce5e1bbff20 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789049602.063142:0:15014:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1789049602.063150:0:15014:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009e4fa65b/0xf4f48ce5e1bbff27 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049602.063162:0:15014:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1f:0x0].0x0 since=428s v=(0 0) 00010000:00010000:3.0:1789049602.063168:0:15014:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789049602.063173:0:15014:0:(ldlm_resource.c:1751:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009e4fa65b/0xf4f48ce5e1bbff27 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049602.063185:0:15014:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009e4fa65b/0xf4f48ce5e1bbff27 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049602.063207:0:15014:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009e4fa65b/0xf4f48ce5e1bbff27 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049602.063215:0:15014:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009e4fa65b/0xf4f48ce5e1bbff27 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049602.063226:0:15014:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789049602.063349:0:14316:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cb8c6b34600 already unused, calling callback (ffffffffc166a8f0) 00010000:00010000:2.0:1789049602.063358:0:14316:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c33e2386/0xf4f48ce5e1bbff20 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049602.063367:0:14316:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c33e2386/0xf4f48ce5e1bbff20 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049602.063380:0:14316:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c33e2386/0xf4f48ce5e1bbff20 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049602.063386:0:14316:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c33e2386/0xf4f48ce5e1bbff20 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049602.063402:0:14316:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789049602.063406:0:14316:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009e4fa65b/0xf4f48ce5e1bbff27 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049602.063412:0:14316:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cb8c6b35600 already unused, calling callback (ffffffffc166a8f0) 00010000:00010000:1.0:1789049602.063913:0:14317:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789049602.063976:0:15014:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1789049602.063984:0:15014:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d37b956e/0xf4f48ce5e1bbff2e lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049602.063993:0:15014:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1e:0x0].0x0 since=428s v=(0 0) 00010000:00010000:3.0:1789049602.063997:0:15014:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789049602.064002:0:15014:0:(ldlm_resource.c:1751:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d37b956e/0xf4f48ce5e1bbff2e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049602.064011:0:15014:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d37b956e/0xf4f48ce5e1bbff2e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049602.064019:0:15014:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d37b956e/0xf4f48ce5e1bbff2e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049602.064040:0:15014:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d37b956e/0xf4f48ce5e1bbff2e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049602.064073:0:15014:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789049602.064126:0:14317:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00002000:00010000:3.0:1789049602.064462:0:15014:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1789049602.064468:0:15014:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000081773780/0xf4f48ce5e1bbff35 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049602.064476:0:15014:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1d:0x0].0x0 since=428s v=(0 0) 00010000:00010000:3.0:1789049602.064479:0:15014:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789049602.064484:0:15014:0:(ldlm_resource.c:1751:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000081773780/0xf4f48ce5e1bbff35 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049602.064494:0:15014:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000081773780/0xf4f48ce5e1bbff35 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049602.064503:0:15014:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000081773780/0xf4f48ce5e1bbff35 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049602.064512:0:15014:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000081773780/0xf4f48ce5e1bbff35 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049602.064521:0:15014:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1789049602.064907:0:15014:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1789049602.064914:0:15014:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000096c66832/0xf4f48ce5e1bbff3c lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049602.064924:0:15014:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1c:0x0].0x0 since=428s v=(0 0) 00010000:00010000:3.0:1789049602.064932:0:15014:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789049602.064937:0:15014:0:(ldlm_resource.c:1751:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000096c66832/0xf4f48ce5e1bbff3c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049602.064947:0:15014:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000096c66832/0xf4f48ce5e1bbff3c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049602.064955:0:15014:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000096c66832/0xf4f48ce5e1bbff3c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049602.064961:0:15014:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000096c66832/0xf4f48ce5e1bbff3c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049602.064970:0:15014:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1789049602.065051:0:14316:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009e4fa65b/0xf4f48ce5e1bbff27 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049602.065122:0:14316:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009e4fa65b/0xf4f48ce5e1bbff27 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049602.065138:0:14316:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009e4fa65b/0xf4f48ce5e1bbff27 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049602.065146:0:14316:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009e4fa65b/0xf4f48ce5e1bbff27 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049602.065167:0:14316:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1789049602.065171:0:14316:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000081773780/0xf4f48ce5e1bbff35 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049602.065178:0:14316:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cb8c6b35c00 already unused, calling callback (ffffffffc166a8f0) 00010000:00010000:2.0:1789049602.065181:0:14316:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000081773780/0xf4f48ce5e1bbff35 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049602.065188:0:14316:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000081773780/0xf4f48ce5e1bbff35 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049602.065196:0:14316:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000081773780/0xf4f48ce5e1bbff35 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049602.065203:0:14316:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000081773780/0xf4f48ce5e1bbff35 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049602.065219:0:14316:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789049602.065223:0:14316:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000096c66832/0xf4f48ce5e1bbff3c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049602.065230:0:14316:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cb8c6b34e00 already unused, calling callback (ffffffffc166a8f0) 00010000:00010000:2.0:1789049602.065234:0:14316:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000096c66832/0xf4f48ce5e1bbff3c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789049602.065368:0:15014:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1789049602.065374:0:15014:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000095ff868f/0xf4f48ce5e1bbff43 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049602.065383:0:15014:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1b:0x0].0x0 since=428s v=(0 0) 00010000:00010000:3.0:1789049602.065385:0:15014:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789049602.065389:0:15014:0:(ldlm_resource.c:1751:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000095ff868f/0xf4f48ce5e1bbff43 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049602.065398:0:15014:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000095ff868f/0xf4f48ce5e1bbff43 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049602.065405:0:15014:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000095ff868f/0xf4f48ce5e1bbff43 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049602.065418:0:15014:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000095ff868f/0xf4f48ce5e1bbff43 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049602.065426:0:15014:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789049602.065610:0:14316:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000096c66832/0xf4f48ce5e1bbff3c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049602.065625:0:14316:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000096c66832/0xf4f48ce5e1bbff3c lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049602.065633:0:14316:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000096c66832/0xf4f48ce5e1bbff3c lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049602.065646:0:14316:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789049602.065650:0:14316:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000095ff868f/0xf4f48ce5e1bbff43 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049602.065656:0:14316:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cb8c6b34c00 already unused, calling callback (ffffffffc166a8f0) 00010000:00010000:2.0:1789049602.065659:0:14316:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000095ff868f/0xf4f48ce5e1bbff43 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049602.065676:0:14316:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000095ff868f/0xf4f48ce5e1bbff43 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049602.065687:0:14316:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000095ff868f/0xf4f48ce5e1bbff43 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789049602.065802:0:15014:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1789049602.065808:0:15014:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006025434f/0xf4f48ce5e1bbff4a lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049602.065817:0:15014:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1a:0x0].0x0 since=428s v=(0 0) 00010000:00010000:3.0:1789049602.065820:0:15014:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789049602.065824:0:15014:0:(ldlm_resource.c:1751:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006025434f/0xf4f48ce5e1bbff4a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049602.065832:0:15014:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006025434f/0xf4f48ce5e1bbff4a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049602.065840:0:15014:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006025434f/0xf4f48ce5e1bbff4a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049602.065873:0:15014:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006025434f/0xf4f48ce5e1bbff4a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049602.065882:0:15014:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789049602.068433:0:14316:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000095ff868f/0xf4f48ce5e1bbff43 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049602.068463:0:14316:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789049602.068468:0:14316:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006025434f/0xf4f48ce5e1bbff4a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049602.068475:0:14316:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cb8c6b35400 already unused, calling callback (ffffffffc166a8f0) 00010000:00010000:2.0:1789049602.068480:0:14316:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006025434f/0xf4f48ce5e1bbff4a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049602.068490:0:14316:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006025434f/0xf4f48ce5e1bbff4a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049602.068514:0:14316:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006025434f/0xf4f48ce5e1bbff4a lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049602.068522:0:14316:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006025434f/0xf4f48ce5e1bbff4a lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049602.068558:0:14316:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789049602.068560:0:14316:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789049602.068563:0:14316:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789049602.071429:0:15620:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789049602.071435:0:15620:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789049602.071437:0:15620:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789049602.071591:0:14317:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d37b956e/0xf4f48ce5e1bbff2e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049602.071606:0:14317:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cb8c6b35200 already unused, calling callback (ffffffffc166a8f0) 00010000:00010000:2.0:1789049602.071611:0:14317:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d37b956e/0xf4f48ce5e1bbff2e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049602.071621:0:14317:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d37b956e/0xf4f48ce5e1bbff2e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049602.071641:0:14317:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d37b956e/0xf4f48ce5e1bbff2e lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049602.071648:0:14317:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d37b956e/0xf4f48ce5e1bbff2e lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049602.071668:0:14317:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789049602.071669:0:14317:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789049602.071671:0:14317:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789049602.073679:0:15014:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x19:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1789049602.073691:0:15014:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009c029bda/0xf4f48ce5e1bbff51 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049602.073713:0:15014:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x19:0x0].0x0 since=428s v=(0 0) 00010000:00010000:3.0:1789049602.073717:0:15014:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x19:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789049602.073723:0:15014:0:(ldlm_resource.c:1751:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009c029bda/0xf4f48ce5e1bbff51 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049602.073738:0:15014:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009c029bda/0xf4f48ce5e1bbff51 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049602.073747:0:15014:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009c029bda/0xf4f48ce5e1bbff51 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049602.073756:0:15014:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009c029bda/0xf4f48ce5e1bbff51 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049602.073771:0:15014:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1789049602.074237:0:15014:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x18:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1789049602.074244:0:15014:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000048233d98/0xf4f48ce5e1bbff58 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049602.074254:0:15014:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x18:0x0].0x0 since=428s v=(0 0) 00010000:00010000:3.0:1789049602.074258:0:15014:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x18:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789049602.074262:0:15014:0:(ldlm_resource.c:1751:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000048233d98/0xf4f48ce5e1bbff58 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049602.074271:0:15014:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000048233d98/0xf4f48ce5e1bbff58 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049602.074291:0:15014:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000048233d98/0xf4f48ce5e1bbff58 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049602.074298:0:15014:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000048233d98/0xf4f48ce5e1bbff58 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049602.074312:0:15014:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1789049602.074402:0:15620:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1789049602.074410:0:15620:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009c029bda/0xf4f48ce5e1bbff51 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049602.074785:0:15620:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cb8c6b34200 already unused, calling callback (ffffffffc166a8f0) 00010000:00010000:1.0:1789049602.074792:0:15620:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009c029bda/0xf4f48ce5e1bbff51 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789049602.074817:0:15014:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x17:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789049602.074817:0:15620:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009c029bda/0xf4f48ce5e1bbff51 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049602.074828:0:15014:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cb6df1a7/0xf4f48ce5e1bbff5f lrc: 3/0,1 mode: --/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049602.074838:0:15014:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x17:0x0].0x0 since=428s v=(0 0) 00010000:00010000:3.0:1789049602.074866:0:15014:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x17:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789049602.074872:0:15014:0:(ldlm_resource.c:1751:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000cb6df1a7/0xf4f48ce5e1bbff5f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049602.074881:0:15620:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009c029bda/0xf4f48ce5e1bbff51 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049602.074883:0:15014:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000cb6df1a7/0xf4f48ce5e1bbff5f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049602.074901:0:15620:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009c029bda/0xf4f48ce5e1bbff51 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049602.074904:0:15014:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cb6df1a7/0xf4f48ce5e1bbff5f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049602.074924:0:15014:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000cb6df1a7/0xf4f48ce5e1bbff5f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049602.074934:0:15620:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789049602.074939:0:15620:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000048233d98/0xf4f48ce5e1bbff58 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049602.074953:0:15620:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cb8c6b34400 already unused, calling callback (ffffffffc166a8f0) 00010000:00010000:1.0:1789049602.074957:0:15620:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000048233d98/0xf4f48ce5e1bbff58 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049602.074963:0:15014:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789049602.074965:0:15620:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000048233d98/0xf4f48ce5e1bbff58 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049602.074978:0:15620:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000048233d98/0xf4f48ce5e1bbff58 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049602.074984:0:15620:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000048233d98/0xf4f48ce5e1bbff58 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049602.075009:0:15620:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789049602.075012:0:15620:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000cb6df1a7/0xf4f48ce5e1bbff5f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049602.075019:0:15620:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cb8c6b34000 already unused, calling callback (ffffffffc166a8f0) 00010000:00010000:1.0:1789049602.075023:0:15620:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000cb6df1a7/0xf4f48ce5e1bbff5f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049602.075031:0:15620:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000cb6df1a7/0xf4f48ce5e1bbff5f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049602.075044:0:15620:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000cb6df1a7/0xf4f48ce5e1bbff5f lrc: 1/0,0 mode: --/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049602.075369:0:14317:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789049602.075376:0:14316:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789049602.075391:0:15014:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x16:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1789049602.075398:0:15014:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007a34bd43/0xf4f48ce5e1bbff66 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049602.075400:0:15620:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000cb6df1a7/0xf4f48ce5e1bbff5f lrc: 0/0,0 mode: --/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049602.075417:0:15014:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x16:0x0].0x0 since=428s v=(0 0) 00010000:00010000:3.0:1789049602.075421:0:15014:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x16:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789049602.075425:0:15014:0:(ldlm_resource.c:1751:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007a34bd43/0xf4f48ce5e1bbff66 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049602.075435:0:15014:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007a34bd43/0xf4f48ce5e1bbff66 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049602.075435:0:15620:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789049602.075438:0:15620:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789049602.075441:0:15620:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789049602.075448:0:15014:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007a34bd43/0xf4f48ce5e1bbff66 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049602.075454:0:15014:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007a34bd43/0xf4f48ce5e1bbff66 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049602.078248:0:15014:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1789049602.078873:0:15014:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x15:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1789049602.078883:0:15014:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000040a9fa71/0xf4f48ce5e1bbff6d lrc: 3/0,1 mode: --/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049602.078898:0:15014:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x15:0x0].0x0 since=428s v=(0 0) 00010000:00010000:3.0:1789049602.078910:0:15014:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x15:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789049602.078916:0:15014:0:(ldlm_resource.c:1751:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000040a9fa71/0xf4f48ce5e1bbff6d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049602.078931:0:15014:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000040a9fa71/0xf4f48ce5e1bbff6d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049602.078940:0:15014:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000040a9fa71/0xf4f48ce5e1bbff6d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049602.078948:0:15014:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000040a9fa71/0xf4f48ce5e1bbff6d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049602.080208:0:14317:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1789049602.080212:0:15014:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789049602.080220:0:14317:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007a34bd43/0xf4f48ce5e1bbff66 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049602.080229:0:14316:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789049602.080237:0:14316:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000040a9fa71/0xf4f48ce5e1bbff6d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049602.080247:0:14316:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cb8d6714600 already unused, calling callback (ffffffffc166a8f0) 00010000:00010000:3.0:1789049602.080252:0:14316:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000040a9fa71/0xf4f48ce5e1bbff6d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049602.080261:0:14316:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000040a9fa71/0xf4f48ce5e1bbff6d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049602.080278:0:14316:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000040a9fa71/0xf4f48ce5e1bbff6d lrc: 1/0,0 mode: --/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049602.080298:0:14316:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000040a9fa71/0xf4f48ce5e1bbff6d lrc: 0/0,0 mode: --/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049602.080317:0:14316:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789049602.080319:0:14316:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789049602.080321:0:14316:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789049602.080370:0:14317:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cb8d6715400 already unused, calling callback (ffffffffc166a8f0) 00010000:00010000:2.0:1789049602.080375:0:14317:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007a34bd43/0xf4f48ce5e1bbff66 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049602.080385:0:14317:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007a34bd43/0xf4f48ce5e1bbff66 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049602.080397:0:14317:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007a34bd43/0xf4f48ce5e1bbff66 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049602.080403:0:14317:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007a34bd43/0xf4f48ce5e1bbff66 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049602.080675:0:14317:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789049602.080678:0:14317:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789049602.080680:0:14317:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789049602.081232:0:15014:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x14:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1789049602.081240:0:15014:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000064957477/0xf4f48ce5e1bbff74 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049602.081252:0:15014:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=428s v=(0 0) 00010000:00010000:3.0:1789049602.081256:0:15014:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789049602.081261:0:15014:0:(ldlm_resource.c:1751:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000064957477/0xf4f48ce5e1bbff74 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049602.081273:0:15014:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000064957477/0xf4f48ce5e1bbff74 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049602.081286:0:15014:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000064957477/0xf4f48ce5e1bbff74 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049602.081294:0:15014:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000064957477/0xf4f48ce5e1bbff74 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049602.081310:0:15014:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789049602.081320:0:15620:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789049602.081330:0:15620:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000064957477/0xf4f48ce5e1bbff74 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049602.081337:0:15620:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cb8d6714800 already unused, calling callback (ffffffffc166a8f0) 00010000:00010000:3.0:1789049602.081341:0:15620:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000064957477/0xf4f48ce5e1bbff74 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049602.081364:0:15620:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000064957477/0xf4f48ce5e1bbff74 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049602.081376:0:15620:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000064957477/0xf4f48ce5e1bbff74 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049602.081383:0:15620:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000064957477/0xf4f48ce5e1bbff74 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049602.081397:0:15620:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789049602.081399:0:15620:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789049602.081400:0:15620:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789049602.083634:0:15014:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x13:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1789049602.083649:0:15014:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000147d38c/0xf4f48ce5e1bbff7b lrc: 3/0,1 mode: --/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049602.083664:0:15014:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x13:0x0].0x0 since=428s v=(0 0) 00010000:00010000:3.0:1789049602.083669:0:15014:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x13:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789049602.083674:0:15014:0:(ldlm_resource.c:1751:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000147d38c/0xf4f48ce5e1bbff7b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049602.083698:0:15014:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000147d38c/0xf4f48ce5e1bbff7b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049602.083709:0:15014:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000147d38c/0xf4f48ce5e1bbff7b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049602.083717:0:15014:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000147d38c/0xf4f48ce5e1bbff7b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049602.083734:0:15014:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789049602.083746:0:14316:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789049602.083751:0:14316:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000147d38c/0xf4f48ce5e1bbff7b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049602.084022:0:14316:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cb8d6715600 already unused, calling callback (ffffffffc166a8f0) 00010000:00010000:3.0:1789049602.084029:0:14316:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000147d38c/0xf4f48ce5e1bbff7b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049602.084039:0:14316:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000147d38c/0xf4f48ce5e1bbff7b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049602.084053:0:14316:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000147d38c/0xf4f48ce5e1bbff7b lrc: 1/0,0 mode: --/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049602.084061:0:14316:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000147d38c/0xf4f48ce5e1bbff7b lrc: 0/0,0 mode: --/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049602.084085:0:14316:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789049602.084087:0:14316:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789049602.084088:0:14316:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789049602.084752:0:15014:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x12:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1789049602.085029:0:15014:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b0b0f467/0xf4f48ce5e1bbff82 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049602.085042:0:15014:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x12:0x0].0x0 since=428s v=(0 0) 00010000:00010000:3.0:1789049602.085046:0:15014:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x12:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789049602.085052:0:15014:0:(ldlm_resource.c:1751:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b0b0f467/0xf4f48ce5e1bbff82 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049602.085063:0:15014:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b0b0f467/0xf4f48ce5e1bbff82 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049602.085072:0:15014:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b0b0f467/0xf4f48ce5e1bbff82 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049602.085079:0:15014:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b0b0f467/0xf4f48ce5e1bbff82 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049602.085099:0:15014:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789049602.085110:0:14317:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789049602.085595:0:14317:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b0b0f467/0xf4f48ce5e1bbff82 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049602.085620:0:14317:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cb8d6714400 already unused, calling callback (ffffffffc166a8f0) 00010000:00010000:3.0:1789049602.085624:0:14317:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b0b0f467/0xf4f48ce5e1bbff82 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049602.085635:0:14317:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b0b0f467/0xf4f48ce5e1bbff82 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049602.085650:0:14317:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b0b0f467/0xf4f48ce5e1bbff82 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049602.085658:0:14317:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b0b0f467/0xf4f48ce5e1bbff82 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049602.085676:0:14317:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789049602.085678:0:14317:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789049602.085680:0:14317:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789049602.088719:0:15014:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x11:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1789049602.088734:0:15014:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000040a9fa71/0xf4f48ce5e1bbff89 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049602.088751:0:15014:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=428s v=(0 0) 00010000:00010000:3.0:1789049602.088756:0:15014:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789049602.088901:0:15014:0:(ldlm_resource.c:1751:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000040a9fa71/0xf4f48ce5e1bbff89 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049602.088915:0:15014:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000040a9fa71/0xf4f48ce5e1bbff89 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049602.089233:0:15014:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000040a9fa71/0xf4f48ce5e1bbff89 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049602.089245:0:15014:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000040a9fa71/0xf4f48ce5e1bbff89 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049602.089263:0:15014:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789049602.089275:0:15620:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789049602.089280:0:15620:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000040a9fa71/0xf4f48ce5e1bbff89 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049602.089288:0:15620:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cb8d6714600 already unused, calling callback (ffffffffc166a8f0) 00010000:00010000:3.0:1789049602.089293:0:15620:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000040a9fa71/0xf4f48ce5e1bbff89 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049602.089303:0:15620:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000040a9fa71/0xf4f48ce5e1bbff89 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049602.089319:0:15620:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000040a9fa71/0xf4f48ce5e1bbff89 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049602.089327:0:15620:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000040a9fa71/0xf4f48ce5e1bbff89 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049602.089353:0:15620:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789049602.089360:0:15620:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789049602.089362:0:15620:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789049602.092684:0:15014:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x10:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1789049602.092698:0:15014:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000064957477/0xf4f48ce5e1bbff90 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049602.092714:0:15014:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x10:0x0].0x0 since=428s v=(0 0) 00010000:00010000:3.0:1789049602.092718:0:15014:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x10:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789049602.092725:0:15014:0:(ldlm_resource.c:1751:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000064957477/0xf4f48ce5e1bbff90 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049602.092739:0:15014:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000064957477/0xf4f48ce5e1bbff90 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049602.092749:0:15014:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000064957477/0xf4f48ce5e1bbff90 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049602.093623:0:15014:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000064957477/0xf4f48ce5e1bbff90 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049602.093649:0:15014:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789049602.093664:0:14316:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789049602.093669:0:14316:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000064957477/0xf4f48ce5e1bbff90 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049602.093677:0:14316:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cb8d6714800 already unused, calling callback (ffffffffc166a8f0) 00010000:00010000:3.0:1789049602.093681:0:14316:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000064957477/0xf4f48ce5e1bbff90 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049602.093702:0:14316:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000064957477/0xf4f48ce5e1bbff90 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049602.093717:0:14316:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000064957477/0xf4f48ce5e1bbff90 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049602.093724:0:14316:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000064957477/0xf4f48ce5e1bbff90 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049602.093739:0:14316:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789049602.093741:0:14316:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789049602.093743:0:14316:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789049602.096454:0:15014:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1789049602.096468:0:15014:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000040a9fa71/0xf4f48ce5e1bbff97 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049602.096484:0:15014:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xf:0x0].0x0 since=428s v=(0 0) 00010000:00010000:3.0:1789049602.096488:0:15014:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789049602.096493:0:15014:0:(ldlm_resource.c:1751:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000040a9fa71/0xf4f48ce5e1bbff97 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049602.096507:0:15014:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000040a9fa71/0xf4f48ce5e1bbff97 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049602.096517:0:15014:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000040a9fa71/0xf4f48ce5e1bbff97 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049602.096602:0:15014:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000040a9fa71/0xf4f48ce5e1bbff97 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049602.096630:0:15014:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789049602.098051:0:14317:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789049602.098060:0:14317:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000040a9fa71/0xf4f48ce5e1bbff97 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049602.098070:0:14317:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cb8d6714600 already unused, calling callback (ffffffffc166a8f0) 00010000:00010000:0.0:1789049602.098075:0:14317:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000040a9fa71/0xf4f48ce5e1bbff97 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049602.098096:0:14317:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000040a9fa71/0xf4f48ce5e1bbff97 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049602.098116:0:14317:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000040a9fa71/0xf4f48ce5e1bbff97 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049602.098125:0:14317:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000040a9fa71/0xf4f48ce5e1bbff97 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049602.098144:0:14317:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789049602.098145:0:14317:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789049602.098147:0:14317:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789049602.098507:0:15014:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xe:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1789049602.098515:0:15014:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b0b0f467/0xf4f48ce5e1bbff9e lrc: 3/0,1 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049602.099014:0:15014:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=428s v=(0 0) 00010000:00010000:3.0:1789049602.099020:0:15014:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789049602.099026:0:15014:0:(ldlm_resource.c:1751:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b0b0f467/0xf4f48ce5e1bbff9e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049602.099038:0:15014:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b0b0f467/0xf4f48ce5e1bbff9e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049602.099048:0:15014:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b0b0f467/0xf4f48ce5e1bbff9e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049602.099056:0:15014:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b0b0f467/0xf4f48ce5e1bbff9e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049602.099082:0:15014:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789049602.099096:0:15620:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789049602.099101:0:15620:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b0b0f467/0xf4f48ce5e1bbff9e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049602.099109:0:15620:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cb8d6714400 already unused, calling callback (ffffffffc166a8f0) 00010000:00010000:0.0:1789049602.099113:0:15620:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b0b0f467/0xf4f48ce5e1bbff9e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049602.099121:0:15620:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b0b0f467/0xf4f48ce5e1bbff9e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049602.099134:0:15620:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b0b0f467/0xf4f48ce5e1bbff9e lrc: 1/0,0 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049602.099152:0:15620:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b0b0f467/0xf4f48ce5e1bbff9e lrc: 0/0,0 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049602.099464:0:15620:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789049602.099467:0:15620:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789049602.099469:0:15620:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789049602.100686:0:15014:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1789049602.100696:0:15014:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000147d38c/0xf4f48ce5e1bbffa5 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049602.100717:0:15014:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=428s v=(0 0) 00010000:00010000:3.0:1789049602.100721:0:15014:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789049602.100727:0:15014:0:(ldlm_resource.c:1751:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000147d38c/0xf4f48ce5e1bbffa5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049602.100740:0:15014:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000147d38c/0xf4f48ce5e1bbffa5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049602.100750:0:15014:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000147d38c/0xf4f48ce5e1bbffa5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049602.100772:0:15014:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000147d38c/0xf4f48ce5e1bbffa5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049602.100795:0:15014:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1789049602.101222:0:15014:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1789049602.101228:0:15014:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000770bf68f/0xf4f48ce5e1bbffac lrc: 3/0,1 mode: --/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049602.101237:0:15014:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xc:0x0].0x0 since=428s v=(0 0) 00010000:00010000:3.0:1789049602.101240:0:15014:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789049602.101244:0:15014:0:(ldlm_resource.c:1751:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000770bf68f/0xf4f48ce5e1bbffac lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049602.101254:0:15014:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000770bf68f/0xf4f48ce5e1bbffac lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049602.101273:0:15014:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000770bf68f/0xf4f48ce5e1bbffac lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049602.101281:0:15014:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000770bf68f/0xf4f48ce5e1bbffac lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049602.101293:0:15014:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1789049602.101378:0:14316:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1789049602.101385:0:14316:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000147d38c/0xf4f48ce5e1bbffa5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049602.101393:0:14316:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cb8d6715600 already unused, calling callback (ffffffffc166a8f0) 00010000:00010000:0.0:1789049602.101397:0:14316:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000147d38c/0xf4f48ce5e1bbffa5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049602.101406:0:14316:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000147d38c/0xf4f48ce5e1bbffa5 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049602.101421:0:14316:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000147d38c/0xf4f48ce5e1bbffa5 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049602.101428:0:14316:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000147d38c/0xf4f48ce5e1bbffa5 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049602.101445:0:14316:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789049602.101448:0:14316:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000770bf68f/0xf4f48ce5e1bbffac lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049602.101462:0:14316:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cb8d6715000 already unused, calling callback (ffffffffc166a8f0) 00010000:00010000:0.0:1789049602.101465:0:14316:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000770bf68f/0xf4f48ce5e1bbffac lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049602.101472:0:14316:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000770bf68f/0xf4f48ce5e1bbffac lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049602.101483:0:14316:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000770bf68f/0xf4f48ce5e1bbffac lrc: 1/0,0 mode: --/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049602.101490:0:14316:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000770bf68f/0xf4f48ce5e1bbffac lrc: 0/0,0 mode: --/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049602.101503:0:14316:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789049602.101505:0:14316:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789049602.101506:0:14316:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789049602.101512:0:14317:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789049602.102194:0:15014:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1789049602.102200:0:15014:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000965d1f06/0xf4f48ce5e1bbffb3 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049602.102211:0:15014:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb:0x0].0x0 since=428s v=(0 0) 00010000:00010000:3.0:1789049602.102214:0:15014:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789049602.102219:0:15014:0:(ldlm_resource.c:1751:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000965d1f06/0xf4f48ce5e1bbffb3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049602.102228:0:15014:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000965d1f06/0xf4f48ce5e1bbffb3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049602.102236:0:15014:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000965d1f06/0xf4f48ce5e1bbffb3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049602.102244:0:15014:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000965d1f06/0xf4f48ce5e1bbffb3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049602.102278:0:15014:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00080000:2.0:1789049602.102756:0:5872:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00010000:00010000:1.0:1789049602.102861:0:15620:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789049602.102867:0:15620:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000965d1f06/0xf4f48ce5e1bbffb3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049602.102875:0:15620:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cb8d6714000 already unused, calling callback (ffffffffc166a8f0) 00010000:00010000:1.0:1789049602.102885:0:15620:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000965d1f06/0xf4f48ce5e1bbffb3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049602.102894:0:15620:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000965d1f06/0xf4f48ce5e1bbffb3 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049602.102908:0:15620:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000965d1f06/0xf4f48ce5e1bbffb3 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049602.102916:0:15620:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000965d1f06/0xf4f48ce5e1bbffb3 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049602.103045:0:15620:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789049602.103047:0:15620:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789049602.103052:0:15620:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789049602.103680:0:15014:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xa:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1789049602.103687:0:15014:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003144160e/0xf4f48ce5e1bbffba lrc: 3/0,1 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049602.103700:0:15014:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa:0x0].0x0 since=428s v=(0 0) 00010000:00010000:3.0:1789049602.103704:0:15014:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789049602.103709:0:15014:0:(ldlm_resource.c:1751:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003144160e/0xf4f48ce5e1bbffba lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049602.103720:0:15014:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003144160e/0xf4f48ce5e1bbffba lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049602.103729:0:15014:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003144160e/0xf4f48ce5e1bbffba lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049602.103738:0:15014:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003144160e/0xf4f48ce5e1bbffba lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049602.104611:0:15014:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1789049602.105502:0:15014:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1789049602.105511:0:15014:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ec42a189/0xf4f48ce5e1bbffc1 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049602.105526:0:15014:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x9:0x0].0x0 since=428s v=(0 0) 00010000:00010000:3.0:1789049602.105536:0:15014:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789049602.105542:0:15014:0:(ldlm_resource.c:1751:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ec42a189/0xf4f48ce5e1bbffc1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049602.105556:0:15014:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ec42a189/0xf4f48ce5e1bbffc1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049602.105566:0:15014:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ec42a189/0xf4f48ce5e1bbffc1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049602.105575:0:15014:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ec42a189/0xf4f48ce5e1bbffc1 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049602.106597:0:14316:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1789049602.106631:0:15014:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1789049602.107174:0:15014:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1789049602.107183:0:15014:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001ed3bcdf/0xf4f48ce5e1bbffc8 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049602.107197:0:15014:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8:0x0].0x0 since=428s v=(0 0) 00010000:00010000:3.0:1789049602.107201:0:15014:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789049602.107207:0:15014:0:(ldlm_resource.c:1751:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001ed3bcdf/0xf4f48ce5e1bbffc8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049602.107220:0:15014:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001ed3bcdf/0xf4f48ce5e1bbffc8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049602.107229:0:15014:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001ed3bcdf/0xf4f48ce5e1bbffc8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049602.107243:0:15014:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001ed3bcdf/0xf4f48ce5e1bbffc8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049602.107524:0:14317:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1789049602.107531:0:14317:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ec42a189/0xf4f48ce5e1bbffc1 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049602.107540:0:14317:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cb8d6715800 already unused, calling callback (ffffffffc166a8f0) 00010000:00010000:0.0:1789049602.107834:0:14316:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003144160e/0xf4f48ce5e1bbffba lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049602.107855:0:14316:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cb8d6714c00 already unused, calling callback (ffffffffc166a8f0) 00010000:00010000:0.0:1789049602.107859:0:14316:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003144160e/0xf4f48ce5e1bbffba lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049602.107869:0:14316:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003144160e/0xf4f48ce5e1bbffba lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049602.107896:0:14316:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003144160e/0xf4f48ce5e1bbffba lrc: 1/0,0 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049602.107904:0:14316:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003144160e/0xf4f48ce5e1bbffba lrc: 0/0,0 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049602.107909:0:14317:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ec42a189/0xf4f48ce5e1bbffc1 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049602.107921:0:14317:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ec42a189/0xf4f48ce5e1bbffc1 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049602.107990:0:14317:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ec42a189/0xf4f48ce5e1bbffc1 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049602.108006:0:14317:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ec42a189/0xf4f48ce5e1bbffc1 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049602.108021:0:14317:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789049602.108024:0:14317:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001ed3bcdf/0xf4f48ce5e1bbffc8 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049602.108030:0:14317:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cb8d6714e00 already unused, calling callback (ffffffffc166a8f0) 00010000:00010000:1.0:1789049602.108033:0:14317:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001ed3bcdf/0xf4f48ce5e1bbffc8 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049602.108040:0:14317:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001ed3bcdf/0xf4f48ce5e1bbffc8 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049602.108049:0:14317:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001ed3bcdf/0xf4f48ce5e1bbffc8 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049602.108056:0:14317:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789049602.108058:0:14317:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789049602.108060:0:14317:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789049602.108213:0:14316:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789049602.108215:0:14316:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789049602.108217:0:14316:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789049602.108318:0:15014:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1789049602.108325:0:15014:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001ed3bcdf/0xf4f48ce5e1bbffc8 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049602.109017:0:15620:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789049602.109227:0:15014:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1789049602.109237:0:15014:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007011bca5/0xf4f48ce5e1bbffcf lrc: 3/0,1 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049602.109252:0:15014:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=428s v=(0 0) 00010000:00010000:3.0:1789049602.109257:0:15014:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789049602.109265:0:15014:0:(ldlm_resource.c:1751:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007011bca5/0xf4f48ce5e1bbffcf lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049602.109280:0:15014:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007011bca5/0xf4f48ce5e1bbffcf lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049602.109291:0:15014:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007011bca5/0xf4f48ce5e1bbffcf lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049602.109300:0:15014:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007011bca5/0xf4f48ce5e1bbffcf lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049602.109378:0:15014:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00080000:3.0:1789049602.109615:0:15014:0:(ofd_dev.c:1524:ofd_orphans_destroy()) lustre-OST0000: after destroy: set last_id to 0x240000400:6 00000100:00100000:3.0:1789049602.109704:0:15014:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb900e96a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:14350:x1875954110655616:12345-0@lo:5:osp-pre-0-0.0 Request processed in 79177us (79330us total) trans 0 rc 0/0 00000100:00100000:3.0:1789049602.109718:0:15014:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1789049602.110085:0:14350:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb900e95c00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14350:1875954110655616:0@lo:5:osp-pre-0-0.0 00000004:00080000:2.0:1789049602.110101:0:14350:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x240000400:0x21:0x0] from OST, last_created [0x240000400:0x21:0x0]last_used is [0x240000400:0x6:0x0] 00010000:00010000:1.0:1789049602.110105:0:14317:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789049602.110112:0:14317:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007011bca5/0xf4f48ce5e1bbffcf lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789049602.110141:0:14350:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb900e95c00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14350:1875954110655744:0@lo:5:osp-pre-0-0.0 00000100:00100000:2.0:1789049602.110175:0:14350:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1789049602.110198:0:14317:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cb8d6714a00 already unused, calling callback (ffffffffc166a8f0) 00010000:00010000:1.0:1789049602.110202:0:14317:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007011bca5/0xf4f48ce5e1bbffcf lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049602.110211:0:14317:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007011bca5/0xf4f48ce5e1bbffcf lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789049602.110219:0:14350:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cb8c799fc00 going to sleep for 11 seconds 00010000:00010000:1.0:1789049602.110226:0:14317:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007011bca5/0xf4f48ce5e1bbffcf lrc: 1/0,0 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049602.110233:0:14317:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007011bca5/0xf4f48ce5e1bbffcf lrc: 0/0,0 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049602.110249:0:14317:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789049602.110251:0:14317:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789049602.110253:0:14317:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789049602.110315:0:15013:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954110655744 00000100:00100000:3.0:1789049602.110322:0:15013:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954110655744 00000100:00100000:3.0:1789049602.110368:0:15013:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1789049602.110377:0:15013:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb900e94000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:14350:x1875954110655744:12345-0@lo:5:osp-pre-0-0.0 00002000:00080000:3.0:1789049602.110415:0:15013:0:(ofd_dev.c:1753:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x240000400 at 34 00000100:00100000:3.0:1789049602.117807:0:15013:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb900e94000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:14350:x1875954110655744:12345-0@lo:5:osp-pre-0-0.0 Request processed in 7425us (7625us total) trans 8589934593 rc 0/0 00000100:00100000:3.0:1789049602.117819:0:15013:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1789049602.119429:0:14350:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb900e95c00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14350:1875954110655744:0@lo:5:osp-pre-0-0.0 00000004:00080000:2.0:1789049602.119447:0:14350:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x240000400:0x21:0x0]-[0x240000400:0x41:0x0] 00010000:00010000:1.0:1789049602.139946:0:14316:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789049603.163045:0:15620:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1789049603.674434:0:15730:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:2.0:1789049603.674437:0:15730:0:(obd_mount.c:926:lmd_print()) device: lustre-ost2/ost2 00000080:01200004:2.0:1789049603.674530:0:15730:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff8cb7c10e3800 00000020:01000004:2.0:1789049603.674541:0:15730:0:(tgt_mount.c:2502:osd_start()) Attempting to start lustre-OST0001, type=osd-zfs, lsifl=200002, mountfl=0 00000020:01000004:2.0:1789049603.674550:0:15730:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0001-osd (typ=osd-zfs) 00000020:00000080:2.0:1789049603.674559:0:15730:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osd (ffff8cb7c6034d40) 00000020:00000080:2.0:1789049603.674570:0:15730:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type osd-zfs with refcount 2 00100000:10000000:3.0:1789049603.696017:0:15730:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:3.0:1789049603.697478:0:15730:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0001: registered index [0x200000001:0x3:0x0] (8/24) 00100000:10000000:3.0:1789049603.699431:0:15730:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:3.0:1789049603.700381:0:15730:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00100000:10000000:3.0:1789049603.705275:0:15730:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0001: registered index [0x200000003:0x3:0x0] (8/32) 00100000:10000000:3.0:1789049603.705724:0:15730:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled lustre-client under 477: rc = 0 00100000:10000000:3.0:1789049603.705810:0:15730:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled lustre-OST0001 under 477: rc = 0 00100000:10000000:3.0:1789049603.705925:0:15730:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled params under 477: rc = 0 00100000:10000000:3.0:1789049603.706434:0:15730:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x20000-OST0001 under 640: rc = 0 00100000:10000000:3.0:1789049603.706676:0:15730:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x2020000 under 640: rc = 0 00100000:10000000:3.0:1789049603.706952:0:15730:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x20000 under 640: rc = 0 00100000:10000000:3.0:1789049603.707210:0:15730:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x1020000 under 640: rc = 0 00100000:10000000:3.0:1789049603.707471:0:15730:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x1020000-OST0001 under 640: rc = 0 00100000:10000000:3.0:1789049603.707712:0:15730:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x2020000-OST0001 under 640: rc = 0 00000020:00000080:0.0:1789049603.708700:0:15730:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00080000:01000000:0.0:1789049603.708713:0:15730:0:(osd_handler.c:1574:osd_obd_connect()) connect #0 00000020:00000080:0.0:1789049603.708722:0:15730:0:(genops.c:1384:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0xf4f48ce5e1bbffdd 00000020:01000004:0.0:1789049603.708731:0:15730:0:(tgt_mount.c:2587:server_fill_super()) Found service lustre-OST0001 on device lustre-ost2/ost2 00000020:01000004:0.0:1789049603.708751:0:15730:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.206.126@tcp:Set MGC reconnect 1 10000000:01000000:0.0:1789049603.708754:0:15730:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.206.126@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:0.0:1789049603.708760:0:15730:0:(tgt_mount.c:1808:server_start_targets()) starting target lustre-OST0001 00000020:01000004:0.0:1789049603.708780:0:15730:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost2/ost2 10000000:01000000:0.0:1789049603.708785:0:15730:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.206.126@tcp: cl_mgc_mutex lustre-OST0001-osd for locked: rc = 0 00000040:01000000:1.0:1789049603.717404:0:15730:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.206.126@tcp ctxt 0 is initialized 00000020:01000004:1.0:1789049603.717438:0:15730:0:(tgt_mount.c:1416:server_register_target()) Registration lustre-OST0001, fs=lustre, 192.168.206.126@tcp, index=0001, flags=0x20002 00000020:01000004:1.0:1789049603.717442:0:15730:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:1.0:1789049603.717444:0:15730:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1789049603.717445:0:15730:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1789049603.717446:0:15730:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1789049603.717447:0:15730:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1789049603.717448:0:15730:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1789049603.717449:0:15730:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1789049603.717451:0:15730:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1789049603.717452:0:15730:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1789049603.717460:0:15730:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x10020002 00000020:01000004:1.0:1789049603.717462:0:15730:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1789049603.717463:0:15730:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1789049603.717464:0:15730:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1789049603.717465:0:15730:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1789049603.717466:0:15730:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1789049603.717467:0:15730:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1789049603.717467:0:15730:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1789049603.717468:0:15730:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1789049603.717469:0:15730:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1789049603.717494:0:15730:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:1.0:1789049603.717513:0:15730:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb900e41f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:817823bd-3ba1-432d-9714-f03a15bff403:15730:1875954110655872:0@lo:253:mount.lustre.0 00000100:00100000:1.0:1789049603.717580:0:15730:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789049603.717661:0:15730:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cb8c576f780 going to sleep for 11 seconds 00000100:00100000:0.0:1789049603.717708:0:14321:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954110655872 00000100:00100000:0.0:1789049603.717715:0:14321:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954110655872 00000100:00100000:0.0:1789049603.717798:0:14321:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1789049603.717807:0:14321:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8d6a25c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:817823bd-3ba1-432d-9714-f03a15bff403+16:15730:x1875954110655872:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1789049603.717831:0:14321:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:0.0:1789049603.717834:0:14321:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0001 is running on 0@lo 20000000:01000000:0.0:1789049603.717837:0:14321:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:3.0:1789049603.753492:0:14321:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8d6a25c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:817823bd-3ba1-432d-9714-f03a15bff403+16:15730:x1875954110655872:12345-0@lo:253:mount.lustre.0 Request processed in 35678us (35903us total) trans 0 rc 0/0 00000100:00100000:3.0:1789049603.753507:0:14321:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1789049603.753590:0:15730:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb900e41f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:817823bd-3ba1-432d-9714-f03a15bff403:15730:1875954110655872:0@lo:253:mount.lustre.0 10000000:01000000:1.0:1789049603.753606:0:15730:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:1.0:1789049603.753609:0:15730:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1789049603.753611:0:15730:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1789049603.753613:0:15730:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1789049603.753614:0:15730:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1789049603.753616:0:15730:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1789049603.753617:0:15730:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1789049603.753619:0:15730:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1789049603.753621:0:15730:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1789049603.753622:0:15730:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:1.0:1789049603.753645:0:15730:0:(tgt_mount.c:101:server_register_mount()) register mount ffff8cb7c10e3800 from lustre-OST0001 10000000:01000000:1.0:1789049603.753670:0:15730:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0001 from 0 10000000:01000000:1.0:1789049603.753673:0:15730:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0001-0000000000000000 10000000:01000000:1.0:1789049603.753746:0:15730:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff8cb900ba8000 local copy 00010000:00010000:1.0:1789049603.753757:0:15730:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.126@tcp lock: ffff8cb8c6b35e00/0xf4f48ce5e1bbfd8a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xf4f48ce5e1bbfd91 expref: -99 pid: 14310 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789049603.754014:0:15730:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb900e41f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:817823bd-3ba1-432d-9714-f03a15bff403:15730:1875954110656000:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789049603.754050:0:15730:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789049603.754141:0:15730:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cb8c576f6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789049603.754188:0:14322:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954110656000 00000100:00100000:2.0:1789049603.754195:0:14322:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954110656000 00000100:00100000:2.0:1789049603.754237:0:14322:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1789049603.754373:0:14322:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8d6a25050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:817823bd-3ba1-432d-9714-f03a15bff403+16:15730:x1875954110656000:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789049603.754573:0:14322:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8d6a25050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:817823bd-3ba1-432d-9714-f03a15bff403+16:15730:x1875954110656000:12345-0@lo:501:mount.lustre.0 Request processed in 328us (522us total) trans 0 rc -2/-2 00000100:00100000:2.0:1789049603.754581:0:14322:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1789049603.754645:0:15730:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb900e41f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:817823bd-3ba1-432d-9714-f03a15bff403:15730:1875954110656000:0@lo:501:mount.lustre.0 10000000:01000000:1.0:1789049603.754659:0:15730:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.206.126@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:1.0:1789049603.756889:0:15730:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.206.126@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:1.0:1789049603.756903:0:15730:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.126@tcp lock: ffff8cb8c6b35e00/0xf4f48ce5e1bbfd8a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xf4f48ce5e1bbfd91 expref: -99 pid: 14310 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049603.756916:0:15730:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.126@tcp lock: ffff8cb8c6b35e00/0xf4f48ce5e1bbfd8a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xf4f48ce5e1bbfd91 expref: -99 pid: 14310 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789049603.756952:0:15730:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff8cb7c10e3800 10000000:01000000:1.0:1789049603.756957:0:15730:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:1.0:1789049603.756963:0:15730:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0001-0000000000000000 10000000:01000000:1.0:1789049603.756965:0:15730:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1789049603.756969:0:15730:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 1 10000000:01000000:1.0:1789049603.756972:0:15730:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:1.0:1789049603.757003:0:15730:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.126@tcp lock: ffff8cb8c28c2000/0xf4f48ce5e1bbffe4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15730 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049603.757010:0:15730:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.126@tcp lock: ffff8cb8c28c2000/0xf4f48ce5e1bbffe4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15730 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049603.757021:0:15730:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.126@tcp lock: ffff8cb8c28c2000/0xf4f48ce5e1bbffe4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15730 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789049603.757107:0:15730:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb900e41f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:817823bd-3ba1-432d-9714-f03a15bff403:15730:1875954110656128:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1789049603.757206:0:15730:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789049603.757360:0:15730:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cb8c576f6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789049603.757405:0:14321:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954110656128 00000100:00100000:3.0:1789049603.757412:0:14321:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954110656128 00000100:00100000:3.0:1789049603.757459:0:14321:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1789049603.757468:0:14321:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8d6a25850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:817823bd-3ba1-432d-9714-f03a15bff403+16:15730:x1875954110656128:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1789049603.757481:0:14321:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789049603.757494:0:14321:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cb8d6714e00/0xf4f48ce5e1bbffeb lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xf4f48ce5e1bbffe4 expref: -99 pid: 14321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049603.757519:0:14321:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cb8d6714e00/0xf4f48ce5e1bbffeb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf4f48ce5e1bbffe4 expref: 17 pid: 14321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049603.757530:0:14321:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cb8d6714e00/0xf4f48ce5e1bbffeb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf4f48ce5e1bbffe4 expref: 17 pid: 14321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049603.757539:0:14321:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cb8d6714e00, rc 0) 00000100:00100000:3.0:1789049603.757592:0:14321:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8d6a25850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:817823bd-3ba1-432d-9714-f03a15bff403+17:15730:x1875954110656128:12345-0@lo:101:mount.lustre.0 Request processed in 125us (386us total) trans 0 rc 0/0 00000100:00100000:3.0:1789049603.757599:0:14321:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1789049603.757630:0:15730:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb900e41f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:817823bd-3ba1-432d-9714-f03a15bff403:15730:1875954110656128:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1789049603.757643:0:15730:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.126@tcp lock: ffff8cb8c28c2000/0xf4f48ce5e1bbffe4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xf4f48ce5e1bbffeb expref: -99 pid: 15730 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049603.757659:0:15730:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.126@tcp lock: ffff8cb8c28c2000/0xf4f48ce5e1bbffe4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0xf4f48ce5e1bbffeb expref: -99 pid: 15730 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1789049603.758194:0:15730:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000040:00080000:1.0:1789049603.759095:0:15730:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1789049603.759351:0:15730:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].1, 224 off8416 00000040:00080000:1.0:1789049603.759392:0:15730:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].2, 128 off8544 00000040:00080000:1.0:1789049603.759416:0:15730:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].3, 112 off8656 00000040:00080000:1.0:1789049603.759451:0:15730:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].4, 224 off8880 00000040:00080000:1.0:1789049603.759479:0:15730:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].5, 224 off9104 00000040:00080000:1.0:1789049603.759577:0:15730:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].6, 80 off9184 00000040:00080000:1.0:1789049603.759646:0:15730:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].7, 224 off9408 00000040:00080000:1.0:1789049603.759654:0:15730:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 8 00000100:00100000:1.0:1789049603.759723:0:15730:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb900e41f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:817823bd-3ba1-432d-9714-f03a15bff403:15730:1875954110656256:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789049603.759770:0:15730:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789049603.759878:0:15730:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cb8c576fd80 going to sleep for 11 seconds 00000100:00100000:2.0:1789049603.759919:0:14322:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954110656256 00000100:00100000:2.0:1789049603.759924:0:14322:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954110656256 00000100:00100000:2.0:1789049603.759967:0:14322:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1789049603.759976:0:14322:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8d6a27c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:817823bd-3ba1-432d-9714-f03a15bff403+17:15730:x1875954110656256:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789049603.760301:0:14322:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8d6a27c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:817823bd-3ba1-432d-9714-f03a15bff403+17:15730:x1875954110656256:12345-0@lo:501:mount.lustre.0 Request processed in 325us (529us total) trans 0 rc 0/0 00000100:00100000:2.0:1789049603.760308:0:14322:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1789049603.760384:0:15730:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb900e41f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:817823bd-3ba1-432d-9714-f03a15bff403:15730:1875954110656256:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789049603.760412:0:15730:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb900e41f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:817823bd-3ba1-432d-9714-f03a15bff403:15730:1875954110656384:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1789049603.760445:0:15730:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789049603.760464:0:15730:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cb8c576fd80 going to sleep for 11 seconds 00000100:00100000:3.0:1789049603.760566:0:14321:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954110656384 00000100:00100000:3.0:1789049603.760571:0:14321:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954110656384 00000100:00100000:3.0:1789049603.760604:0:14321:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1789049603.760611:0:14321:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb900c58050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:817823bd-3ba1-432d-9714-f03a15bff403+17:15730:x1875954110656384:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1789049603.760916:0:14321:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb900c58050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:817823bd-3ba1-432d-9714-f03a15bff403+17:15730:x1875954110656384:12345-0@lo:503:mount.lustre.0 Request processed in 304us (469us total) trans 0 rc 0/0 00000100:00100000:3.0:1789049603.760923:0:14321:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1789049603.760938:0:15730:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb900e41f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:817823bd-3ba1-432d-9714-f03a15bff403:15730:1875954110656384:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1789049603.761537:0:15730:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1789049603.761611:0:15730:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb900e41f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:817823bd-3ba1-432d-9714-f03a15bff403:15730:1875954110656512:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1789049603.761649:0:15730:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789049603.761682:0:15730:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cb8c576fd80 going to sleep for 11 seconds 00000100:00100000:2.0:1789049603.761701:0:14322:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954110656512 00000100:00100000:2.0:1789049603.761706:0:14322:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954110656512 00000100:00100000:2.0:1789049603.761755:0:14322:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1789049603.761763:0:14322:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb900c5b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:817823bd-3ba1-432d-9714-f03a15bff403+17:15730:x1875954110656512:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1789049603.762038:0:14322:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb900c5b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:817823bd-3ba1-432d-9714-f03a15bff403+17:15730:x1875954110656512:12345-0@lo:502:mount.lustre.0 Request processed in 275us (387us total) trans 0 rc 0/0 00000100:00100000:3.0:1789049603.762046:0:14322:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1789049603.762135:0:15730:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb900e41f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:817823bd-3ba1-432d-9714-f03a15bff403:15730:1875954110656512:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1789049603.762393:0:15730:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].1, 224 off8416 00000040:00080000:1.0:1789049603.762443:0:15730:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].2, 128 off8544 00000040:00080000:1.0:1789049603.762479:0:15730:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].3, 112 off8656 00000040:00080000:1.0:1789049603.762673:0:15730:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].4, 224 off8880 00000040:00080000:1.0:1789049603.762712:0:15730:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].5, 224 off9104 00000040:00080000:1.0:1789049603.762749:0:15730:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].6, 80 off9184 00000040:00080000:1.0:1789049603.762798:0:15730:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].7, 224 off9408 00000040:00080000:1.0:1789049603.762830:0:15730:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].8, 224 off9632 00000040:00080000:1.0:1789049603.762909:0:15730:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].9, 120 off9752 00000100:00100000:1.0:1789049603.762943:0:15730:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb900e41f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:817823bd-3ba1-432d-9714-f03a15bff403:15730:1875954110656640:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1789049603.762987:0:15730:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789049603.763016:0:15730:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cb8c576fd80 going to sleep for 11 seconds 00000100:00100000:0.0:1789049603.763128:0:14323:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954110656640 00000100:00100000:0.0:1789049603.763134:0:14323:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954110656640 00000100:00100000:0.0:1789049603.763180:0:14323:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1789049603.763188:0:14323:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb900c58c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:817823bd-3ba1-432d-9714-f03a15bff403+17:15730:x1875954110656640:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1789049603.763427:0:14323:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb900c58c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:817823bd-3ba1-432d-9714-f03a15bff403+17:15730:x1875954110656640:12345-0@lo:502:mount.lustre.0 Request processed in 239us (439us total) trans 0 rc 0/0 00000100:00100000:0.0:1789049603.763433:0:14323:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1789049603.763626:0:15730:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb900e41f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:817823bd-3ba1-432d-9714-f03a15bff403:15730:1875954110656640:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1789049603.763688:0:15730:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].10, 224 off9976 00000040:00080000:2.0:1789049603.763702:0:15730:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 10 count 11 00000020:01000000:2.0:1789049603.765105:0:15732:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1789049603.765114:0:15732:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-ost2/ost2 00000020:00000080:2.0:1789049603.765121:0:15732:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789049603.765123:0:15732:0:(obd_config.c:1563:class_process_config()) marker 17 (0x1) lustre-OST0001 add ost 00000020:00000080:2.0:1789049603.765130:0:15732:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1789049603.765143:0:15732:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001 (ffff8cb7c6030000) 00000020:00000080:2.0:1789049603.765163:0:15732:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type obdfilter with refcount 2 00000020:00000080:2.0:1789049603.765169:0:15732:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:2.0:1789049603.765219:0:15732:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8cb7c10e3800 from lustre-OST0001, refs=2 00080000:01000000:2.0:1789049603.765225:0:15732:0:(osd_handler.c:1574:osd_obd_connect()) connect #1 00000020:00000080:2.0:1789049603.765230:0:15732:0:(genops.c:1384:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0xf4f48ce5e1bbfff9 00010000:00010000:2.0:1789049603.768588:0:15732:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0001_UUID-3 is initialized 00000001:00000004:2.0:1789049603.769977:0:15732:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 4294967310 00080000:10000000:3.0:1789049603.773265:0:15732:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0xb:0x0] (8/8/4) registered 00000020:00000080:3.0:1789049603.774420:0:15732:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:01000000:3.0:1789049603.774432:0:15732:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789049603.774438:0:15732:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789049603.774440:0:15732:0:(obd_config.c:1563:class_process_config()) marker 17 (0x2) lustre-OST0001 add ost 00000020:01000000:3.0:1789049603.774444:0:15732:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789049603.774448:0:15732:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789049603.774450:0:15732:0:(obd_config.c:1563:class_process_config()) marker 22 (0x1) lustre sys.timeout 00000020:00000080:3.0:1789049603.774453:0:15732:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1789049603.774455:0:15732:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:3.0:1789049603.774457:0:15732:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789049603.774460:0:15732:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789049603.774461:0:15732:0:(obd_config.c:1563:class_process_config()) marker 22 (0x2) lustre sys.timeout 00000020:01000000:3.0:1789049603.774463:0:15732:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789049603.774465:0:15732:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789049603.774467:0:15732:0:(obd_config.c:1563:class_process_config()) marker 26 (0x1) lustre sys.jobid_var 00000020:00000080:3.0:1789049603.774470:0:15732:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:3.0:1789049603.774539:0:15732:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789049603.774543:0:15732:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789049603.774545:0:15732:0:(obd_config.c:1563:class_process_config()) marker 26 (0x2) lustre sys.jobid_var 00000040:00080000:3.0:1789049603.774549:0:15732:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 11 count 11 00000020:01000000:1.0:1789049603.774813:0:15730:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 1-10 (rc=0) 10000000:01000000:1.0:1789049603.777259:0:15730:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.126@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:1.0:1789049603.777299:0:15730:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.126@tcp lock: ffff8cb8c28c2000/0xf4f48ce5e1bbffe4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xf4f48ce5e1bbffeb expref: -99 pid: 15730 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049603.777313:0:15730:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.126@tcp lock: ffff8cb8c28c2000/0xf4f48ce5e1bbffe4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xf4f48ce5e1bbffeb expref: -99 pid: 15730 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789049603.779189:0:15730:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8cb7c10e3800 from 1 10000000:01000000:3.0:1789049603.779197:0:15730:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1789049603.779429:0:15730:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.126@tcp lock: ffff8cb8d6714800/0xf4f48ce5e1bc0000 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15730 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049603.779454:0:15730:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.126@tcp lock: ffff8cb8d6714800/0xf4f48ce5e1bc0000 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15730 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049603.779465:0:15730:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.126@tcp lock: ffff8cb8d6714800/0xf4f48ce5e1bc0000 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15730 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789049603.779489:0:15730:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb7c5c36300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:817823bd-3ba1-432d-9714-f03a15bff403:15730:1875954110656768:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1789049603.779553:0:15730:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789049603.779647:0:15730:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cb8c79e0c00 going to sleep for 11 seconds 00000100:00100000:0.0:1789049603.779763:0:14322:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954110656768 00000100:00100000:0.0:1789049603.779771:0:14322:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954110656768 00000100:00100000:0.0:1789049603.779873:0:14322:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1789049603.779883:0:14322:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb900c5a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:817823bd-3ba1-432d-9714-f03a15bff403+17:15730:x1875954110656768:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1789049603.779896:0:14322:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789049603.779909:0:14322:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cb7c4c39600/0xf4f48ce5e1bc0007 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xf4f48ce5e1bc0000 expref: -99 pid: 14322 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049603.779932:0:14322:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cb7c4c39600/0xf4f48ce5e1bc0007 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf4f48ce5e1bc0000 expref: 18 pid: 14322 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049603.779955:0:14322:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cb7c4c39600/0xf4f48ce5e1bc0007 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf4f48ce5e1bc0000 expref: 18 pid: 14322 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049603.779964:0:14322:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cb7c4c39600, rc 0) 00000100:00100000:0.0:1789049603.780004:0:14322:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb900c5a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:817823bd-3ba1-432d-9714-f03a15bff403+18:15730:x1875954110656768:12345-0@lo:101:mount.lustre.0 Request processed in 124us (452us total) trans 0 rc 0/0 00000100:00100000:0.0:1789049603.780010:0:14322:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1789049603.780376:0:15730:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb7c5c36300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:817823bd-3ba1-432d-9714-f03a15bff403:15730:1875954110656768:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1789049603.780393:0:15730:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.126@tcp lock: ffff8cb8d6714800/0xf4f48ce5e1bc0000 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf4f48ce5e1bc0007 expref: -99 pid: 15730 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049603.780404:0:15730:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.126@tcp lock: ffff8cb8d6714800/0xf4f48ce5e1bc0000 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xf4f48ce5e1bc0007 expref: -99 pid: 15730 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1789049603.788132:0:15730:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000040:00080000:2.0:1789049603.790609:0:15730:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1789049603.791724:0:15730:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 224 off8416 00000040:00080000:3.0:1789049603.791772:0:15730:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 112 off8528 00000040:00080000:3.0:1789049603.791827:0:15730:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].3, 224 off8752 00000040:00080000:3.0:1789049603.791835:0:15730:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 3 count 4 00000100:00100000:3.0:1789049603.791956:0:15730:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb7c5c34380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:817823bd-3ba1-432d-9714-f03a15bff403:15730:1875954110656896:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789049603.792019:0:15730:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789049603.792055:0:15730:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cb8c79e0c00 going to sleep for 11 seconds 00000100:00100000:2.0:1789049603.793891:0:14323:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954110656896 00000100:00100000:2.0:1789049603.793905:0:14323:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954110656896 00000100:00100000:2.0:1789049603.793961:0:14323:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1789049603.793970:0:14323:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb900c59050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:817823bd-3ba1-432d-9714-f03a15bff403+18:15730:x1875954110656896:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789049603.794250:0:14323:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb900c59050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:817823bd-3ba1-432d-9714-f03a15bff403+18:15730:x1875954110656896:12345-0@lo:501:mount.lustre.0 Request processed in 280us (2230us total) trans 0 rc 0/0 00000100:00100000:2.0:1789049603.794257:0:14323:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1789049603.794516:0:15730:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb7c5c34380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:817823bd-3ba1-432d-9714-f03a15bff403:15730:1875954110656896:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789049603.794561:0:15730:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb8f7b91c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:817823bd-3ba1-432d-9714-f03a15bff403:15730:1875954110657024:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1789049603.794602:0:15730:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789049603.794670:0:15730:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cb8c63ea180 going to sleep for 11 seconds 00000100:00100000:3.0:1789049603.795969:0:14322:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954110657024 00000100:00100000:3.0:1789049603.795981:0:14322:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954110657024 00000100:00100000:3.0:1789049603.796035:0:14322:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1789049603.796059:0:14322:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb900c59850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:817823bd-3ba1-432d-9714-f03a15bff403+18:15730:x1875954110657024:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1789049603.798969:0:14322:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb900c59850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:817823bd-3ba1-432d-9714-f03a15bff403+18:15730:x1875954110657024:12345-0@lo:503:mount.lustre.0 Request processed in 2918us (4358us total) trans 0 rc 0/0 00000100:00100000:3.0:1789049603.798982:0:14322:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1789049603.799233:0:15730:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb8f7b91c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:817823bd-3ba1-432d-9714-f03a15bff403:15730:1875954110657024:0@lo:503:mount.lustre.0 00000040:00080000:0.0:1789049603.800284:0:15730:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1789049603.800388:0:15730:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb8f7b91c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:817823bd-3ba1-432d-9714-f03a15bff403:15730:1875954110657152:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1789049603.800452:0:15730:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789049603.800622:0:14323:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954110657152 00000100:00100000:2.0:1789049603.800629:0:14323:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954110657152 00000100:00100000:0.0:1789049603.800638:0:15730:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cb8c63ea180 going to sleep for 11 seconds 00000100:00100000:2.0:1789049603.800749:0:14323:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1789049603.800760:0:14323:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8f73fa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:817823bd-3ba1-432d-9714-f03a15bff403+18:15730:x1875954110657152:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1789049603.800965:0:14323:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8f73fa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:817823bd-3ba1-432d-9714-f03a15bff403+18:15730:x1875954110657152:12345-0@lo:502:mount.lustre.0 Request processed in 207us (512us total) trans 0 rc 0/0 00000100:00100000:2.0:1789049603.800973:0:14323:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1789049603.801169:0:15730:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb8f7b91c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:817823bd-3ba1-432d-9714-f03a15bff403:15730:1875954110657152:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1789049603.801387:0:15730:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 00000040:00080000:0.0:1789049603.801508:0:15730:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 112 off8528 00000040:00080000:0.0:1789049603.801540:0:15730:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 224 off8752 00000040:00080000:0.0:1789049603.801824:0:15730:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8976 00000040:00080000:0.0:1789049603.801906:0:15730:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 112 off9088 00000040:00080000:0.0:1789049603.801959:0:15730:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 224 off9312 00000040:00080000:0.0:1789049603.801995:0:15730:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9536 00000040:00080000:0.0:1789049603.802094:0:15730:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 128 off9664 00000100:00100000:0.0:1789049603.802129:0:15730:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb8f7b91c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:817823bd-3ba1-432d-9714-f03a15bff403:15730:1875954110657280:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1789049603.802184:0:15730:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789049603.802359:0:14322:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954110657280 00000100:00100000:3.0:1789049603.802366:0:14322:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954110657280 00000100:00100000:0.0:1789049603.802375:0:15730:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cb8c63ea180 going to sleep for 11 seconds 00000100:00100000:3.0:1789049603.802412:0:14322:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1789049603.802421:0:14322:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8f73fa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:817823bd-3ba1-432d-9714-f03a15bff403+18:15730:x1875954110657280:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1789049603.802606:0:14322:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8f73fa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:817823bd-3ba1-432d-9714-f03a15bff403+18:15730:x1875954110657280:12345-0@lo:502:mount.lustre.0 Request processed in 184us (420us total) trans 0 rc 0/0 00000100:00100000:3.0:1789049603.802613:0:14322:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1789049603.802656:0:15730:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb8f7b91c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:817823bd-3ba1-432d-9714-f03a15bff403:15730:1875954110657280:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1789049603.802750:0:15730:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9888 00000040:00080000:0.0:1789049603.802760:0:15730:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 9 count 10 00000020:01000000:1.0:1789049603.806995:0:15736:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789049603.807008:0:15736:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789049603.807010:0:15736:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:1.0:1789049603.807018:0:15736:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8cb7c10e3800 00000020:00000080:1.0:1789049603.807020:0:15736:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1789049603.807031:0:15736:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789049603.807034:0:15736:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789049603.807035:0:15736:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:1.0:1789049603.807037:0:15736:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789049603.807040:0:15736:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789049603.807053:0:15736:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:1.0:1789049603.807058:0:15736:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8cb7c10e3800 00000020:00000080:1.0:1789049603.807060:0:15736:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1789049603.807187:0:15736:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789049603.807191:0:15736:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789049603.807192:0:15736:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:1.0:1789049603.807195:0:15736:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789049603.807197:0:15736:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789049603.807198:0:15736:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1789049603.807201:0:15736:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8cb7c10e3800 00000020:00000080:1.0:1789049603.807203:0:15736:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1789049603.807580:0:15736:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789049603.807584:0:15736:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789049603.807586:0:15736:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:1.0:1789049603.807589:0:15736:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 10 count 10 00000020:01000000:3.0:1789049603.809325:0:15730:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-9 (rc=0) 10000000:01000000:3.0:1789049603.809376:0:15730:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.126@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1789049603.809403:0:15730:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.126@tcp lock: ffff8cb8d6714800/0xf4f48ce5e1bc0000 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf4f48ce5e1bc0007 expref: -99 pid: 15730 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049603.809418:0:15730:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.126@tcp lock: ffff8cb8d6714800/0xf4f48ce5e1bc0000 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf4f48ce5e1bc0007 expref: -99 pid: 15730 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789049603.809484:0:15730:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:3.0:1789049603.809488:0:15730:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff8cb7c10e3800 10000000:01000000:3.0:1789049603.809496:0:15730:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff8cb7c10e3800 10000000:01000000:3.0:1789049603.809501:0:15730:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1789049603.809507:0:15730:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8cb7c10e3800 from 1 10000000:01000000:3.0:1789049603.809510:0:15730:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1789049603.809548:0:15730:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.126@tcp lock: ffff8cb8d6715c00/0xf4f48ce5e1bc000e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15730 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049603.809557:0:15730:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.126@tcp lock: ffff8cb8d6715c00/0xf4f48ce5e1bc000e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15730 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049603.809566:0:15730:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.126@tcp lock: ffff8cb8d6715c00/0xf4f48ce5e1bc000e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15730 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789049603.809591:0:15730:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb7c5c37800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:817823bd-3ba1-432d-9714-f03a15bff403:15730:1875954110657408:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1789049603.809671:0:15730:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789049603.809717:0:15730:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cb8df429b40 going to sleep for 11 seconds 00000100:00100000:2.0:1789049603.811541:0:14323:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954110657408 00000100:00100000:2.0:1789049603.811552:0:14323:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954110657408 00000100:00100000:2.0:1789049603.811618:0:14323:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1789049603.811628:0:14323:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8f73fb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:817823bd-3ba1-432d-9714-f03a15bff403+18:15730:x1875954110657408:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1789049603.811644:0:14323:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789049603.811661:0:14323:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cb900e62200/0xf4f48ce5e1bc0015 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0xf4f48ce5e1bc000e expref: -99 pid: 14323 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049603.811686:0:14323:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cb900e62200/0xf4f48ce5e1bc0015 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf4f48ce5e1bc000e expref: 19 pid: 14323 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049603.811697:0:14323:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cb900e62200/0xf4f48ce5e1bc0015 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf4f48ce5e1bc000e expref: 19 pid: 14323 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049603.811707:0:14323:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cb900e62200, rc 0) 00000100:00100000:2.0:1789049603.811790:0:14323:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8f73fb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:817823bd-3ba1-432d-9714-f03a15bff403+19:15730:x1875954110657408:12345-0@lo:101:mount.lustre.0 Request processed in 164us (2119us total) trans 0 rc 0/0 00000100:00100000:2.0:1789049603.811797:0:14323:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1789049603.812750:0:15730:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb7c5c37800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:817823bd-3ba1-432d-9714-f03a15bff403:15730:1875954110657408:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1789049603.812772:0:15730:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.126@tcp lock: ffff8cb8d6715c00/0xf4f48ce5e1bc000e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xf4f48ce5e1bc0015 expref: -99 pid: 15730 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049603.812783:0:15730:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.126@tcp lock: ffff8cb8d6715c00/0xf4f48ce5e1bc000e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xf4f48ce5e1bc0015 expref: -99 pid: 15730 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1789049603.813444:0:15730:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 39 count 39 00000040:00080000:3.0:1789049603.814255:0:15730:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1789049603.814585:0:15730:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 00000040:00080000:3.0:1789049603.814648:0:15730:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 120 off8536 00000040:00080000:3.0:1789049603.814691:0:15730:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 168 off8704 00000040:00080000:3.0:1789049603.814746:0:15730:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8928 00000040:00080000:3.0:1789049603.814779:0:15730:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9152 00000040:00080000:3.0:1789049603.814816:0:15730:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 120 off9272 00000040:00080000:3.0:1789049603.814867:0:15730:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 168 off9440 00000040:00080000:3.0:1789049603.814900:0:15730:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9664 00000040:00080000:3.0:1789049603.814949:0:15730:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 224 off9888 00000040:00080000:3.0:1789049603.814987:0:15730:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 120 off10008 00000040:00080000:3.0:1789049603.815024:0:15730:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 224 off10232 00000040:00080000:3.0:1789049603.815087:0:15730:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 224 off10456 00000040:00080000:3.0:1789049603.815136:0:15730:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 88 off10544 00000040:00080000:3.0:1789049603.815197:0:15730:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].14, 128 off10672 00000040:00080000:3.0:1789049603.815247:0:15730:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].15, 144 off10816 00000040:00080000:3.0:1789049603.815285:0:15730:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].16, 160 off10976 00000040:00080000:3.0:1789049603.815345:0:15730:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].17, 224 off11200 00000040:00080000:3.0:1789049603.815418:0:15730:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].18, 224 off11424 00000040:00080000:3.0:1789049603.815456:0:15730:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].19, 80 off11504 00000040:00080000:3.0:1789049603.815491:0:15730:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].20, 224 off11728 00000040:00080000:3.0:1789049603.815539:0:15730:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].21, 224 off11952 00000040:00080000:3.0:1789049603.815575:0:15730:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].22, 88 off12040 00000040:00080000:3.0:1789049603.815610:0:15730:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].23, 128 off12168 00000040:00080000:3.0:1789049603.815762:0:15730:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].24, 144 off12312 00000040:00080000:3.0:1789049603.815802:0:15730:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].25, 128 off12440 00000040:00080000:3.0:1789049603.815919:0:15730:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].26, 224 off12664 00000040:00080000:3.0:1789049603.815977:0:15730:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].27, 224 off12888 00000040:00080000:3.0:1789049603.816040:0:15730:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].28, 80 off12968 00000040:00080000:3.0:1789049603.816085:0:15730:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].29, 224 off13192 00000040:00080000:3.0:1789049603.816170:0:15730:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].30, 224 off13416 00000040:00080000:3.0:1789049603.816207:0:15730:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].31, 88 off13504 00000040:00080000:3.0:1789049603.816239:0:15730:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].32, 128 off13632 00000040:00080000:3.0:1789049603.816272:0:15730:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].33, 144 off13776 00000040:00080000:3.0:1789049603.816320:0:15730:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].34, 128 off13904 00000040:00080000:3.0:1789049603.816373:0:15730:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].35, 224 off14128 00000040:00080000:3.0:1789049603.816424:0:15730:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].36, 224 off14352 00000040:00080000:3.0:1789049603.816471:0:15730:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].37, 80 off14432 00000040:00080000:3.0:1789049603.816614:0:15730:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].38, 224 off14656 00000040:00080000:3.0:1789049603.816627:0:15730:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 38 count 39 00000100:00100000:3.0:1789049603.816740:0:15730:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb7c5c37800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:817823bd-3ba1-432d-9714-f03a15bff403:15730:1875954110657536:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789049603.816797:0:15730:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789049603.816917:0:15730:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cb8df429b40 going to sleep for 11 seconds 00000100:00100000:1.0:1789049603.816964:0:14322:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954110657536 00000100:00100000:1.0:1789049603.816973:0:14322:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954110657536 00000100:00100000:1.0:1789049603.817060:0:14322:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1789049603.817075:0:14322:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8f73f8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:817823bd-3ba1-432d-9714-f03a15bff403+19:15730:x1875954110657536:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789049603.817311:0:14322:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8f73f8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:817823bd-3ba1-432d-9714-f03a15bff403+19:15730:x1875954110657536:12345-0@lo:501:mount.lustre.0 Request processed in 243us (512us total) trans 0 rc 0/0 00000100:00100000:1.0:1789049603.817319:0:14322:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1789049603.817419:0:15730:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb7c5c37800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:817823bd-3ba1-432d-9714-f03a15bff403:15730:1875954110657536:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789049603.817452:0:15730:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb7c5c37800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:817823bd-3ba1-432d-9714-f03a15bff403:15730:1875954110657664:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1789049603.817491:0:15730:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789049603.817519:0:15730:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cb8df429b40 going to sleep for 11 seconds 00000100:00100000:1.0:1789049603.817559:0:14321:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954110657664 00000100:00100000:1.0:1789049603.817564:0:14321:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954110657664 00000100:00100000:1.0:1789049603.817623:0:14321:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1789049603.817631:0:14321:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8f73f8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:817823bd-3ba1-432d-9714-f03a15bff403+19:15730:x1875954110657664:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1789049603.817764:0:14321:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8f73f8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:817823bd-3ba1-432d-9714-f03a15bff403+19:15730:x1875954110657664:12345-0@lo:503:mount.lustre.0 Request processed in 133us (272us total) trans 0 rc 0/0 00000100:00100000:1.0:1789049603.817771:0:14321:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1789049603.817828:0:15730:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb7c5c37800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:817823bd-3ba1-432d-9714-f03a15bff403:15730:1875954110657664:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1789049603.818474:0:15730:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1789049603.818542:0:15730:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb7c5c37800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:817823bd-3ba1-432d-9714-f03a15bff403:15730:1875954110657792:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1789049603.818591:0:15730:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789049603.818626:0:14322:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954110657792 00000100:00100000:3.0:1789049603.818637:0:14322:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954110657792 00000100:00100000:3.0:1789049603.818667:0:14322:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1789049603.818674:0:14322:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb7c47f6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:817823bd-3ba1-432d-9714-f03a15bff403+19:15730:x1875954110657792:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1789049603.818871:0:14322:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb7c47f6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:817823bd-3ba1-432d-9714-f03a15bff403+19:15730:x1875954110657792:12345-0@lo:502:mount.lustre.0 Request processed in 197us (280us total) trans 0 rc 0/0 00000100:00100000:3.0:1789049603.818879:0:14322:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1789049603.818933:0:15730:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cb8df429b40 going to sleep for 11 seconds 00000100:00100000:3.0:1789049603.818954:0:15730:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb7c5c37800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:817823bd-3ba1-432d-9714-f03a15bff403:15730:1875954110657792:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1789049603.819214:0:15730:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 00000040:00080000:3.0:1789049603.819260:0:15730:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 120 off8536 00000040:00080000:3.0:1789049603.819293:0:15730:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 168 off8704 00000040:00080000:3.0:1789049603.819364:0:15730:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8928 00000040:00080000:3.0:1789049603.819421:0:15730:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 224 off9152 00000040:00080000:3.0:1789049603.819463:0:15730:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 120 off9272 00000040:00080000:3.0:1789049603.819493:0:15730:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 168 off9440 00000040:00080000:3.0:1789049603.819530:0:15730:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 224 off9664 00000040:00080000:3.0:1789049603.819584:0:15730:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 224 off9888 00000040:00080000:3.0:1789049603.819623:0:15730:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 120 off10008 00000040:00080000:3.0:1789049603.819665:0:15730:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].11, 224 off10232 00000040:00080000:3.0:1789049603.819718:0:15730:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].12, 224 off10456 00000040:00080000:3.0:1789049603.819751:0:15730:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].13, 88 off10544 00000040:00080000:3.0:1789049603.819776:0:15730:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].14, 128 off10672 00000040:00080000:3.0:1789049603.819810:0:15730:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].15, 144 off10816 00000040:00080000:3.0:1789049603.819860:0:15730:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].16, 160 off10976 00000040:00080000:3.0:1789049603.819899:0:15730:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].17, 224 off11200 00000040:00080000:3.0:1789049603.819945:0:15730:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].18, 224 off11424 00000040:00080000:3.0:1789049603.819975:0:15730:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].19, 80 off11504 00000040:00080000:3.0:1789049603.820002:0:15730:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].20, 224 off11728 00000040:00080000:3.0:1789049603.820062:0:15730:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].21, 224 off11952 00000040:00080000:3.0:1789049603.820106:0:15730:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].22, 88 off12040 00000040:00080000:3.0:1789049603.820149:0:15730:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].23, 128 off12168 00000040:00080000:3.0:1789049603.820189:0:15730:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].24, 144 off12312 00000040:00080000:3.0:1789049603.820217:0:15730:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].25, 128 off12440 00000040:00080000:3.0:1789049603.820243:0:15730:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].26, 224 off12664 00000040:00080000:3.0:1789049603.820298:0:15730:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].27, 224 off12888 00000040:00080000:3.0:1789049603.820352:0:15730:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].28, 80 off12968 00000040:00080000:3.0:1789049603.820400:0:15730:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].29, 224 off13192 00000040:00080000:3.0:1789049603.820443:0:15730:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].30, 224 off13416 00000040:00080000:3.0:1789049603.820470:0:15730:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].31, 88 off13504 00000040:00080000:3.0:1789049603.820516:0:15730:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].32, 128 off13632 00000040:00080000:3.0:1789049603.820562:0:15730:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].33, 144 off13776 00000040:00080000:3.0:1789049603.820628:0:15730:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].34, 128 off13904 00000040:00080000:3.0:1789049603.820681:0:15730:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].35, 224 off14128 00000040:00080000:3.0:1789049603.820740:0:15730:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].36, 224 off14352 00000040:00080000:3.0:1789049603.820786:0:15730:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].37, 80 off14432 00000040:00080000:3.0:1789049603.820813:0:15730:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].38, 224 off14656 00000040:00080000:3.0:1789049603.820879:0:15730:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].39, 224 off14880 00000040:00080000:3.0:1789049603.820918:0:15730:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].40, 120 off15000 00000100:00100000:3.0:1789049603.820957:0:15730:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb7c5c37800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:817823bd-3ba1-432d-9714-f03a15bff403:15730:1875954110657920:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1789049603.821021:0:15730:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789049603.821050:0:15730:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cb8df429b40 going to sleep for 11 seconds 00000100:00100000:1.0:1789049603.821143:0:14321:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954110657920 00000100:00100000:1.0:1789049603.821162:0:14321:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954110657920 00000100:00100000:1.0:1789049603.821203:0:14321:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1789049603.821211:0:14321:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb7c47f4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:817823bd-3ba1-432d-9714-f03a15bff403+19:15730:x1875954110657920:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1789049603.821431:0:14321:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb7c47f4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:817823bd-3ba1-432d-9714-f03a15bff403+19:15730:x1875954110657920:12345-0@lo:502:mount.lustre.0 Request processed in 220us (409us total) trans 0 rc 0/0 00000100:00100000:1.0:1789049603.821438:0:14321:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1789049603.821468:0:15730:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb7c5c37800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:817823bd-3ba1-432d-9714-f03a15bff403:15730:1875954110657920:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1789049603.821549:0:15730:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].41, 224 off15224 00000040:00080000:3.0:1789049603.821560:0:15730:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 41 count 42 00000020:01000004:2.0:1789049603.825536:0:15741:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0001 (typ=lwp) 00000020:00000080:2.0:1789049603.825553:0:15741:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0001 (ffff8cb7c60319c0) 00000020:00000080:2.0:1789049603.825576:0:15741:0:(obd_config.c:720:class_attach_name()) OBD: dev 17 attached type lwp with refcount 2 00000020:01000004:2.0:1789049603.825657:0:15741:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8cb7c10e3800 from lustre-OST0001, refs=3 00000020:01000004:2.0:1789049603.825669:0:15741:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8cb7c10e3800 from lustre-OST0001, refs=3 00000020:01000004:2.0:1789049603.825672:0:15741:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8cb7c10e3800 3 00010000:00080000:2.0:1789049603.825707:0:15741:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8cb7c754f000@lustre-MDT0000-lwp-OST0001: add connection 192.168.206.126@tcp at head 00010000:00010000:2.0:1789049603.829096:0:15741:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0001-5 is initialized 00000020:00000080:2.0:1789049603.829286:0:15741:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000010:01000000:2.0:1789049603.829324:0:15741:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1789049603.829361:0:15741:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-OST0001, cookie 0xf4f48ce5e1bc0023 00000100:00080000:2.0:1789049603.829372:0:15741:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1789049603.829385:0:15741:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8cb7c754f000 using connection 192.168.206.126@tcp/0@lo 00000100:00100000:2.0:1789049603.829421:0:15741:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8cb900e97100 x1875954110658048/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1789049603.829448:0:15741:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00100000:0.0:1789049603.830436:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb900e97100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3307:1875954110658048:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1789049603.830507:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1789049603.830594:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1789049603.830598:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:0.0:1789049603.830601:0:36:0:(import.c:65:import_set_state_nolock()) ffff8cb8c3fca000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1789049603.830605:0:36:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 428 00000100:00080000:0.0:1789049603.830618:0:36:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 15s 00000100:00080000:0.0:1789049603.830624:0:36:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff8cb8c3fca000 using connection 192.168.206.126@tcp/0@lo 00000100:00100000:0.0:1789049603.830642:0:36:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8cb8f7b91180 x1875954110658304/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1789049603.830683:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb8f7b90000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1875954110658176:0@lo:400:kworker.0 00000100:00100000:0.0:1789049603.830718:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789049603.830740:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789049603.830746:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb8f7b91f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3308:1875954110658432:0@lo:400:kworker.0 00000100:00100000:0.0:1789049603.830768:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789049603.830796:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb8f7b91180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3307:1875954110658304:0@lo:8:kworker.0 00000100:00100000:0.0:1789049603.830819:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789049603.830862:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1789049603.830871:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb8f7b92d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3311:1875954110658560:0@lo:400:kworker.0 00000100:00100000:0.0:1789049603.830893:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789049603.830920:0:14328:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954110658048 00000100:00100000:0.0:1789049603.830926:0:14328:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954110658048 00000100:00100000:0.0:1789049603.830947:0:14328:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954110658432 00000100:00100000:0.0:1789049603.830949:0:14328:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954110658432 00000100:00100000:0.0:1789049603.830969:0:14328:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954110658560 00000100:00100000:0.0:1789049603.830971:0:14328:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954110658560 00000100:00100000:0.0:1789049603.830985:0:14328:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1789049603.830993:0:14328:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8f7b90a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1875954110658432:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789049603.831325:0:14328:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8f7b90a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1875954110658432:12345-0@lo:400:kworker.0 Request processed in 51us (274us total) trans 0 rc 0/0 00000100:00100000:0.0:1789049603.831341:0:14328:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1789049603.831362:0:14328:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1789049603.831370:0:14328:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8f7b92a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1875954110658560:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789049603.831418:0:14328:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8f7b92a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1875954110658560:12345-0@lo:400:kworker.0 Request processed in 49us (523us total) trans 0 rc 0/0 00000100:00100000:0.0:1789049603.831425:0:14328:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1789049603.831439:0:14328:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1789049603.831443:0:14328:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8f7b91c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3307:x1875954110658048:12345-0@lo:38:llog_process_th.0 00010000:00080000:0.0:1789049603.831463:0:14328:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 429 last 0 00000020:00000080:0.0:1789049603.831507:0:14328:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0xf4f48ce5e1bc002a 00000004:00100000:0.0:1789049603.831523:0:14328:0:(mdt_handler.c:7315:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1789049603.831557:0:14328:0:(import.c:65:import_set_state_nolock()) ffff8cb8df658000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1789049603.831594:0:14328:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8f7b91c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1875954110658048:12345-0@lo:38:llog_process_th.0 Request processed in 149us (1087us total) trans 0 rc 0/0 00000100:00100000:0.0:1789049603.831600:0:14328:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1789049603.831617:0:15011:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954110658176 00000100:00100000:0.0:1789049603.831621:0:15011:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954110658176 00000100:00100000:0.0:1789049603.831654:0:15011:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954110658304 00000100:00100000:0.0:1789049603.831658:0:15011:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954110658304 00000100:00100000:0.0:1789049603.831673:0:15011:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1789049603.831680:0:15011:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8f7b93100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3308:x1875954110658176:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789049603.831717:0:15011:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8f7b93100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3308:x1875954110658176:12345-0@lo:400:kworker.0 Request processed in 39us (999us total) trans 0 rc 0/0 00000100:00100000:0.0:1789049603.831724:0:15011:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1789049603.831742:0:15011:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1789049603.831746:0:15011:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8f7b93480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3307:x1875954110658304:12345-0@lo:8:kworker.0 00000100:00100000:0.0:1789049603.831789:0:15011:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8f7b93480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3307:x1875954110658304:12345-0@lo:8:kworker.0 Request processed in 41us (968us total) trans 0 rc -11/-11 00000100:00100000:0.0:1789049603.831796:0:15011:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1789049603.831869:0:3307:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1789049603.831876:0:3307:0:(import.c:65:import_set_state_nolock()) ffff8cb8c3fca000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1789049603.831881:0:3307:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-11) 00000100:00100000:0.0:1789049603.831886:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb8f7b91180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3307:1875954110658304:0@lo:8:kworker.0 00010000:00080000:0.0:1789049603.831902:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8cb900e97100 x1875954110658048/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1789049613 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789049603.831911:0:3307:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:0.0:1789049603.831916:0:3307:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 2 00000100:00080000:0.0:1789049603.831921:0:3307:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:0.0:1789049603.831925:0:3307:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1789049603.831928:0:3307:0:(import.c:65:import_set_state_nolock()) ffff8cb7c754f000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1789049603.831932:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb900e97100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3307:1875954110658048:0@lo:38:llog_process_th.0 00010000:00080000:0.0:1789049603.831967:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8cb8f7b92d80 x1875954110658560/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789049619 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789049603.831976:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb8f7b92d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3311:1875954110658560:0@lo:400:kworker.0 00010000:00080000:0.0:1789049603.832002:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8cb8f7b91f80 x1875954110658432/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789049619 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789049603.832011:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb8f7b91f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3308:1875954110658432:0@lo:400:kworker.0 00000100:00100000:0.0:1789049603.832024:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb8f7b90000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1875954110658176:0@lo:400:kworker.0 00000040:00080000:0.0:1789049603.832192:0:15741:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 42 count 42 00000020:01000000:2.0:1789049603.832734:0:15730:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-41 (rc=0) 10000000:01000000:2.0:1789049603.832780:0:15730:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.126@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1789049603.832796:0:15730:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.126@tcp lock: ffff8cb8d6715c00/0xf4f48ce5e1bc000e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xf4f48ce5e1bc0015 expref: -99 pid: 15730 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049603.832807:0:15730:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.126@tcp lock: ffff8cb8d6715c00/0xf4f48ce5e1bc000e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xf4f48ce5e1bc0015 expref: -99 pid: 15730 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1789049603.832903:0:15730:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:2.0:1789049603.832906:0:15730:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1789049603.832907:0:15730:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789049603.832908:0:15730:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789049603.832909:0:15730:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789049603.832911:0:15730:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789049603.832913:0:15730:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1789049603.832915:0:15730:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789049603.832916:0:15730:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1789049603.832920:0:15730:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x40020002 00000020:01000004:2.0:1789049603.832922:0:15730:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1789049603.832923:0:15730:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1789049603.832930:0:15730:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789049603.832931:0:15730:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789049603.832932:0:15730:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789049603.832934:0:15730:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789049603.832935:0:15730:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1789049603.832936:0:15730:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789049603.832937:0:15730:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1789049603.832954:0:15730:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:2.0:1789049603.832970:0:15730:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb900e96680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:817823bd-3ba1-432d-9714-f03a15bff403:15730:1875954110658688:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1789049603.833026:0:15730:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789049603.833057:0:15730:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cb8c62d90c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789049603.834032:0:14323:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954110658688 00000100:00100000:3.0:1789049603.834097:0:14323:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954110658688 00000100:00100000:3.0:1789049603.834149:0:14323:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1789049603.834160:0:14323:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb7c47f5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:817823bd-3ba1-432d-9714-f03a15bff403+19:15730:x1875954110658688:12345-0@lo:253:mount.lustre.0 20000000:01000000:3.0:1789049603.834189:0:14323:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:3.0:1789049603.834202:0:14323:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:0.0:1789049603.861676:0:14323:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1789049603.861767:0:14323:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 20000000:01000000:1.0:1789049603.863264:0:14343:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:1.0:1789049603.863272:0:14343:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:3.0:1789049603.863354:0:14343:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8cb8d6715200/0xf4f48ce5e1bc0031 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14343 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049603.863381:0:14343:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8cb8c28c2800/0xf4f48ce5e1bbff0b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf4f48ce5e1bbff04 expref: 19 pid: 14321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049603.863389:0:14343:0:(ldlm_resource.c:1751:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8cb8d6715200/0xf4f48ce5e1bc0031 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14343 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049603.863425:0:14343:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8cb8c28c2800/0xf4f48ce5e1bbff0b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf4f48ce5e1bbff04 expref: 19 pid: 14321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049603.863437:0:14343:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8cb8c28c2800/0xf4f48ce5e1bbff0b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf4f48ce5e1bbff04 expref: 19 pid: 14321 timeout: 529 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789049603.863453:0:14343:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb7c5c37800 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14343:1875954110658816:0@lo:104: 00000100:00100000:3.0:1789049603.863508:0:14343:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789049603.863540:0:14343:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cb8df429600 going to sleep for 11 seconds 00000100:00100000:0.0:1789049603.864210:0:14312:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954110658816 00000100:00100000:0.0:1789049603.864218:0:14312:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954110658816 00000100:00100000:0.0:1789049603.864273:0:14312:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1789049603.864280:0:14312:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb7c5c34380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:817823bd-3ba1-432d-9714-f03a15bff403+3:14343:x1875954110658816:12345-0@lo:104: 00010000:00010000:0.0:1789049603.864292:0:14312:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.126@tcp lock: ffff8cb7c4c39000/0xf4f48ce5e1bbff04 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xf4f48ce5e1bbff0b expref: -99 pid: 14325 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049603.864358:0:14312:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1789049603.864364:0:14312:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb7c5c34380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:817823bd-3ba1-432d-9714-f03a15bff403+3:14343:x1875954110658816:12345-0@lo:104: Request processed in 85us (855us total) trans 0 rc 0/0 00010000:00010000:1.0:1789049603.864387:0:14317:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789049603.864395:0:14317:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.126@tcp lock: ffff8cb7c4c39000/0xf4f48ce5e1bbff04 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xf4f48ce5e1bbff0b expref: -99 pid: 14325 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049603.864403:0:14317:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cb7c4c39000 already unused, calling callback (ffffffffc1ca3c20) 10000000:00010000:1.0:1789049603.864407:0:14317:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.126@tcp lock: ffff8cb7c4c39000/0xf4f48ce5e1bbff04 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xf4f48ce5e1bbff0b expref: -99 pid: 14325 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049603.864416:0:14317:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.126@tcp lock: ffff8cb7c4c39000/0xf4f48ce5e1bbff04 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xf4f48ce5e1bbff0b expref: -99 pid: 14325 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789049603.864424:0:14317:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.126@tcp lock: ffff8cb7c4c39000/0xf4f48ce5e1bbff04 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xf4f48ce5e1bbff0b expref: -99 pid: 14325 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789049603.864430:0:14317:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00000100:00100000:3.0:1789049603.864459:0:14343:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb7c5c37800 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14343:1875954110658816:0@lo:104: 00010000:00010000:1.0:1789049603.864466:0:14317:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.126@tcp lock: ffff8cb7c4c39000/0xf4f48ce5e1bbff04 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf4f48ce5e1bbff0b expref: -99 pid: 14325 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049603.864474:0:14317:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789049603.864481:0:14343:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8cb8d6715200/0xf4f48ce5e1bc0031 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14343 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049603.864494:0:14317:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.126@tcp lock: ffff8cb7c4c39000/0xf4f48ce5e1bbff04 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf4f48ce5e1bbff0b expref: -99 pid: 14325 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049603.864515:0:14317:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.126@tcp lock: ffff8cb7c4c39000/0xf4f48ce5e1bbff04 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf4f48ce5e1bbff0b expref: -99 pid: 14325 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789049603.864529:0:14312:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00010000:1.0:1789049603.864538:0:14317:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789049603.864541:0:14317:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789049603.864543:0:14317:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789049603.864567:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb900e40380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:817823bd-3ba1-432d-9714-f03a15bff403:3311:1875954110658944:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789049603.864618:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789049603.865716:0:14315:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954110658944 00000100:00100000:3.0:1789049603.865723:0:14315:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954110658944 00010000:00010000:3.0:1789049603.865749:0:14315:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8cb8c28c2800/0xf4f48ce5e1bbff0b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf4f48ce5e1bbff04 expref: 20 pid: 14321 timeout: 529 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789049603.865769:0:14315:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1789049603.865775:0:14315:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb900e41c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:817823bd-3ba1-432d-9714-f03a15bff403+20:3311:x1875954110658944:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789049603.865785:0:14315:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789049603.865798:0:14315:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8cb8c28c2800/0xf4f48ce5e1bbff0b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf4f48ce5e1bbff04 expref: 20 pid: 14321 timeout: 529 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049603.865807:0:14315:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8cb8c28c2800/0xf4f48ce5e1bbff0b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf4f48ce5e1bbff04 expref: 20 pid: 14321 timeout: 529 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049603.865819:0:14315:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cb8c28c2800/0xf4f48ce5e1bbff0b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf4f48ce5e1bbff04 expref: 20 pid: 14321 timeout: 529 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049603.865833:0:14315:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8cb8d6715200/0xf4f48ce5e1bc0031 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14343 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049603.865873:0:14315:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cb8d6715200/0xf4f48ce5e1bc0031 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14343 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1789049603.865888:0:14315:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.002616529s 00010000:00010000:3.0:1789049603.865901:0:14315:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8cb8d6715200/0xf4f48ce5e1bc0031 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14343 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049603.865908:0:14315:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8cb8d6715200/0xf4f48ce5e1bc0031 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14343 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049603.865915:0:14315:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8cb8d6715200/0xf4f48ce5e1bc0031 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14343 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049603.865921:0:14315:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8cb8d6715200/0xf4f48ce5e1bc0031 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14343 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049603.865927:0:14315:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cb8d6715200 already unused, calling callback (ffffffffc166a8f0) 00010000:00010000:3.0:1789049603.865932:0:14315:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8cb8d6715200/0xf4f48ce5e1bc0031 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14343 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049603.865948:0:14315:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8cb8d6715200/0xf4f48ce5e1bc0031 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14343 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049603.865962:0:14315:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8cb8d6715200/0xf4f48ce5e1bc0031 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14343 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049603.865971:0:14315:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789049603.866364:0:14315:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb900e41c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:817823bd-3ba1-432d-9714-f03a15bff403+19:3311:x1875954110658944:12345-0@lo:103:ldlm_bl.0 Request processed in 587us (1745us total) trans 0 rc 0/0 00000100:00100000:3.0:1789049603.866380:0:14315:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00010000:3.0:1789049603.866404:0:14343:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8cb8d6715200/0xf4f48ce5e1bc0031 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14343 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049603.866413:0:14343:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8cb8d6715200/0xf4f48ce5e1bc0031 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14343 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049603.866419:0:14343:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cb8d6715200/0xf4f48ce5e1bc0031 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14343 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789049603.866622:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb900e40380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:817823bd-3ba1-432d-9714-f03a15bff403:3311:1875954110658944:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789049603.872610:0:14323:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb7c47f5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:817823bd-3ba1-432d-9714-f03a15bff403+18:15730:x1875954110658688:12345-0@lo:253:mount.lustre.0 Request processed in 38444us (39576us total) trans 0 rc 0/0 00000100:00100000:0.0:1789049603.872625:0:14323:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1789049603.874468:0:15730:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb900e96680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:817823bd-3ba1-432d-9714-f03a15bff403:15730:1875954110658688:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1789049603.874488:0:15730:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:2.0:1789049603.874491:0:15730:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1789049603.874492:0:15730:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1789049603.874493:0:15730:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789049603.874495:0:15730:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789049603.874496:0:15730:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789049603.874497:0:15730:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789049603.874498:0:15730:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1789049603.874500:0:15730:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789049603.874501:0:15730:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:2.0:1789049603.874516:0:15730:0:(tgt_mount.c:2694:server_calc_timeout()) lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:3.0:1789049603.881277:0:15730:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:3.0:1789049603.881560:0:15730:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:3.0:1789049603.881787:0:15730:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:3.0:1789049603.881965:0:15730:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:3.0:1789049603.885578:0:15730:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:3.0:1789049603.886115:0:15730:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:3.0:1789049603.887232:0:15730:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 8589934592 00002000:00080000:3.0:1789049603.953188:0:15730:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0001: recovery is over 00100000:10000000:3.0:1789049603.953197:0:15730:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0001-osd: start master thread 00000020:01000004:3.0:1789049603.953230:0:15730:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:3.0:1789049603.953301:0:15730:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.206.126@tcp: cl_mgc_mutex unlock 00000020:01000004:3.0:1789049603.953316:0:15730:0:(tgt_mount.c:2460:server_fill_super_common()) Server sb, dev=49 00000080:00000004:3.0:1789049603.953352:0:15730:0:(super25.c:182:lustre_fill_super()) lustre-ost2/ost2: Mount complete 00010000:00010000:1.0:1789049604.187026:0:14316:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789049605.211015:0:15620:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1789049605.530948:0:14325:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1789049605.530956:0:14325:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8cb8d1a86000 from 8 10000000:01000000:1.0:1789049605.530961:0:14325:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1789049605.531008:0:14325:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.126@tcp lock: ffff8cb8c28c3000/0xf4f48ce5e1bc0038 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14325 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049605.531020:0:14325:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.126@tcp lock: ffff8cb8c28c3000/0xf4f48ce5e1bc0038 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14325 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049605.531032:0:14325:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.126@tcp lock: ffff8cb8c28c3000/0xf4f48ce5e1bc0038 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14325 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789049605.531057:0:14325:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb900e40380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:817823bd-3ba1-432d-9714-f03a15bff403:14325:1875954110659072:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1789049605.531122:0:14325:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789049605.531164:0:14325:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cb8f310cc00 going to sleep for 11 seconds 00000100:00100000:0.0:1789049605.531229:0:14321:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954110659072 00000100:00100000:0.0:1789049605.531237:0:14321:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954110659072 00000100:00100000:0.0:1789049605.531288:0:14321:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1789049605.531298:0:14321:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb7c47f7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:817823bd-3ba1-432d-9714-f03a15bff403+18:14325:x1875954110659072:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789049605.531312:0:14321:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789049605.531338:0:14321:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cb7c4c39800/0xf4f48ce5e1bc003f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xf4f48ce5e1bc0038 expref: -99 pid: 14321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049605.531361:0:14321:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cb7c4c39800/0xf4f48ce5e1bc003f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf4f48ce5e1bc0038 expref: 19 pid: 14321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049605.531373:0:14321:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cb7c4c39800/0xf4f48ce5e1bc003f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf4f48ce5e1bc0038 expref: 19 pid: 14321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049605.531382:0:14321:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cb7c4c39800, rc 0) 00000100:00100000:0.0:1789049605.531433:0:14321:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb7c47f7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:817823bd-3ba1-432d-9714-f03a15bff403+19:14325:x1875954110659072:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 136us (310us total) trans 0 rc 0/0 00000100:00100000:0.0:1789049605.531453:0:14321:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1789049605.531587:0:14325:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb900e40380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:817823bd-3ba1-432d-9714-f03a15bff403:14325:1875954110659072:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789049605.531602:0:14325:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.126@tcp lock: ffff8cb8c28c3000/0xf4f48ce5e1bc0038 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf4f48ce5e1bc003f expref: -99 pid: 14325 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049605.531617:0:14325:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.126@tcp lock: ffff8cb8c28c3000/0xf4f48ce5e1bc0038 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xf4f48ce5e1bc003f expref: -99 pid: 14325 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789049605.531667:0:14325:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb900e40380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:817823bd-3ba1-432d-9714-f03a15bff403:14325:1875954110659200:0@lo:256:ll_cfg_requeue.0 00000100:00100000:1.0:1789049605.531775:0:14325:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789049605.531796:0:14325:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cb8f310cc00 going to sleep for 11 seconds 00000100:00100000:0.0:1789049605.531876:0:14323:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954110659200 00000100:00100000:0.0:1789049605.531881:0:14323:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954110659200 00000100:00100000:0.0:1789049605.531903:0:14323:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1789049605.531910:0:14323:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb7c47f7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:817823bd-3ba1-432d-9714-f03a15bff403+19:14325:x1875954110659200:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:0.0:1789049605.531923:0:14323:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1789049605.531940:0:14323:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1789049605.531943:0:14323:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 8 00000100:00100000:0.0:1789049605.532032:0:14323:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb7c47f7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:817823bd-3ba1-432d-9714-f03a15bff403+19:14325:x1875954110659200:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 122us (257us total) trans 0 rc 0/0 00000100:00100000:0.0:1789049605.532039:0:14323:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1789049605.532120:0:14325:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb900e40380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:817823bd-3ba1-432d-9714-f03a15bff403:14325:1875954110659200:0@lo:256:ll_cfg_requeue.0 10000000:01000000:2.0:1789049605.532178:0:14325:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.126@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1789049605.532184:0:14325:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.126@tcp lock: ffff8cb8c28c3000/0xf4f48ce5e1bc0038 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf4f48ce5e1bc003f expref: -99 pid: 14325 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049605.532192:0:14325:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.126@tcp lock: ffff8cb8c28c3000/0xf4f48ce5e1bc0038 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf4f48ce5e1bc003f expref: -99 pid: 14325 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049606.235433:0:14317:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1789049606.664223:0:6731:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00080000:1.0:1789049606.664241:0:6731:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934593 is committed 00000100:00100000:3.0:1789049607.067299:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb900e96680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1875954110659328:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789049607.067380:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789049607.067538:0:15016:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954110659328 00000100:00100000:2.0:1789049607.067546:0:15016:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954110659328 00000100:00100000:2.0:1789049607.067622:0:15016:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1789049607.067631:0:15016:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb7c5c37800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1875954110659328:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789049607.067674:0:15016:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789049607.067722:0:15016:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb7c5c37800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1875954110659328:12345-0@lo:13:osp-pre-0-0.0 Request processed in 93us (342us total) trans 0 rc 0/0 00000100:00100000:2.0:1789049607.067729:0:15016:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1789049607.067772:0:3308:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934593 gen 2 00000100:00080000:3.0:1789049607.067873:0:14324:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789049607.067964:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb900e96680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1875954110659328:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1789049607.259111:0:14316:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789049608.283148:0:15620:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1789049609.115796:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1789049609.115802:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1789049609.115806:0:8:0:(import.c:65:import_set_state_nolock()) ffff8cb8c3fca000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1789049609.115821:0:8:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff8cb8c3fca000 using connection 192.168.206.126@tcp/0@lo 00000100:00100000:3.0:1789049609.115858:0:8:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8cb7c5c34000 x1875954110659712/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1789049609.115889:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb7c5c36300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:817823bd-3ba1-432d-9714-f03a15bff403:3309:1875954110659456:0@lo:400:kworker.0 00000100:00100000:3.0:1789049609.115918:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb7c5c36a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3308:1875954110659968:0@lo:400:kworker.0 00000100:00100000:3.0:1789049609.121553:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789049609.121637:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789049609.121649:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb7c5c36680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3308:1875954110660096:0@lo:400:kworker.0 00000100:00100000:3.0:1789049609.121684:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789049609.121728:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb7c5c36d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1875954110659584:0@lo:400:kworker.0 00000100:00100000:3.0:1789049609.121755:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789049609.121780:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789049609.121786:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb7c5c34e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3310:1875954110659840:0@lo:400:kworker.0 00000100:00100000:3.0:1789049609.121809:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789049609.121840:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb7c5c34000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3307:1875954110659712:0@lo:8:kworker.0 00000100:00100000:3.0:1789049609.121880:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789049609.123157:0:14329:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954110659968 00000100:00100000:1.0:1789049609.123168:0:14329:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954110659968 00000100:00100000:2.0:1789049609.123264:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789049609.123351:0:15013:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954110659584 00000100:00100000:2.0:1789049609.123356:0:15013:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954110659584 00000100:00100000:1.0:1789049609.129172:0:14329:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954110660096 00000100:00100000:1.0:1789049609.129186:0:14329:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954110660096 00000100:00100000:2.0:1789049609.132697:0:15013:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954110659712 00000100:00100000:2.0:1789049609.132712:0:15013:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954110659712 00000100:00100000:2.0:1789049609.132730:0:15013:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1789049609.132744:0:15013:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb7c5c35c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3310:x1875954110659584:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789049609.132834:0:15013:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb7c5c35c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3310:x1875954110659584:12345-0@lo:400:kworker.0 Request processed in 96us (11077us total) trans 0 rc 0/0 00000100:00100000:2.0:1789049609.132855:0:15013:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1789049609.132884:0:15013:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1789049609.132889:0:15013:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8d0ab5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3307:x1875954110659712:12345-0@lo:8:kworker.0 00010000:00080000:2.0:1789049609.132914:0:15013:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 435 last 0 00000020:00000080:2.0:1789049609.132942:0:15013:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xf4f48ce5e1bc0046 00002000:00100000:2.0:1789049609.132955:0:15013:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff8cb7c460f800 ocd_connect_flags: 0xa044c01443000026 ocd_version: 2113a28 ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:2.0:1789049609.132959:0:15013:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00002000:00100000:2.0:1789049609.132967:0:15013:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:2.0:1789049609.133286:0:15013:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1789049609.133323:0:15013:0:(import.c:65:import_set_state_nolock()) ffff8cb7c460c800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1789049609.133366:0:15013:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8d0ab5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3307:x1875954110659712:12345-0@lo:8:kworker.0 Request processed in 476us (11485us total) trans 0 rc 0/0 00000100:00100000:2.0:1789049609.133374:0:15013:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1789049609.133400:0:14323:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954110659456 00000100:00100000:2.0:1789049609.133404:0:14323:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954110659456 00000100:00100000:2.0:1789049609.133436:0:14323:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1789049609.133443:0:14323:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb7c47f4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:817823bd-3ba1-432d-9714-f03a15bff403+19:3309:x1875954110659456:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789049609.133479:0:14323:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb7c47f4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:817823bd-3ba1-432d-9714-f03a15bff403+19:3309:x1875954110659456:12345-0@lo:400:kworker.0 Request processed in 36us (10217us total) trans 0 rc 0/0 00000100:00100000:2.0:1789049609.133485:0:14323:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00010000:00080000:2.0:1789049609.133763:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cb7c5c34000 x1875954110659712/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1789049634 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1789049609.133780:0:3307:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 2 00000100:00080000:2.0:1789049609.133787:0:3307:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040c01443000026 00000100:00080000:2.0:1789049609.133792:0:3307:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:2.0:1789049609.133794:0:3307:0:(import.c:65:import_set_state_nolock()) ffff8cb8c3fca000 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:2.0:1789049609.133807:0:3307:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:2.0:1789049609.133811:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb7c5c34000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3307:1875954110659712:0@lo:8:kworker.0 00000004:00080000:2.0:1789049609.133881:0:14352:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x280000400:0x5:0x0] 00000100:00100000:2.0:1789049609.133900:0:14352:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb900e95c00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14352:1875954110660352:0@lo:5:osp-pre-1-0.0 00000100:00100000:2.0:1789049609.133933:0:14352:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789049609.133953:0:14352:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cb8c7c973c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789049609.133978:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1789049609.133988:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb900e96680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3311:1875954110660224:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789049609.134019:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789049609.134044:0:15016:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954110660224 00000100:00100000:2.0:1789049609.134049:0:15016:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954110660224 00000100:00100000:2.0:1789049609.134080:0:15016:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1789049609.134087:0:15016:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb900e95880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3311:x1875954110660224:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1789049609.134106:0:15016:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789049609.134140:0:15016:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb900e95880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3311:x1875954110660224:12345-0@lo:13:osp-pre-1-0.0 Request processed in 53us (121us total) trans 0 rc 0/0 00000100:00100000:2.0:1789049609.134147:0:15016:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:2.0:1789049609.134176:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cb900e96680 x1875954110660224/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789049625 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789049609.134190:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb900e96680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3311:1875954110660224:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789049609.134218:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb7c5c36d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1875954110659584:0@lo:400:kworker.0 00000100:00100000:2.0:1789049609.134243:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb7c5c36300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:817823bd-3ba1-432d-9714-f03a15bff403:3309:1875954110659456:0@lo:400:kworker.0 00000100:00100000:2.0:1789049609.134259:0:15013:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954110660352 00000100:00100000:2.0:1789049609.134262:0:15013:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954110660352 00000100:00100000:2.0:1789049609.134285:0:15013:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1789049609.134290:0:15013:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb900e94380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:14352:x1875954110660352:12345-0@lo:5:osp-pre-1-0.0 00000100:00100000:3.0:1789049609.135408:0:14327:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954110659840 00000100:00100000:3.0:1789049609.135415:0:14327:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954110659840 00000100:00100000:3.0:1789049609.135451:0:14327:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1789049609.135459:0:14327:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb7c5c37100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1875954110659968:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789049609.135522:0:14327:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb7c5c37100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1875954110659968:12345-0@lo:400:kworker.0 Request processed in 65us (13977us total) trans 0 rc 0/0 00000100:00100000:3.0:1789049609.135529:0:14327:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1789049609.135544:0:14327:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1789049609.135551:0:14327:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8d0ab4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1875954110659840:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789049609.135583:0:14327:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8d0ab4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1875954110659840:12345-0@lo:400:kworker.0 Request processed in 34us (13774us total) trans 0 rc 0/0 00000100:00100000:3.0:1789049609.135589:0:14327:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00080000:3.0:1789049609.135606:0:14324:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789049609.135610:0:14324:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1789049609.135613:0:14324:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00080000:1.0:1789049609.138031:0:14351:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00010000:00080000:2.0:1789049609.141549:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cb7c5c34e00 x1875954110659840/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789049625 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789049609.141564:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb7c5c34e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3310:1875954110659840:0@lo:400:kworker.0 00002000:00080000:2.0:1789049609.142790:0:15013:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x280000400 00002000:00080000:2.0:1789049609.142799:0:15013:0:(ofd_dev.c:1646:ofd_create_hdl()) ofd_last_id() = 33 -> diff = -28 00002000:02000040:2.0:1789049609.142803:0:15013:0:(ofd_dev.c:1497:ofd_orphans_destroy()) lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000400:6 to 0x280000400:33) 00010000:00080000:3.0:1789049609.144124:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cb7c5c36a00 x1875954110659968/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789049625 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789049609.144141:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb7c5c36a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3308:1875954110659968:0@lo:400:kworker.0 00002000:00010000:2.0:1789049609.152620:0:15013:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x21:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789049609.152631:0:15013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000650238d0/0xf4f48ce5e1bc004d lrc: 3/0,1 mode: --/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049609.152648:0:15013:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x21:0x0].0x0 since=435s v=(0 0) 00010000:00010000:2.0:1789049609.152766:0:15013:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x21:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789049609.152774:0:15013:0:(ldlm_resource.c:1751:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000650238d0/0xf4f48ce5e1bc004d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049609.152792:0:15013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000650238d0/0xf4f48ce5e1bc004d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049609.152802:0:15013:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000650238d0/0xf4f48ce5e1bc004d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049609.152809:0:15013:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000650238d0/0xf4f48ce5e1bc004d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049609.152831:0:15013:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789049609.152930:0:14317:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789049609.152937:0:14317:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000650238d0/0xf4f48ce5e1bc004d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049609.152945:0:14317:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cb900e62800 already unused, calling callback (ffffffffc166a8f0) 00010000:00010000:2.0:1789049609.152950:0:14317:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000650238d0/0xf4f48ce5e1bc004d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1789049609.153099:0:14351:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 435205253866ns, next at 0ns, rc = 0 00010000:00010000:2.0:1789049609.153105:0:14317:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000650238d0/0xf4f48ce5e1bc004d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049609.153124:0:14317:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000650238d0/0xf4f48ce5e1bc004d lrc: 1/0,0 mode: --/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049609.153131:0:14317:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000650238d0/0xf4f48ce5e1bc004d lrc: 0/0,0 mode: --/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049609.153147:0:14317:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789049609.153149:0:14317:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789049609.153150:0:14317:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789049609.154174:0:14329:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1789049609.154187:0:14329:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb7c5c34a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1875954110660096:12345-0@lo:400:kworker.0 00002000:00010000:2.0:1789049609.154259:0:15013:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x20:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789049609.154266:0:15013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d233b00f/0xf4f48ce5e1bc0054 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789049609.154268:0:14329:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb7c5c34a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1875954110660096:12345-0@lo:400:kworker.0 Request processed in 85us (32583us total) trans 0 rc 0/0 00000100:00100000:0.0:1789049609.154274:0:14329:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00010000:2.0:1789049609.154278:0:15013:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x20:0x0].0x0 since=435s v=(0 0) 00010000:00010000:2.0:1789049609.154282:0:15013:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x20:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789049609.154287:0:15013:0:(ldlm_resource.c:1751:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d233b00f/0xf4f48ce5e1bc0054 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049609.154298:0:15013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d233b00f/0xf4f48ce5e1bc0054 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049609.154316:0:15013:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d233b00f/0xf4f48ce5e1bc0054 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049609.154331:0:15013:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d233b00f/0xf4f48ce5e1bc0054 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049609.154346:0:15013:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789049609.154356:0:14316:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789049609.154361:0:14316:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d233b00f/0xf4f48ce5e1bc0054 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049609.154368:0:14316:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cb900e62000 already unused, calling callback (ffffffffc166a8f0) 00010000:00010000:2.0:1789049609.154371:0:14316:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d233b00f/0xf4f48ce5e1bc0054 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049609.154378:0:14316:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d233b00f/0xf4f48ce5e1bc0054 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049609.154392:0:14316:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d233b00f/0xf4f48ce5e1bc0054 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049609.154399:0:14316:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d233b00f/0xf4f48ce5e1bc0054 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049609.154414:0:14316:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789049609.154415:0:14316:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789049609.154416:0:14316:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1789049609.155341:0:15013:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789049609.155358:0:15013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e0b64209/0xf4f48ce5e1bc005b lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049609.155370:0:15013:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1f:0x0].0x0 since=435s v=(0 0) 00010000:00010000:2.0:1789049609.155374:0:15013:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789049609.155379:0:15013:0:(ldlm_resource.c:1751:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e0b64209/0xf4f48ce5e1bc005b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049609.155390:0:15013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e0b64209/0xf4f48ce5e1bc005b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049609.155398:0:15013:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e0b64209/0xf4f48ce5e1bc005b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049609.155406:0:15013:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e0b64209/0xf4f48ce5e1bc005b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049609.155420:0:15013:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789049609.155747:0:15620:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789049609.155753:0:15620:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e0b64209/0xf4f48ce5e1bc005b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049609.155762:0:15620:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cb900e62600 already unused, calling callback (ffffffffc166a8f0) 00010000:00010000:0.0:1789049609.155765:0:15620:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e0b64209/0xf4f48ce5e1bc005b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049609.155775:0:15620:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e0b64209/0xf4f48ce5e1bc005b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049609.155802:0:15620:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e0b64209/0xf4f48ce5e1bc005b lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049609.155810:0:15620:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e0b64209/0xf4f48ce5e1bc005b lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049609.155827:0:15620:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789049609.155829:0:15620:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789049609.155831:0:15620:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1789049609.156762:0:15013:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789049609.156770:0:15013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f38c5358/0xf4f48ce5e1bc0062 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049609.156781:0:15013:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1e:0x0].0x0 since=435s v=(0 0) 00010000:00010000:2.0:1789049609.156785:0:15013:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789049609.156789:0:15013:0:(ldlm_resource.c:1751:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f38c5358/0xf4f48ce5e1bc0062 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049609.156800:0:15013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f38c5358/0xf4f48ce5e1bc0062 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049609.156814:0:15013:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f38c5358/0xf4f48ce5e1bc0062 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049609.156821:0:15013:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f38c5358/0xf4f48ce5e1bc0062 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049609.156835:0:15013:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789049609.156920:0:14317:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789049609.156925:0:14317:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f38c5358/0xf4f48ce5e1bc0062 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049609.156932:0:14317:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cb900e63200 already unused, calling callback (ffffffffc166a8f0) 00010000:00010000:2.0:1789049609.156935:0:14317:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f38c5358/0xf4f48ce5e1bc0062 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049609.156943:0:14317:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f38c5358/0xf4f48ce5e1bc0062 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049609.156956:0:14317:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f38c5358/0xf4f48ce5e1bc0062 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049609.156963:0:14317:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f38c5358/0xf4f48ce5e1bc0062 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049609.157039:0:14317:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789049609.157046:0:14317:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789049609.157047:0:14317:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1789049609.157681:0:15013:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789049609.157687:0:15013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e43ebbe8/0xf4f48ce5e1bc0069 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049609.157697:0:15013:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1d:0x0].0x0 since=435s v=(0 0) 00010000:00010000:2.0:1789049609.157700:0:15013:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789049609.157704:0:15013:0:(ldlm_resource.c:1751:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e43ebbe8/0xf4f48ce5e1bc0069 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049609.157713:0:15013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e43ebbe8/0xf4f48ce5e1bc0069 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049609.157721:0:15013:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e43ebbe8/0xf4f48ce5e1bc0069 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049609.157728:0:15013:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e43ebbe8/0xf4f48ce5e1bc0069 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00080000:3.0:1789049609.161518:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cb7c5c36680 x1875954110660096/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789049625 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789049609.161537:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb7c5c36680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3308:1875954110660096:0@lo:400:kworker.0 00010000:00010000:2.0:1789049609.172397:0:15013:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789049609.172583:0:14316:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789049609.172593:0:14316:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e43ebbe8/0xf4f48ce5e1bc0069 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049609.172607:0:14316:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cb900e63c00 already unused, calling callback (ffffffffc166a8f0) 00010000:00010000:2.0:1789049609.172611:0:14316:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e43ebbe8/0xf4f48ce5e1bc0069 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049609.172633:0:14316:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e43ebbe8/0xf4f48ce5e1bc0069 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049609.172655:0:14316:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e43ebbe8/0xf4f48ce5e1bc0069 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049609.172673:0:14316:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e43ebbe8/0xf4f48ce5e1bc0069 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049609.172698:0:14316:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789049609.172700:0:14316:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789049609.172702:0:14316:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789049609.174929:0:15013:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1789049609.174940:0:15013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b84a320d/0xf4f48ce5e1bc0070 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049609.174955:0:15013:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1c:0x0].0x0 since=435s v=(0 0) 00010000:00010000:3.0:1789049609.174959:0:15013:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789049609.174966:0:15013:0:(ldlm_resource.c:1751:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b84a320d/0xf4f48ce5e1bc0070 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049609.175109:0:15013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b84a320d/0xf4f48ce5e1bc0070 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049609.175121:0:15013:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b84a320d/0xf4f48ce5e1bc0070 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049609.175129:0:15013:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b84a320d/0xf4f48ce5e1bc0070 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049609.175148:0:15013:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789049609.175160:0:15620:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789049609.175165:0:15620:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b84a320d/0xf4f48ce5e1bc0070 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049609.175173:0:15620:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cb8d6715a00 already unused, calling callback (ffffffffc166a8f0) 00010000:00010000:3.0:1789049609.175177:0:15620:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b84a320d/0xf4f48ce5e1bc0070 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049609.175185:0:15620:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b84a320d/0xf4f48ce5e1bc0070 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049609.175199:0:15620:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b84a320d/0xf4f48ce5e1bc0070 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049609.175206:0:15620:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b84a320d/0xf4f48ce5e1bc0070 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049609.175228:0:15620:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789049609.175230:0:15620:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789049609.175231:0:15620:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789049609.175640:0:15013:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1789049609.175647:0:15013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f26278f2/0xf4f48ce5e1bc0077 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049609.175655:0:15013:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1b:0x0].0x0 since=435s v=(0 0) 00010000:00010000:3.0:1789049609.175658:0:15013:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789049609.175662:0:15013:0:(ldlm_resource.c:1751:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f26278f2/0xf4f48ce5e1bc0077 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049609.175671:0:15013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f26278f2/0xf4f48ce5e1bc0077 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049609.175678:0:15013:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f26278f2/0xf4f48ce5e1bc0077 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049609.175685:0:15013:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f26278f2/0xf4f48ce5e1bc0077 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049609.175700:0:15013:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1789049609.179907:0:15013:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1789049609.179921:0:15013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007011bca5/0xf4f48ce5e1bc007e lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049609.179949:0:15013:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1a:0x0].0x0 since=435s v=(0 0) 00010000:00010000:3.0:1789049609.179953:0:15013:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789049609.179959:0:15013:0:(ldlm_resource.c:1751:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007011bca5/0xf4f48ce5e1bc007e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049609.180274:0:15013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007011bca5/0xf4f48ce5e1bc007e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049609.180288:0:15013:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007011bca5/0xf4f48ce5e1bc007e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049609.180297:0:15013:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000007011bca5/0xf4f48ce5e1bc007e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049609.180329:0:15013:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1789049609.180818:0:14317:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1789049609.180826:0:14317:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f26278f2/0xf4f48ce5e1bc0077 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049609.180835:0:14317:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cb8d6715200 already unused, calling callback (ffffffffc166a8f0) 00010000:00010000:2.0:1789049609.180840:0:14317:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f26278f2/0xf4f48ce5e1bc0077 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049609.180886:0:14317:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f26278f2/0xf4f48ce5e1bc0077 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049609.180902:0:14317:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f26278f2/0xf4f48ce5e1bc0077 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049609.180922:0:14317:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f26278f2/0xf4f48ce5e1bc0077 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049609.180941:0:14317:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789049609.180944:0:14317:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000007011bca5/0xf4f48ce5e1bc007e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049609.180950:0:14317:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cb8d6714a00 already unused, calling callback (ffffffffc166a8f0) 00010000:00010000:2.0:1789049609.180953:0:14317:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000007011bca5/0xf4f48ce5e1bc007e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049609.180960:0:14317:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000007011bca5/0xf4f48ce5e1bc007e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049609.180969:0:14317:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000007011bca5/0xf4f48ce5e1bc007e lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049609.180986:0:14317:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007011bca5/0xf4f48ce5e1bc007e lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049609.180997:0:14317:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789049609.180999:0:14317:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789049609.181000:0:14317:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789049609.181006:0:14316:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789049609.190323:0:15013:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x19:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789049609.190338:0:15013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000dccf69bb/0xf4f48ce5e1bc0085 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049609.190355:0:15013:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x19:0x0].0x0 since=435s v=(0 0) 00010000:00010000:1.0:1789049609.190360:0:15013:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x19:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789049609.190366:0:15013:0:(ldlm_resource.c:1751:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000dccf69bb/0xf4f48ce5e1bc0085 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049609.190382:0:15013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000dccf69bb/0xf4f48ce5e1bc0085 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049609.190407:0:15013:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000dccf69bb/0xf4f48ce5e1bc0085 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049609.190415:0:15013:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000dccf69bb/0xf4f48ce5e1bc0085 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049609.190442:0:15013:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1789049609.190927:0:15013:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x18:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789049609.190933:0:15013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004f91907a/0xf4f48ce5e1bc008c lrc: 3/0,1 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049609.190941:0:15013:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x18:0x0].0x0 since=435s v=(0 0) 00010000:00010000:1.0:1789049609.190944:0:15013:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x18:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789049609.190948:0:15013:0:(ldlm_resource.c:1751:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004f91907a/0xf4f48ce5e1bc008c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049609.190956:0:15013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004f91907a/0xf4f48ce5e1bc008c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049609.190964:0:15013:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004f91907a/0xf4f48ce5e1bc008c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049609.190970:0:15013:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004f91907a/0xf4f48ce5e1bc008c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049609.190998:0:15013:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1789049609.191144:0:15620:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1789049609.191152:0:15620:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000dccf69bb/0xf4f48ce5e1bc0085 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049609.191163:0:15620:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cb8c28c2200 already unused, calling callback (ffffffffc166a8f0) 00010000:00010000:3.0:1789049609.191168:0:15620:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000dccf69bb/0xf4f48ce5e1bc0085 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049609.191178:0:15620:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000dccf69bb/0xf4f48ce5e1bc0085 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049609.191209:0:15620:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000dccf69bb/0xf4f48ce5e1bc0085 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049609.191218:0:15620:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000dccf69bb/0xf4f48ce5e1bc0085 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049609.191240:0:15620:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789049609.191243:0:15620:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004f91907a/0xf4f48ce5e1bc008c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049609.191250:0:15620:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cb8c28c2e00 already unused, calling callback (ffffffffc166a8f0) 00010000:00010000:3.0:1789049609.191254:0:15620:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004f91907a/0xf4f48ce5e1bc008c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049609.191262:0:15620:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004f91907a/0xf4f48ce5e1bc008c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049609.191272:0:15620:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004f91907a/0xf4f48ce5e1bc008c lrc: 1/0,0 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049609.191278:0:15620:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004f91907a/0xf4f48ce5e1bc008c lrc: 0/0,0 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049609.191290:0:15620:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789049609.191292:0:15620:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789049609.191300:0:15620:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789049609.191507:0:15013:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x17:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789049609.191513:0:15013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009130cead/0xf4f48ce5e1bc0093 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049609.191521:0:15013:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17:0x0].0x0 since=435s v=(0 0) 00010000:00010000:1.0:1789049609.191524:0:15013:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789049609.191529:0:15013:0:(ldlm_resource.c:1751:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009130cead/0xf4f48ce5e1bc0093 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049609.191538:0:15013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009130cead/0xf4f48ce5e1bc0093 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049609.191545:0:15013:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009130cead/0xf4f48ce5e1bc0093 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049609.191554:0:15013:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000009130cead/0xf4f48ce5e1bc0093 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049609.191568:0:15013:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1789049609.192068:0:15013:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x16:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789049609.192074:0:15013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000079117db1/0xf4f48ce5e1bc009a lrc: 3/0,1 mode: --/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049609.192083:0:15013:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x16:0x0].0x0 since=435s v=(0 0) 00010000:00010000:1.0:1789049609.192093:0:15013:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x16:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789049609.192098:0:15013:0:(ldlm_resource.c:1751:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000079117db1/0xf4f48ce5e1bc009a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049609.192110:0:15013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000079117db1/0xf4f48ce5e1bc009a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049609.192120:0:15013:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000079117db1/0xf4f48ce5e1bc009a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049609.192127:0:15013:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000079117db1/0xf4f48ce5e1bc009a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049609.192139:0:15013:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:1.0:1789049609.192610:0:15013:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x15:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789049609.192616:0:15013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007f80b415/0xf4f48ce5e1bc00a1 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049609.192624:0:15013:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x15:0x0].0x0 since=435s v=(0 0) 00010000:00010000:1.0:1789049609.192628:0:15013:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x15:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789049609.192632:0:15013:0:(ldlm_resource.c:1751:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007f80b415/0xf4f48ce5e1bc00a1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049609.192642:0:15013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007f80b415/0xf4f48ce5e1bc00a1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049609.192650:0:15013:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007f80b415/0xf4f48ce5e1bc00a1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049609.192664:0:15013:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000007f80b415/0xf4f48ce5e1bc00a1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049609.192673:0:15013:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:3.0:1789049609.192726:0:15620:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1789049609.192733:0:15620:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000009130cead/0xf4f48ce5e1bc0093 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049609.192742:0:15620:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cb8c28c2800 already unused, calling callback (ffffffffc166a8f0) 00010000:00010000:3.0:1789049609.192747:0:15620:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000009130cead/0xf4f48ce5e1bc0093 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049609.192756:0:15620:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000009130cead/0xf4f48ce5e1bc0093 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049609.192772:0:15620:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000009130cead/0xf4f48ce5e1bc0093 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049609.192780:0:15620:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009130cead/0xf4f48ce5e1bc0093 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049609.192795:0:15620:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1789049609.192799:0:15620:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000079117db1/0xf4f48ce5e1bc009a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049609.192805:0:15620:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cb8c28c3c00 already unused, calling callback (ffffffffc166a8f0) 00010000:00010000:3.0:1789049609.192808:0:15620:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000079117db1/0xf4f48ce5e1bc009a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049609.192815:0:15620:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000079117db1/0xf4f48ce5e1bc009a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049609.192831:0:15620:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000079117db1/0xf4f48ce5e1bc009a lrc: 1/0,0 mode: --/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049609.192838:0:15620:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000079117db1/0xf4f48ce5e1bc009a lrc: 0/0,0 mode: --/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049609.192866:0:15620:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789049609.192869:0:15620:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000007f80b415/0xf4f48ce5e1bc00a1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049609.192875:0:15620:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cb8c28c2400 already unused, calling callback (ffffffffc166a8f0) 00010000:00010000:3.0:1789049609.192879:0:15620:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000007f80b415/0xf4f48ce5e1bc00a1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049609.192886:0:15620:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000007f80b415/0xf4f48ce5e1bc00a1 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049609.192894:0:15620:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000007f80b415/0xf4f48ce5e1bc00a1 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049609.192901:0:15620:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007f80b415/0xf4f48ce5e1bc00a1 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049609.192911:0:15620:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789049609.192912:0:15620:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789049609.192918:0:15620:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789049609.194094:0:14317:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789049609.196660:0:14316:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789049609.200120:0:15013:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x14:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789049609.200133:0:15013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000acc6525f/0xf4f48ce5e1bc00a8 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049609.200151:0:15013:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x14:0x0].0x0 since=435s v=(0 0) 00010000:00010000:1.0:1789049609.200155:0:15013:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789049609.200161:0:15013:0:(ldlm_resource.c:1751:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000acc6525f/0xf4f48ce5e1bc00a8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049609.200176:0:15013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000acc6525f/0xf4f48ce5e1bc00a8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049609.200186:0:15013:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000acc6525f/0xf4f48ce5e1bc00a8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049609.200194:0:15013:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000acc6525f/0xf4f48ce5e1bc00a8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049609.200212:0:15013:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789049609.201929:0:15620:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789049609.201940:0:15620:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000acc6525f/0xf4f48ce5e1bc00a8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049609.201953:0:15620:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cb8c28c2600 already unused, calling callback (ffffffffc166a8f0) 00010000:00010000:3.0:1789049609.201958:0:15620:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000acc6525f/0xf4f48ce5e1bc00a8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049609.201969:0:15620:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000acc6525f/0xf4f48ce5e1bc00a8 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049609.201988:0:15620:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000acc6525f/0xf4f48ce5e1bc00a8 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049609.201996:0:15620:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000acc6525f/0xf4f48ce5e1bc00a8 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049609.202022:0:15620:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789049609.202025:0:15620:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789049609.202028:0:15620:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789049609.206112:0:15013:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x13:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789049609.206126:0:15013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001870f5eb/0xf4f48ce5e1bc00af lrc: 3/0,1 mode: --/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049609.206149:0:15013:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x13:0x0].0x0 since=435s v=(0 0) 00010000:00010000:1.0:1789049609.206154:0:15013:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x13:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789049609.206161:0:15013:0:(ldlm_resource.c:1751:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001870f5eb/0xf4f48ce5e1bc00af lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049609.206176:0:15013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001870f5eb/0xf4f48ce5e1bc00af lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049609.206187:0:15013:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001870f5eb/0xf4f48ce5e1bc00af lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049609.206195:0:15013:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001870f5eb/0xf4f48ce5e1bc00af lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049609.206214:0:15013:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789049609.207062:0:14317:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789049609.207071:0:14317:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001870f5eb/0xf4f48ce5e1bc00af lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049609.207082:0:14317:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cb8c28c3800 already unused, calling callback (ffffffffc166a8f0) 00010000:00010000:3.0:1789049609.207087:0:14317:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001870f5eb/0xf4f48ce5e1bc00af lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049609.207106:0:14317:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001870f5eb/0xf4f48ce5e1bc00af lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049609.207165:0:14317:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001870f5eb/0xf4f48ce5e1bc00af lrc: 1/0,0 mode: --/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049609.207174:0:14317:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001870f5eb/0xf4f48ce5e1bc00af lrc: 0/0,0 mode: --/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049609.207199:0:14317:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789049609.207201:0:14317:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789049609.207203:0:14317:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789049609.209225:0:15013:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x12:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789049609.209235:0:15013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007f80b415/0xf4f48ce5e1bc00b6 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049609.209251:0:15013:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x12:0x0].0x0 since=435s v=(0 0) 00010000:00010000:1.0:1789049609.209255:0:15013:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x12:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789049609.209261:0:15013:0:(ldlm_resource.c:1751:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007f80b415/0xf4f48ce5e1bc00b6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049609.209274:0:15013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007f80b415/0xf4f48ce5e1bc00b6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049609.209455:0:15013:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007f80b415/0xf4f48ce5e1bc00b6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049609.209464:0:15013:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000007f80b415/0xf4f48ce5e1bc00b6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049609.209484:0:15013:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789049609.209498:0:14316:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789049609.209504:0:14316:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000007f80b415/0xf4f48ce5e1bc00b6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049609.209513:0:14316:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cb8c28c2400 already unused, calling callback (ffffffffc166a8f0) 00010000:00010000:1.0:1789049609.209517:0:14316:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000007f80b415/0xf4f48ce5e1bc00b6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049609.209526:0:14316:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000007f80b415/0xf4f48ce5e1bc00b6 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049609.209543:0:14316:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000007f80b415/0xf4f48ce5e1bc00b6 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049609.209550:0:14316:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007f80b415/0xf4f48ce5e1bc00b6 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049609.209567:0:14316:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789049609.209575:0:14316:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789049609.209577:0:14316:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789049609.215049:0:15013:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x11:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789049609.215063:0:15013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000079117db1/0xf4f48ce5e1bc00bd lrc: 3/0,1 mode: --/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049609.215077:0:15013:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x11:0x0].0x0 since=435s v=(0 0) 00010000:00010000:1.0:1789049609.215082:0:15013:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789049609.215088:0:15013:0:(ldlm_resource.c:1751:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000079117db1/0xf4f48ce5e1bc00bd lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049609.215102:0:15013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000079117db1/0xf4f48ce5e1bc00bd lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049609.215112:0:15013:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000079117db1/0xf4f48ce5e1bc00bd lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049609.215120:0:15013:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000079117db1/0xf4f48ce5e1bc00bd lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049609.215146:0:15013:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789049609.215499:0:15620:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789049609.215507:0:15620:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000079117db1/0xf4f48ce5e1bc00bd lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049609.215518:0:15620:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cb8c28c3c00 already unused, calling callback (ffffffffc166a8f0) 00010000:00010000:3.0:1789049609.215523:0:15620:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000079117db1/0xf4f48ce5e1bc00bd lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049609.215533:0:15620:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000079117db1/0xf4f48ce5e1bc00bd lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049609.215551:0:15620:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000079117db1/0xf4f48ce5e1bc00bd lrc: 1/0,0 mode: --/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049609.215583:0:15620:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000079117db1/0xf4f48ce5e1bc00bd lrc: 0/0,0 mode: --/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049609.215605:0:15620:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789049609.215609:0:15620:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789049609.215610:0:15620:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789049609.215689:0:15013:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x10:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789049609.215697:0:15013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009130cead/0xf4f48ce5e1bc00c4 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049609.215707:0:15013:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x10:0x0].0x0 since=435s v=(0 0) 00010000:00010000:1.0:1789049609.215710:0:15013:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x10:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789049609.215715:0:15013:0:(ldlm_resource.c:1751:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009130cead/0xf4f48ce5e1bc00c4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049609.215732:0:15013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009130cead/0xf4f48ce5e1bc00c4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049609.215741:0:15013:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009130cead/0xf4f48ce5e1bc00c4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049609.215749:0:15013:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000009130cead/0xf4f48ce5e1bc00c4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049609.215769:0:15013:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789049609.215791:0:14317:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789049609.215798:0:14317:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000009130cead/0xf4f48ce5e1bc00c4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049609.215806:0:14317:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cb8c28c2800 already unused, calling callback (ffffffffc166a8f0) 00010000:00010000:3.0:1789049609.215810:0:14317:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000009130cead/0xf4f48ce5e1bc00c4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049609.215819:0:14317:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000009130cead/0xf4f48ce5e1bc00c4 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049609.215833:0:14317:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000009130cead/0xf4f48ce5e1bc00c4 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049609.215919:0:14317:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009130cead/0xf4f48ce5e1bc00c4 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049609.215937:0:14317:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789049609.215940:0:14317:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789049609.215944:0:14317:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789049609.216208:0:15013:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789049609.216214:0:15013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004f91907a/0xf4f48ce5e1bc00cb lrc: 3/0,1 mode: --/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049609.216222:0:15013:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xf:0x0].0x0 since=435s v=(0 0) 00010000:00010000:1.0:1789049609.216224:0:15013:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789049609.216229:0:15013:0:(ldlm_resource.c:1751:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004f91907a/0xf4f48ce5e1bc00cb lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049609.216238:0:15013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004f91907a/0xf4f48ce5e1bc00cb lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049609.216247:0:15013:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004f91907a/0xf4f48ce5e1bc00cb lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049609.216266:0:15013:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004f91907a/0xf4f48ce5e1bc00cb lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049609.216290:0:15013:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789049609.216323:0:14316:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789049609.216329:0:14316:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004f91907a/0xf4f48ce5e1bc00cb lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049609.216337:0:14316:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cb8c28c2e00 already unused, calling callback (ffffffffc166a8f0) 00010000:00010000:3.0:1789049609.216341:0:14316:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004f91907a/0xf4f48ce5e1bc00cb lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049609.216349:0:14316:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004f91907a/0xf4f48ce5e1bc00cb lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049609.216363:0:14316:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004f91907a/0xf4f48ce5e1bc00cb lrc: 1/0,0 mode: --/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049609.216370:0:14316:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004f91907a/0xf4f48ce5e1bc00cb lrc: 0/0,0 mode: --/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049609.216388:0:14316:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789049609.216390:0:14316:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789049609.216393:0:14316:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789049609.216727:0:15013:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xe:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789049609.216733:0:15013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000dccf69bb/0xf4f48ce5e1bc00d2 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049609.216741:0:15013:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xe:0x0].0x0 since=435s v=(0 0) 00010000:00010000:1.0:1789049609.216745:0:15013:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789049609.216749:0:15013:0:(ldlm_resource.c:1751:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000dccf69bb/0xf4f48ce5e1bc00d2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049609.216758:0:15013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000dccf69bb/0xf4f48ce5e1bc00d2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049609.216765:0:15013:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000dccf69bb/0xf4f48ce5e1bc00d2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049609.216772:0:15013:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000dccf69bb/0xf4f48ce5e1bc00d2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049609.216793:0:15013:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789049609.218374:0:15620:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789049609.218384:0:15620:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000dccf69bb/0xf4f48ce5e1bc00d2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049609.218396:0:15620:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cb8c28c2200 already unused, calling callback (ffffffffc166a8f0) 00010000:00010000:3.0:1789049609.219439:0:15620:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000dccf69bb/0xf4f48ce5e1bc00d2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049609.219477:0:15620:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000dccf69bb/0xf4f48ce5e1bc00d2 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049609.219497:0:15620:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000dccf69bb/0xf4f48ce5e1bc00d2 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049609.219504:0:15620:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000dccf69bb/0xf4f48ce5e1bc00d2 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049609.219715:0:15620:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789049609.219718:0:15620:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789049609.219720:0:15620:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1789049609.222389:0:7663:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00002000:00010000:1.0:1789049609.225382:0:15013:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789049609.225397:0:15013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006146009f/0xf4f48ce5e1bc00d9 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049609.225423:0:15013:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xd:0x0].0x0 since=435s v=(0 0) 00010000:00010000:1.0:1789049609.225428:0:15013:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789049609.225435:0:15013:0:(ldlm_resource.c:1751:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006146009f/0xf4f48ce5e1bc00d9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049609.225451:0:15013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006146009f/0xf4f48ce5e1bc00d9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049609.225462:0:15013:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006146009f/0xf4f48ce5e1bc00d9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049609.225471:0:15013:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006146009f/0xf4f48ce5e1bc00d9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049609.225496:0:15013:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789049609.226143:0:14317:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789049609.226151:0:14317:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006146009f/0xf4f48ce5e1bc00d9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049609.226160:0:14317:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cb8c28c3400 already unused, calling callback (ffffffffc166a8f0) 00010000:00010000:3.0:1789049609.226164:0:14317:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006146009f/0xf4f48ce5e1bc00d9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049609.226173:0:14317:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006146009f/0xf4f48ce5e1bc00d9 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049609.226190:0:14317:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006146009f/0xf4f48ce5e1bc00d9 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049609.226210:0:14317:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006146009f/0xf4f48ce5e1bc00d9 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049609.226227:0:14317:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789049609.226228:0:14317:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789049609.226230:0:14317:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789049609.227135:0:15013:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789049609.227144:0:15013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007f80b415/0xf4f48ce5e1bc00e0 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049609.227157:0:15013:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xc:0x0].0x0 since=435s v=(0 0) 00010000:00010000:1.0:1789049609.227161:0:15013:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789049609.227167:0:15013:0:(ldlm_resource.c:1751:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007f80b415/0xf4f48ce5e1bc00e0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049609.227179:0:15013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007f80b415/0xf4f48ce5e1bc00e0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049609.227199:0:15013:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007f80b415/0xf4f48ce5e1bc00e0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049609.227207:0:15013:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000007f80b415/0xf4f48ce5e1bc00e0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049609.227267:0:15013:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1789049609.228524:0:15013:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789049609.228533:0:15013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000059a1f1e5/0xf4f48ce5e1bc00e7 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049609.228548:0:15013:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xb:0x0].0x0 since=435s v=(0 0) 00010000:00010000:1.0:1789049609.228552:0:15013:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789049609.228558:0:15013:0:(ldlm_resource.c:1751:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000059a1f1e5/0xf4f48ce5e1bc00e7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049609.228570:0:15013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000059a1f1e5/0xf4f48ce5e1bc00e7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049609.228579:0:15013:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000059a1f1e5/0xf4f48ce5e1bc00e7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049609.228587:0:15013:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000059a1f1e5/0xf4f48ce5e1bc00e7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049609.229611:0:14316:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1789049609.229685:0:14316:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000007f80b415/0xf4f48ce5e1bc00e0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049609.229695:0:14316:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cb8c28c2400 already unused, calling callback (ffffffffc166a8f0) 00010000:00010000:3.0:1789049609.229700:0:14316:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000007f80b415/0xf4f48ce5e1bc00e0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049609.229710:0:14316:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000007f80b415/0xf4f48ce5e1bc00e0 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049609.229728:0:14316:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000007f80b415/0xf4f48ce5e1bc00e0 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049609.229735:0:14316:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007f80b415/0xf4f48ce5e1bc00e0 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049609.229756:0:14316:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789049609.229760:0:14316:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000059a1f1e5/0xf4f48ce5e1bc00e7 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049609.229775:0:14316:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cb8c28c3e00 already unused, calling callback (ffffffffc166a8f0) 00010000:00010000:3.0:1789049609.229778:0:14316:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000059a1f1e5/0xf4f48ce5e1bc00e7 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049609.229786:0:14316:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000059a1f1e5/0xf4f48ce5e1bc00e7 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049609.229797:0:14316:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000059a1f1e5/0xf4f48ce5e1bc00e7 lrc: 2/0,0 mode: --/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049609.229806:0:14316:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789049609.229807:0:14316:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789049609.229809:0:14316:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789049609.230403:0:15013:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1789049609.230412:0:15013:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000059a1f1e5/0xf4f48ce5e1bc00e7 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049609.231077:0:15620:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:3.0:1789049609.240916:0:5872:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00002000:00010000:1.0:1789049609.241598:0:15013:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xa:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789049609.241608:0:15013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000089001826/0xf4f48ce5e1bc00ee lrc: 3/0,1 mode: --/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049609.241626:0:15013:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xa:0x0].0x0 since=435s v=(0 0) 00010000:00010000:1.0:1789049609.241630:0:15013:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789049609.241636:0:15013:0:(ldlm_resource.c:1751:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000089001826/0xf4f48ce5e1bc00ee lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049609.241650:0:15013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000089001826/0xf4f48ce5e1bc00ee lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049609.241661:0:15013:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000089001826/0xf4f48ce5e1bc00ee lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049609.241680:0:15013:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000089001826/0xf4f48ce5e1bc00ee lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049609.241702:0:15013:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789049609.241756:0:14317:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789049609.241763:0:14317:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000089001826/0xf4f48ce5e1bc00ee lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049609.241772:0:14317:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cb8c28c3200 already unused, calling callback (ffffffffc166a8f0) 00010000:00010000:3.0:1789049609.241777:0:14317:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000089001826/0xf4f48ce5e1bc00ee lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049609.241786:0:14317:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000089001826/0xf4f48ce5e1bc00ee lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049609.241814:0:14317:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000089001826/0xf4f48ce5e1bc00ee lrc: 1/0,0 mode: --/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049609.241821:0:14317:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000089001826/0xf4f48ce5e1bc00ee lrc: 0/0,0 mode: --/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049609.241838:0:14317:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789049609.241867:0:14317:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789049609.241869:0:14317:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789049609.242184:0:15013:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789049609.242190:0:15013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007f80b415/0xf4f48ce5e1bc00f5 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049609.242205:0:15013:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x9:0x0].0x0 since=435s v=(0 0) 00010000:00010000:1.0:1789049609.242209:0:15013:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789049609.242213:0:15013:0:(ldlm_resource.c:1751:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007f80b415/0xf4f48ce5e1bc00f5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049609.242222:0:15013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007f80b415/0xf4f48ce5e1bc00f5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049609.242231:0:15013:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007f80b415/0xf4f48ce5e1bc00f5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049609.242238:0:15013:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000007f80b415/0xf4f48ce5e1bc00f5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049609.242258:0:15013:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789049609.242384:0:14316:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789049609.242390:0:14316:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000007f80b415/0xf4f48ce5e1bc00f5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049609.242398:0:14316:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cb8c28c2400 already unused, calling callback (ffffffffc166a8f0) 00010000:00010000:3.0:1789049609.242401:0:14316:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000007f80b415/0xf4f48ce5e1bc00f5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049609.242410:0:14316:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000007f80b415/0xf4f48ce5e1bc00f5 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049609.242422:0:14316:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000007f80b415/0xf4f48ce5e1bc00f5 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049609.242429:0:14316:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007f80b415/0xf4f48ce5e1bc00f5 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049609.242454:0:14316:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789049609.242456:0:14316:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789049609.242458:0:14316:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789049609.242664:0:15013:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789049609.242671:0:15013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006146009f/0xf4f48ce5e1bc00fc lrc: 3/0,1 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049609.242679:0:15013:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x8:0x0].0x0 since=435s v=(0 0) 00010000:00010000:1.0:1789049609.242682:0:15013:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789049609.242687:0:15013:0:(ldlm_resource.c:1751:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006146009f/0xf4f48ce5e1bc00fc lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049609.242696:0:15013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006146009f/0xf4f48ce5e1bc00fc lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049609.242715:0:15013:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006146009f/0xf4f48ce5e1bc00fc lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049609.242723:0:15013:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006146009f/0xf4f48ce5e1bc00fc lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049609.242744:0:15013:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789049609.242760:0:15620:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789049609.242766:0:15620:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006146009f/0xf4f48ce5e1bc00fc lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049609.242773:0:15620:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cb8c28c3400 already unused, calling callback (ffffffffc166a8f0) 00010000:00010000:3.0:1789049609.242777:0:15620:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006146009f/0xf4f48ce5e1bc00fc lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049609.242785:0:15620:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006146009f/0xf4f48ce5e1bc00fc lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049609.242796:0:15620:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006146009f/0xf4f48ce5e1bc00fc lrc: 1/0,0 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049609.242804:0:15620:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006146009f/0xf4f48ce5e1bc00fc lrc: 0/0,0 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049609.242815:0:15620:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789049609.242817:0:15620:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789049609.242819:0:15620:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789049609.243223:0:15013:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1789049609.243230:0:15013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b84a320d/0xf4f48ce5e1bc0103 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049609.243250:0:15013:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x7:0x0].0x0 since=435s v=(0 0) 00010000:00010000:3.0:1789049609.243253:0:15013:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789049609.243257:0:15013:0:(ldlm_resource.c:1751:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b84a320d/0xf4f48ce5e1bc0103 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049609.243266:0:15013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b84a320d/0xf4f48ce5e1bc0103 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049609.243274:0:15013:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b84a320d/0xf4f48ce5e1bc0103 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049609.243281:0:15013:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b84a320d/0xf4f48ce5e1bc0103 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049609.243527:0:15013:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789049609.243753:0:14317:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789049609.243759:0:14317:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b84a320d/0xf4f48ce5e1bc0103 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049609.243767:0:14317:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cb8d6715a00 already unused, calling callback (ffffffffc166a8f0) 00010000:00010000:1.0:1789049609.243770:0:14317:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b84a320d/0xf4f48ce5e1bc0103 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049609.243779:0:14317:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b84a320d/0xf4f48ce5e1bc0103 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049609.243792:0:14317:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b84a320d/0xf4f48ce5e1bc0103 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049609.243799:0:14317:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b84a320d/0xf4f48ce5e1bc0103 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049609.243815:0:14317:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789049609.243822:0:14317:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789049609.243823:0:14317:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789049609.245070:0:15013:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1789049609.245082:0:15013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ec42a189/0xf4f48ce5e1bc010a lrc: 3/0,1 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049609.245096:0:15013:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=435s v=(0 0) 00010000:00010000:3.0:1789049609.245100:0:15013:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789049609.245106:0:15013:0:(ldlm_resource.c:1751:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ec42a189/0xf4f48ce5e1bc010a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049609.245119:0:15013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ec42a189/0xf4f48ce5e1bc010a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049609.245140:0:15013:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ec42a189/0xf4f48ce5e1bc010a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049609.245148:0:15013:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ec42a189/0xf4f48ce5e1bc010a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049609.245207:0:15013:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00080000:3.0:1789049609.245429:0:15013:0:(ofd_dev.c:1524:ofd_orphans_destroy()) lustre-OST0001: after destroy: set last_id to 0x280000400:5 00000100:00100000:3.0:1789049609.245513:0:15013:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb900e94380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:14352:x1875954110660352:12345-0@lo:5:osp-pre-1-0.0 Request processed in 111219us (111576us total) trans 0 rc 0/0 00000100:00100000:3.0:1789049609.245524:0:15013:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1789049609.245579:0:14352:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb900e95c00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14352:1875954110660352:0@lo:5:osp-pre-1-0.0 00000004:00080000:3.0:1789049609.245595:0:14352:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x280000400:0x21:0x0] from OST, last_created [0x280000400:0x21:0x0]last_used is [0x280000400:0x5:0x0] 00000100:00100000:3.0:1789049609.245662:0:14352:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb8d0ab7100 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14352:1875954110660480:0@lo:5:osp-pre-1-0.0 00000100:00100000:3.0:1789049609.245697:0:14352:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789049609.245735:0:14352:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cb7c5414240 going to sleep for 11 seconds 00000100:00100000:3.0:1789049609.245751:0:15011:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954110660480 00000100:00100000:3.0:1789049609.245757:0:15011:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954110660480 00000100:00100000:3.0:1789049609.245792:0:15011:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1789049609.245800:0:15011:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8d0ab6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:14352:x1875954110660480:12345-0@lo:5:osp-pre-1-0.0 00002000:00080000:3.0:1789049609.245837:0:15011:0:(ofd_dev.c:1753:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x280000400 at 34 00010000:00010000:2.0:1789049609.248422:0:14316:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789049609.248435:0:14316:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ec42a189/0xf4f48ce5e1bc010a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049609.248449:0:14316:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cb8d6715800 already unused, calling callback (ffffffffc166a8f0) 00010000:00010000:2.0:1789049609.248454:0:14316:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ec42a189/0xf4f48ce5e1bc010a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049609.248465:0:14316:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ec42a189/0xf4f48ce5e1bc010a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049609.248489:0:14316:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ec42a189/0xf4f48ce5e1bc010a lrc: 1/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049609.248498:0:14316:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ec42a189/0xf4f48ce5e1bc010a lrc: 0/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049609.248520:0:14316:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789049609.248522:0:14316:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789049609.248524:0:14316:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789049609.250811:0:15011:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8d0ab6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:14352:x1875954110660480:12345-0@lo:5:osp-pre-1-0.0 Request processed in 5004us (5106us total) trans 8589934593 rc 0/0 00000100:00100000:3.0:1789049609.250824:0:15011:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1789049609.250897:0:14352:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb8d0ab7100 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14352:1875954110660480:0@lo:5:osp-pre-1-0.0 00000004:00080000:3.0:1789049609.250912:0:14352:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x280000400:0x21:0x0]-[0x280000400:0x41:0x0] 00010000:00010000:3.0:1789049609.307126:0:15620:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1789049609.627407:0:14362:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1789049610.331836:0:14317:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1789049610.345650:0:16087:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg626-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:0.0:1789049611.355213:0:14316:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789049612.188986:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb8d0ab4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3311:1875954110660608:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789049612.189064:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789049612.189220:0:15016:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954110660608 00000100:00100000:3.0:1789049612.189228:0:15016:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954110660608 00000100:00100000:3.0:1789049612.189283:0:15016:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1789049612.189301:0:15016:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb900e96680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1875954110660608:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789049612.189333:0:15016:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789049612.189375:0:15016:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb900e96680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1875954110660608:12345-0@lo:13:osp-pre-0-0.0 Request processed in 76us (311us total) trans 0 rc 0/0 00000100:00100000:3.0:1789049612.189383:0:15016:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00080000:2.0:1789049612.194637:0:14324:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789049612.194704:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb8d0ab4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3311:1875954110660608:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789049612.289921:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.26@tcp (source: 12345-192.168.206.26@tcp) 00000100:00100000:1.0:1789049612.290156:0:14321:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954089696512 00000100:00100000:1.0:1789049612.290166:0:14321:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954089696512 00000100:00100000:1.0:1789049612.290214:0:14321:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.26@tcp, seq: 75 00000100:00100000:1.0:1789049612.290222:0:14321:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb7c47f6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:2354:x1875954089696512:12345-192.168.206.26@tcp:250:mount.lustre.0 00010000:00080000:1.0:1789049612.290250:0:14321:0:(ldlm_lib.c:1453:target_handle_connect()) MGS: connection from fcaa091b-21fd-4d41-8af7-6b63e4c958e5@192.168.206.26@tcp t0 exp 0000000000000000 cur 438 last 0 00000020:00000080:1.0:1789049612.290284:0:14321:0:(genops.c:1384:class_connect()) connect: client fcaa091b-21fd-4d41-8af7-6b63e4c958e5, cookie 0xf4f48ce5e1bc0111 00000100:00080000:1.0:1789049612.290432:0:14321:0:(import.c:65:import_set_state_nolock()) ffff8cb8db34d800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1789049612.290505:0:14321:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb7c47f6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fcaa091b-21fd-4d41-8af7-6b63e4c958e5+5:2354:x1875954089696512:12345-192.168.206.26@tcp:250:mount.lustre.0 Request processed in 281us (593us total) trans 0 rc 0/0 00000100:00100000:1.0:1789049612.290513:0:14321:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.26@tcp, seq: 75 00000100:00100000:0.0:1789049612.296934:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.26@tcp (source: 12345-192.168.206.26@tcp) 00000100:00100000:3.0:1789049612.297044:0:14322:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954089696640 00000100:00100000:3.0:1789049612.297054:0:14322:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954089696640 00000100:00100000:3.0:1789049612.297109:0:14322:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.26@tcp, seq: 76 00000100:00100000:3.0:1789049612.297118:0:14322:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb7c47f4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fcaa091b-21fd-4d41-8af7-6b63e4c958e5+5:13715:x1875954089696640:12345-192.168.206.26@tcp:101:mount.lustre.0 00010000:00010000:3.0:1789049612.297134:0:14322:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789049612.297150:0:14322:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cb8d6714000/0xf4f48ce5e1bc0118 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x7fc5e358805a3726 expref: -99 pid: 14322 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049612.297177:0:14322:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cb8d6714000/0xf4f48ce5e1bc0118 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a3726 expref: 6 pid: 14322 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049612.297188:0:14322:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cb8d6714000/0xf4f48ce5e1bc0118 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a3726 expref: 6 pid: 14322 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049612.297216:0:14322:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cb8d6714000, rc 0) 00000100:00100000:3.0:1789049612.297275:0:14322:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb7c47f4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fcaa091b-21fd-4d41-8af7-6b63e4c958e5+6:13715:x1875954089696640:12345-192.168.206.26@tcp:101:mount.lustre.0 Request processed in 158us (351us total) trans 0 rc 0/0 00000100:00100000:3.0:1789049612.297283:0:14322:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.26@tcp, seq: 76 00000100:00100000:0.0:1789049612.306159:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.26@tcp (source: 12345-192.168.206.26@tcp) 00000100:00100000:2.0:1789049612.306255:0:14323:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954089696768 00000100:00100000:2.0:1789049612.306264:0:14323:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954089696768 00000100:00100000:2.0:1789049612.306323:0:14323:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.26@tcp, seq: 77 00000100:00100000:2.0:1789049612.306346:0:14323:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb7c47f5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fcaa091b-21fd-4d41-8af7-6b63e4c958e5+6:13715:x1875954089696768:12345-192.168.206.26@tcp:501:mount.lustre.0 00000100:00100000:2.0:1789049612.306689:0:14323:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb7c47f5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fcaa091b-21fd-4d41-8af7-6b63e4c958e5+6:13715:x1875954089696768:12345-192.168.206.26@tcp:501:mount.lustre.0 Request processed in 344us (537us total) trans 0 rc -2/-2 00000100:00100000:2.0:1789049612.306698:0:14323:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.26@tcp, seq: 77 00000100:00100000:0.0:1789049612.309058:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.26@tcp (source: 12345-192.168.206.26@tcp) 00000100:00100000:1.0:1789049612.309146:0:14321:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954089696896 00000100:00100000:1.0:1789049612.309156:0:14321:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954089696896 00000100:00100000:1.0:1789049612.309218:0:14321:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.26@tcp, seq: 78 00000100:00100000:1.0:1789049612.309228:0:14321:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb7c47f6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fcaa091b-21fd-4d41-8af7-6b63e4c958e5+6:13715:x1875954089696896:12345-192.168.206.26@tcp:101:mount.lustre.0 00010000:00010000:1.0:1789049612.309243:0:14321:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789049612.309261:0:14321:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cb8c28c2400/0xf4f48ce5e1bc011f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x7fc5e358805a372d expref: -99 pid: 14321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049612.309298:0:14321:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cb8c28c2400/0xf4f48ce5e1bc011f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a372d expref: 7 pid: 14321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049612.309309:0:14321:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cb8c28c2400/0xf4f48ce5e1bc011f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a372d expref: 7 pid: 14321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049612.309318:0:14321:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cb8c28c2400, rc 0) 00000100:00100000:1.0:1789049612.309377:0:14321:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb7c47f6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fcaa091b-21fd-4d41-8af7-6b63e4c958e5+7:13715:x1875954089696896:12345-192.168.206.26@tcp:101:mount.lustre.0 Request processed in 150us (327us total) trans 0 rc 0/0 00000100:00100000:1.0:1789049612.309384:0:14321:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.26@tcp, seq: 78 00000100:00100000:0.0:1789049612.311829:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.26@tcp (source: 12345-192.168.206.26@tcp) 00000100:00100000:3.0:1789049612.312074:0:14322:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954089697024 00000100:00100000:3.0:1789049612.312083:0:14322:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954089697024 00000100:00100000:3.0:1789049612.312167:0:14322:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.26@tcp, seq: 79 00000100:00100000:3.0:1789049612.312176:0:14322:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb7c47f5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fcaa091b-21fd-4d41-8af7-6b63e4c958e5+7:13715:x1875954089697024:12345-192.168.206.26@tcp:501:mount.lustre.0 00000100:00100000:3.0:1789049612.312458:0:14322:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb7c47f5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fcaa091b-21fd-4d41-8af7-6b63e4c958e5+8:13715:x1875954089697024:12345-192.168.206.26@tcp:501:mount.lustre.0 Request processed in 282us (636us total) trans 0 rc 0/0 00000100:00100000:3.0:1789049612.312465:0:14322:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.26@tcp, seq: 79 00000100:00100000:0.0:1789049612.314124:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.26@tcp (source: 12345-192.168.206.26@tcp) 00000100:00100000:2.0:1789049612.314225:0:14323:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954089697152 00000100:00100000:2.0:1789049612.314234:0:14323:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954089697152 00000100:00100000:2.0:1789049612.314329:0:14323:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.26@tcp, seq: 80 00000100:00100000:2.0:1789049612.314339:0:14323:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb7c47f5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fcaa091b-21fd-4d41-8af7-6b63e4c958e5+8:13715:x1875954089697152:12345-192.168.206.26@tcp:503:mount.lustre.0 00000100:00100000:2.0:1789049612.314711:0:14323:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb7c47f5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fcaa091b-21fd-4d41-8af7-6b63e4c958e5+8:13715:x1875954089697152:12345-192.168.206.26@tcp:503:mount.lustre.0 Request processed in 372us (593us total) trans 0 rc 0/0 00000100:00100000:2.0:1789049612.314720:0:14323:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.26@tcp, seq: 80 00000100:00100000:0.0:1789049612.317948:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.26@tcp (source: 12345-192.168.206.26@tcp) 00000100:00100000:3.0:1789049612.318052:0:14322:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954089697280 00000100:00100000:3.0:1789049612.318063:0:14322:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954089697280 00000100:00100000:3.0:1789049612.318199:0:14322:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.26@tcp, seq: 81 00000100:00100000:3.0:1789049612.318212:0:14322:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb7c47f7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fcaa091b-21fd-4d41-8af7-6b63e4c958e5+8:13734:x1875954089697280:12345-192.168.206.26@tcp:502:llog_process_th.0 00000100:00100000:3.0:1789049612.318558:0:14322:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb7c47f7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fcaa091b-21fd-4d41-8af7-6b63e4c958e5+8:13734:x1875954089697280:12345-192.168.206.26@tcp:502:llog_process_th.0 Request processed in 347us (716us total) trans 0 rc 0/0 00000100:00100000:3.0:1789049612.318566:0:14322:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.26@tcp, seq: 81 00000100:00100000:0.0:1789049612.337396:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.26@tcp (source: 12345-192.168.206.26@tcp) 00000100:00100000:2.0:1789049612.337488:0:14323:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954089697408 00000100:00100000:2.0:1789049612.337567:0:14323:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954089697408 00000100:00100000:2.0:1789049612.337622:0:14323:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.26@tcp, seq: 82 00000100:00100000:2.0:1789049612.337631:0:14323:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8f7989450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fcaa091b-21fd-4d41-8af7-6b63e4c958e5+8:13734:x1875954089697408:12345-192.168.206.26@tcp:502:llog_process_th.0 00000100:00100000:2.0:1789049612.338089:0:14323:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8f7989450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fcaa091b-21fd-4d41-8af7-6b63e4c958e5+8:13734:x1875954089697408:12345-192.168.206.26@tcp:502:llog_process_th.0 Request processed in 457us (701us total) trans 0 rc 0/0 00000100:00100000:2.0:1789049612.338097:0:14323:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.26@tcp, seq: 82 00000100:00100000:0.0:1789049612.344365:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.26@tcp (source: 12345-192.168.206.26@tcp) 00000100:00100000:3.0:1789049612.344569:0:14322:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954089697536 00000100:00100000:3.0:1789049612.344578:0:14322:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954089697536 00000100:00100000:3.0:1789049612.344640:0:14322:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.26@tcp, seq: 83 00000100:00100000:3.0:1789049612.344649:0:14322:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8f7988050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fcaa091b-21fd-4d41-8af7-6b63e4c958e5+8:13715:x1875954089697536:12345-192.168.206.26@tcp:101:mount.lustre.0 00010000:00010000:3.0:1789049612.344666:0:14322:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789049612.344681:0:14322:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cb8d6714c00/0xf4f48ce5e1bc0126 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x7fc5e358805a3757 expref: -99 pid: 14322 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049612.344718:0:14322:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cb8d6714c00/0xf4f48ce5e1bc0126 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a3757 expref: 9 pid: 14322 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049612.344729:0:14322:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cb8d6714c00/0xf4f48ce5e1bc0126 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a3757 expref: 9 pid: 14322 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049612.344738:0:14322:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cb8d6714c00, rc 0) 00000100:00100000:3.0:1789049612.344978:0:14322:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8f7988050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fcaa091b-21fd-4d41-8af7-6b63e4c958e5+9:13715:x1875954089697536:12345-192.168.206.26@tcp:101:mount.lustre.0 Request processed in 328us (621us total) trans 0 rc 0/0 00000100:00100000:3.0:1789049612.344985:0:14322:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.26@tcp, seq: 83 00000100:00100000:0.0:1789049612.348246:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.26@tcp (source: 12345-192.168.206.26@tcp) 00000100:00100000:2.0:1789049612.348355:0:14323:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954089697664 00000100:00100000:2.0:1789049612.348370:0:14323:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954089697664 00000100:00100000:2.0:1789049612.348446:0:14323:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.26@tcp, seq: 84 00000100:00100000:2.0:1789049612.348456:0:14323:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8f798a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fcaa091b-21fd-4d41-8af7-6b63e4c958e5+9:13715:x1875954089697664:12345-192.168.206.26@tcp:256:mount.lustre.0 20000000:01000000:2.0:1789049612.348479:0:14323:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:2.0:1789049612.348572:0:14323:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:2.0:1789049612.348577:0:14323:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:2.0:1789049612.348586:0:14323:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:2.0:1789049612.348588:0:14323:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 8 00000100:00100000:2.0:1789049612.351320:0:14323:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8f798a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fcaa091b-21fd-4d41-8af7-6b63e4c958e5+9:13715:x1875954089697664:12345-192.168.206.26@tcp:256:mount.lustre.0 Request processed in 2852us (3069us total) trans 0 rc 0/0 00000100:00100000:2.0:1789049612.351334:0:14323:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.26@tcp, seq: 84 00000100:00100000:0.0:1789049612.354344:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.26@tcp (source: 12345-192.168.206.26@tcp) 00000100:00100000:2.0:1789049612.354417:0:14322:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954089697792 00000100:00100000:2.0:1789049612.354425:0:14322:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954089697792 00000100:00100000:2.0:1789049612.354470:0:14322:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.26@tcp, seq: 85 00000100:00100000:2.0:1789049612.354479:0:14322:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8f7988c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fcaa091b-21fd-4d41-8af7-6b63e4c958e5+9:13715:x1875954089697792:12345-192.168.206.26@tcp:101:mount.lustre.0 00010000:00010000:2.0:1789049612.354496:0:14322:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789049612.354544:0:14322:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cb900e62800/0xf4f48ce5e1bc012d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x7fc5e358805a375e expref: -99 pid: 14322 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049612.354575:0:14322:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cb900e62800/0xf4f48ce5e1bc012d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a375e expref: 10 pid: 14322 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049612.354585:0:14322:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cb900e62800/0xf4f48ce5e1bc012d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a375e expref: 10 pid: 14322 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049612.354593:0:14322:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cb900e62800, rc 0) 00000100:00100000:2.0:1789049612.354658:0:14322:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8f7988c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fcaa091b-21fd-4d41-8af7-6b63e4c958e5+10:13715:x1875954089697792:12345-192.168.206.26@tcp:101:mount.lustre.0 Request processed in 179us (321us total) trans 0 rc 0/0 00000100:00100000:2.0:1789049612.354664:0:14322:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.26@tcp, seq: 85 00000100:00100000:0.0:1789049612.356625:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.26@tcp (source: 12345-192.168.206.26@tcp) 00000100:00100000:2.0:1789049612.356717:0:14323:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954089697920 00000100:00100000:2.0:1789049612.356726:0:14323:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954089697920 00000100:00100000:2.0:1789049612.356776:0:14323:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.26@tcp, seq: 86 00000100:00100000:2.0:1789049612.356786:0:14323:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8f7989050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fcaa091b-21fd-4d41-8af7-6b63e4c958e5+10:13715:x1875954089697920:12345-192.168.206.26@tcp:501:mount.lustre.0 00000100:00100000:2.0:1789049612.357225:0:14323:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8f7989050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fcaa091b-21fd-4d41-8af7-6b63e4c958e5+10:13715:x1875954089697920:12345-192.168.206.26@tcp:501:mount.lustre.0 Request processed in 440us (607us total) trans 0 rc 0/0 00000100:00100000:2.0:1789049612.357240:0:14323:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.26@tcp, seq: 86 00000100:00100000:0.0:1789049612.368371:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.26@tcp (source: 12345-192.168.206.26@tcp) 00000100:00100000:2.0:1789049612.368639:0:14322:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954089698048 00000100:00100000:2.0:1789049612.368649:0:14322:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954089698048 00000100:00100000:2.0:1789049612.368704:0:14322:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.26@tcp, seq: 87 00000100:00100000:2.0:1789049612.368714:0:14322:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8f798ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fcaa091b-21fd-4d41-8af7-6b63e4c958e5+10:13715:x1875954089698048:12345-192.168.206.26@tcp:503:mount.lustre.0 00000100:00100000:2.0:1789049612.369200:0:14322:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8f798ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fcaa091b-21fd-4d41-8af7-6b63e4c958e5+10:13715:x1875954089698048:12345-192.168.206.26@tcp:503:mount.lustre.0 Request processed in 484us (833us total) trans 0 rc 0/0 00000100:00100000:2.0:1789049612.369208:0:14322:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.26@tcp, seq: 87 00000100:00100000:0.0:1789049612.374251:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.26@tcp (source: 12345-192.168.206.26@tcp) 00000100:00100000:2.0:1789049612.374550:0:14323:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954089698176 00000100:00100000:2.0:1789049612.374560:0:14323:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954089698176 00000100:00100000:2.0:1789049612.374665:0:14323:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.26@tcp, seq: 88 00000100:00100000:2.0:1789049612.374676:0:14323:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8f798b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fcaa091b-21fd-4d41-8af7-6b63e4c958e5+10:13738:x1875954089698176:12345-192.168.206.26@tcp:502:llog_process_th.0 00000100:00100000:2.0:1789049612.374975:0:14323:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8f798b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fcaa091b-21fd-4d41-8af7-6b63e4c958e5+10:13738:x1875954089698176:12345-192.168.206.26@tcp:502:llog_process_th.0 Request processed in 300us (734us total) trans 0 rc 0/0 00000100:00100000:2.0:1789049612.374983:0:14323:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.26@tcp, seq: 88 00010000:00010000:3.0:1789049612.380337:0:15620:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789049612.380792:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.26@tcp (source: 12345-192.168.206.26@tcp) 00000100:00100000:2.0:1789049612.380963:0:14322:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954089698304 00000100:00100000:2.0:1789049612.380973:0:14322:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954089698304 00000100:00100000:2.0:1789049612.381025:0:14322:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.26@tcp, seq: 89 00000100:00100000:2.0:1789049612.381035:0:14322:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8f7989850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fcaa091b-21fd-4d41-8af7-6b63e4c958e5+10:13738:x1875954089698304:12345-192.168.206.26@tcp:502:llog_process_th.0 00000100:00100000:2.0:1789049612.381260:0:14322:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8f7989850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fcaa091b-21fd-4d41-8af7-6b63e4c958e5+10:13738:x1875954089698304:12345-192.168.206.26@tcp:502:llog_process_th.0 Request processed in 226us (475us total) trans 0 rc 0/0 00000100:00100000:2.0:1789049612.381268:0:14322:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.26@tcp, seq: 89 00000100:00100000:0.0:1789049612.390781:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.26@tcp (source: 12345-192.168.206.26@tcp) 00000100:00100000:3.0:1789049612.390924:0:14328:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954089698432 00000100:00100000:3.0:1789049612.390933:0:14328:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954089698432 00000100:00100000:3.0:1789049612.390979:0:14328:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.26@tcp, seq: 4 00000100:00100000:3.0:1789049612.390987:0:14328:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8f7b90000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2354:x1875954089698432:12345-192.168.206.26@tcp:38:mount.lustre.0 00010000:00080000:3.0:1789049612.391015:0:14328:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from b76d50d5-035a-43d0-9ba1-e61b094296a4@192.168.206.26@tcp t0 exp 0000000000000000 cur 438 last 0 00000020:00000080:3.0:1789049612.391059:0:14328:0:(genops.c:1384:class_connect()) connect: client b76d50d5-035a-43d0-9ba1-e61b094296a4, cookie 0xf4f48ce5e1bc0134 00000004:00100000:3.0:1789049612.391086:0:14328:0:(mdt_handler.c:7311:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000001:00000004:3.0:1789049612.391092:0:14328:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934592 00000100:00080000:1.0:1789049612.419944:0:14328:0:(import.c:65:import_set_state_nolock()) ffff8cb8db34f000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1789049612.420024:0:14328:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8f7b90000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b76d50d5-035a-43d0-9ba1-e61b094296a4+6:2354:x1875954089698432:12345-192.168.206.26@tcp:38:mount.lustre.0 Request processed in 29035us (29251us total) trans 0 rc 0/0 00000100:00100000:1.0:1789049612.420036:0:14328:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.26@tcp, seq: 4 00000100:00100000:0.0:1789049612.434909:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.26@tcp (source: 12345-192.168.206.26@tcp) 00000100:00100000:1.0:1789049612.435461:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.26@tcp (source: 12345-192.168.206.26@tcp) 00000100:00100000:3.0:1789049612.436749:0:14327:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954089698688 00000100:00100000:3.0:1789049612.436760:0:14327:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954089698688 00000100:00080000:1.0:1789049612.437166:0:14324:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789049612.437175:0:14327:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954089698560 00000100:00100000:2.0:1789049612.437179:0:14327:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954089698560 00000100:00100000:1.0:1789049612.437184:0:14328:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.26@tcp, seq: 5 00000100:00100000:1.0:1789049612.437194:0:14328:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8f7b91f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b76d50d5-035a-43d0-9ba1-e61b094296a4+7:13715:x1875954089698688:12345-192.168.206.26@tcp:41:mount.lustre.0 00000004:00000024:1.0:1789049612.437232:0:14328:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:1.0:1789049612.437332:0:14328:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8f7b91f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b76d50d5-035a-43d0-9ba1-e61b094296a4+7:13715:x1875954089698688:12345-192.168.206.26@tcp:41:mount.lustre.0 Request processed in 139us (2431us total) trans 0 rc 0/0 00000100:00100000:1.0:1789049612.437340:0:14328:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.26@tcp, seq: 5 00000100:00100000:1.0:1789049612.437358:0:14328:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.26@tcp, seq: 6 00000100:00100000:1.0:1789049612.437365:0:14328:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb900e41880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b76d50d5-035a-43d0-9ba1-e61b094296a4+6:0:x1875954089698560:12345-192.168.206.26@tcp:41:mount.lustre.0 00000004:00000024:1.0:1789049612.437376:0:14328:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:1.0:1789049612.437398:0:14328:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb900e41880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b76d50d5-035a-43d0-9ba1-e61b094296a4+6:0:x1875954089698560:12345-192.168.206.26@tcp:41:mount.lustre.0 Request processed in 33us (1939us total) trans 0 rc 0/0 00000100:00100000:1.0:1789049612.437404:0:14328:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.26@tcp, seq: 6 00000100:00100000:0.0:1789049612.439810:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.26@tcp (source: 12345-192.168.206.26@tcp) 00000100:00100000:2.0:1789049612.439921:0:14327:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954089698816 00000100:00100000:2.0:1789049612.439931:0:14327:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954089698816 00000100:00100000:2.0:1789049612.439989:0:14327:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.26@tcp, seq: 7 00000100:00100000:2.0:1789049612.439999:0:14327:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8f7b92d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b76d50d5-035a-43d0-9ba1-e61b094296a4+6:13715:x1875954089698816:12345-192.168.206.26@tcp:40:mount.lustre.0 00000100:00100000:2.0:1789049612.440081:0:14327:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8f7b92d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b76d50d5-035a-43d0-9ba1-e61b094296a4+6:13715:x1875954089698816:12345-192.168.206.26@tcp:40:mount.lustre.0 Request processed in 84us (280us total) trans 0 rc 0/0 00000100:00100000:2.0:1789049612.440088:0:14327:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.26@tcp, seq: 7 00000100:00100000:2.0:1789049612.451483:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.26@tcp (source: 12345-192.168.206.26@tcp) 00000100:00100000:2.0:1789049612.451532:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.26@tcp (source: 12345-192.168.206.26@tcp) 00000100:00100000:2.0:1789049612.451567:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.26@tcp (source: 12345-192.168.206.26@tcp) 00000100:00100000:3.0:1789049612.451674:0:14330:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954089699200 00000100:00100000:3.0:1789049612.451684:0:14330:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954089699200 00000100:00100000:3.0:1789049612.451736:0:14330:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.26@tcp, seq: 0 00000100:00100000:3.0:1789049612.451745:0:14330:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb900e97100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b76d50d5-035a-43d0-9ba1-e61b094296a4+6:13715:x1875954089699200:12345-192.168.206.26@tcp:33:mount.lustre.0 00000004:00080000:3.0:1789049612.452297:0:14330:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 468us 00000100:00100000:1.0:1789049612.455030:0:15011:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954089698944 00000100:00100000:1.0:1789049612.455043:0:15011:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954089698944 00000100:00100000:1.0:1789049612.455085:0:15011:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954089699072 00000100:00100000:1.0:1789049612.455088:0:15011:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954089699072 00000100:00100000:1.0:1789049612.455104:0:15011:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.26@tcp, seq: 8 00000100:00100000:1.0:1789049612.455120:0:15011:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb900e95c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2354:x1875954089698944:12345-192.168.206.26@tcp:8:mount.lustre.0 00010000:00080000:1.0:1789049612.455150:0:15011:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0000: connection from b76d50d5-035a-43d0-9ba1-e61b094296a4@192.168.206.26@tcp t0 exp 0000000000000000 cur 438 last 0 00000020:00000080:1.0:1789049612.455180:0:15011:0:(genops.c:1384:class_connect()) connect: client b76d50d5-035a-43d0-9ba1-e61b094296a4, cookie 0xf4f48ce5e1bc013b 00002000:00100000:1.0:1789049612.455190:0:15011:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli b76d50d5-035a-43d0-9ba1-e61b094296a4/ffff8cb8db349000 ocd_connect_flags: 0xa046faf2e3640038 ocd_version: 2113a28 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1789049612.455199:0:15011:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:1.0:1789049612.455527:0:15011:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:1.0:1789049612.455558:0:15011:0:(import.c:65:import_set_state_nolock()) ffff8cb8db34d000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1789049612.455624:0:15011:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb900e95c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b76d50d5-035a-43d0-9ba1-e61b094296a4+6:2354:x1875954089698944:12345-192.168.206.26@tcp:8:mount.lustre.0 Request processed in 504us (4150us total) trans 0 rc 0/0 00000100:00100000:1.0:1789049612.455632:0:15011:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.26@tcp, seq: 8 00000100:00100000:1.0:1789049612.455784:0:15011:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.26@tcp, seq: 9 00000100:00100000:1.0:1789049612.455790:0:15011:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb900e95180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2354:x1875954089699072:12345-192.168.206.26@tcp:8:mount.lustre.0 00010000:00080000:1.0:1789049612.455806:0:15011:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0001: connection from b76d50d5-035a-43d0-9ba1-e61b094296a4@192.168.206.26@tcp t0 exp 0000000000000000 cur 438 last 0 00000020:00000080:1.0:1789049612.455821:0:15011:0:(genops.c:1384:class_connect()) connect: client b76d50d5-035a-43d0-9ba1-e61b094296a4, cookie 0xf4f48ce5e1bc0142 00002000:00100000:1.0:1789049612.455827:0:15011:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli b76d50d5-035a-43d0-9ba1-e61b094296a4/ffff8cb8db34a800 ocd_connect_flags: 0xa046faf2e3640038 ocd_version: 2113a28 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1789049612.455879:0:15011:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:1.0:1789049612.455992:0:15011:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:1.0:1789049612.456007:0:15011:0:(import.c:65:import_set_state_nolock()) ffff8cb8db34b800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1789049612.456033:0:15011:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb900e95180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b76d50d5-035a-43d0-9ba1-e61b094296a4+6:2354:x1875954089699072:12345-192.168.206.26@tcp:8:mount.lustre.0 Request processed in 241us (4465us total) trans 0 rc 0/0 00000100:00100000:1.0:1789049612.456040:0:15011:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.26@tcp, seq: 9 00000004:00200000:3.0:1789049612.475207:0:14330:0:(mdt_handler.c:922:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000100:00100000:3.0:1789049612.475321:0:14330:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb900e97100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b76d50d5-035a-43d0-9ba1-e61b094296a4+6:13715:x1875954089699200:12345-192.168.206.26@tcp:33:mount.lustre.0 Request processed in 23572us (23783us total) trans 0 rc 0/0 00000100:00100000:3.0:1789049612.475331:0:14330:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.26@tcp, seq: 0 00000100:00100000:2.0:1789049612.706903:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.26@tcp (source: 12345-192.168.206.26@tcp) 00000100:00100000:0.0:1789049612.706988:0:14329:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954089699328 00000100:00100000:0.0:1789049612.706998:0:14329:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954089699328 00000100:00100000:0.0:1789049612.707064:0:14329:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.26@tcp, seq: 8 00000100:00100000:0.0:1789049612.707074:0:14329:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb900e94a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b76d50d5-035a-43d0-9ba1-e61b094296a4+6:13759:x1875954089699328:12345-192.168.206.26@tcp:101:mkdir.0 00010000:00010000:0.0:1789049612.707092:0:14329:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789049612.707165:0:14329:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb7c4c39a00/0xf4f48ce5e1bc0149 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7fc5e358805a3788 expref: -99 pid: 14329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049612.707226:0:14329:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb7c4c39000/0xf4f48ce5e1bc0150 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049612.707238:0:14329:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cb7c4c39000/0xf4f48ce5e1bc0150 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049612.707252:0:14329:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb7c4c39000/0xf4f48ce5e1bc0150 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14329 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789049612.707302:0:14329:0:(mdt_handler.c:922:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:0.0:1789049612.707306:0:14329:0:(mdt_handler.c:1587:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1789049612.707342:0:14329:0:(mdt_handler.c:2522:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8cb7c4c39000/0xf4f48ce5e1bc0150 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049612.707366:0:14329:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb7c4c39a00/0xf4f48ce5e1bc0149 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a3788 expref: 8 pid: 14329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049612.707383:0:14329:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb7c4c39000/0xf4f48ce5e1bc0150 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a3788 expref: 7 pid: 14329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049612.707408:0:14329:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8cb8ce751300) 00010000:00010000:0.0:1789049612.707411:0:14329:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1789049612.707415:0:14329:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cb7c4c39000, rc 0) 00000100:00100000:0.0:1789049612.707563:0:14329:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb900e94a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b76d50d5-035a-43d0-9ba1-e61b094296a4+7:13759:x1875954089699328:12345-192.168.206.26@tcp:101:mkdir.0 Request processed in 490us (669us total) trans 0 rc 0/0 00000100:00100000:0.0:1789049612.707571:0:14329:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.26@tcp, seq: 8 00010000:00010000:3.0:1789049613.402950:0:14317:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789049614.236681:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb8d0ab4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:817823bd-3ba1-432d-9714-f03a15bff403:3308:1875954110660736:0@lo:400:kworker.0 00000100:00100000:0.0:1789049614.236766:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789049614.236792:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb8d0ab5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3309:1875954110660864:0@lo:400:kworker.0 00000100:00100000:0.0:1789049614.236820:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb8d0ab5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3308:1875954110661248:0@lo:400:kworker.0 00000100:00100000:2.0:1789049614.236824:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789049614.236840:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789049614.236857:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb8d0ab4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3309:1875954110661376:0@lo:400:kworker.0 00000100:00100000:0.0:1789049614.236891:0:15014:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954110660864 00000100:00100000:2.0:1789049614.236895:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789049614.236898:0:15014:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954110660864 00000100:00100000:2.0:1789049614.236921:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb8d0ab5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3311:1875954110661120:0@lo:400:kworker.0 00000100:00100000:2.0:1789049614.236941:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789049614.236946:0:15014:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1789049614.236954:0:15014:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb900e94700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3309:x1875954110660864:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789049614.236955:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1789049614.236960:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb8d0ab7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3311:1875954110660992:0@lo:400:kworker.0 00000100:00100000:2.0:1789049614.236977:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789049614.236998:0:15014:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb900e94700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3309:x1875954110660864:12345-0@lo:400:kworker.0 Request processed in 44us (173us total) trans 0 rc 0/0 00000100:00100000:0.0:1789049614.237004:0:15014:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1789049614.237010:0:14323:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954110660736 00000100:00100000:2.0:1789049614.237013:0:14323:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954110660736 00000100:00100000:0.0:1789049614.237017:0:15014:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954110660992 00000100:00100000:0.0:1789049614.237019:0:15014:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954110660992 00000100:00100000:0.0:1789049614.237034:0:15014:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1789049614.237036:0:14323:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:0.0:1789049614.237039:0:15014:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb7c5c36680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3311:x1875954110660992:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789049614.237041:0:14323:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb900dc5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:817823bd-3ba1-432d-9714-f03a15bff403+19:3308:x1875954110660736:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789049614.237070:0:14323:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb900dc5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:817823bd-3ba1-432d-9714-f03a15bff403+19:3308:x1875954110660736:12345-0@lo:400:kworker.0 Request processed in 28us (304us total) trans 0 rc 0/0 00000100:00100000:0.0:1789049614.237070:0:15014:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb7c5c36680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3311:x1875954110660992:12345-0@lo:400:kworker.0 Request processed in 31us (92us total) trans 0 rc 0/0 00000100:00100000:0.0:1789049614.237076:0:15014:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1789049614.237089:0:14323:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00080000:0.0:1789049614.237101:0:14324:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789049614.237105:0:14324:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789049614.237126:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb8d0ab7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3311:1875954110660992:0@lo:400:kworker.0 00000100:00100000:0.0:1789049614.237126:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb8d0ab5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3309:1875954110660864:0@lo:400:kworker.0 00000100:00100000:2.0:1789049614.237144:0:14327:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954110661248 00000100:00100000:2.0:1789049614.237147:0:14327:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954110661248 00000100:00100000:0.0:1789049614.237147:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb8d0ab4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:817823bd-3ba1-432d-9714-f03a15bff403:3308:1875954110660736:0@lo:400:kworker.0 00000100:00100000:0.0:1789049614.237159:0:14329:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954110661376 00000100:00100000:0.0:1789049614.237162:0:14329:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954110661376 00000100:00100000:2.0:1789049614.237169:0:14327:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954110661120 00000100:00100000:2.0:1789049614.237171:0:14327:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954110661120 00000100:00100000:0.0:1789049614.237176:0:14329:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1789049614.237181:0:14329:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8f7b91180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1875954110661248:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789049614.237182:0:14327:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:2.0:1789049614.237188:0:14327:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt00_003' 00000100:00100000:0.0:1789049614.237214:0:14329:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8f7b91180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1875954110661248:12345-0@lo:400:kworker.0 Request processed in 32us (373us total) trans 0 rc 0/0 00000100:00100000:0.0:1789049614.237220:0:14329:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1789049614.237231:0:14329:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1789049614.237236:0:14329:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb900e94e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1875954110661376:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789049614.237261:0:14329:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb900e94e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1875954110661376:12345-0@lo:400:kworker.0 Request processed in 25us (365us total) trans 0 rc 0/0 00000100:00100000:0.0:1789049614.237266:0:14329:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1789049614.237378:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789049614.237387:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb8d0ab7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3311:1875954110661504:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789049614.237412:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789049614.237436:0:15016:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954110661504 00000100:00100000:3.0:1789049614.237440:0:15016:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954110661504 00000100:00100000:3.0:1789049614.237466:0:15016:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1789049614.237472:0:15016:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8d0ab6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3311:x1875954110661504:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789049614.237496:0:15016:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789049614.237527:0:15016:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8d0ab6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3311:x1875954110661504:12345-0@lo:13:osp-pre-1-0.0 Request processed in 55us (115us total) trans 0 rc 0/0 00000100:00100000:3.0:1789049614.237533:0:15016:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1789049614.237833:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb8d0ab7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3311:1875954110661504:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789049614.242435:0:14327:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00080000:0.0:1789049614.242870:0:14324:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789049614.242919:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb8d0ab4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3309:1875954110661376:0@lo:400:kworker.0 00000100:00100000:0.0:1789049614.242960:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb8d0ab5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3308:1875954110661248:0@lo:400:kworker.0 00000100:00100000:2.0:1789049614.248577:0:14327:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb900e97480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1875954110661120:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789049614.249236:0:14327:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb900e97480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1875954110661120:12345-0@lo:400:kworker.0 Request processed in 6786us (12291us total) trans 0 rc 0/0 00000100:00100000:2.0:1789049614.249246:0:14327:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1789049614.249318:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb8d0ab5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3311:1875954110661120:0@lo:400:kworker.0 00000001:00100000:2.0:1789049614.343159:0:7663:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of b76d50d5-035a-43d0-9ba1-e61b094296a4 00000001:00080000:2.0:1789049614.343204:0:7663:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934593 is committed 00010000:00010000:0.0:1789049614.430691:0:14316:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789049614.845539:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.26@tcp (source: 12345-192.168.206.26@tcp) 00000100:00100000:0.0:1789049614.845637:0:14329:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954089699456 00000100:00100000:0.0:1789049614.845647:0:14329:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954089699456 00000100:00100000:0.0:1789049614.845796:0:14329:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.26@tcp, seq: 9 00000100:00100000:0.0:1789049614.845807:0:14329:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8d0ab7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b76d50d5-035a-43d0-9ba1-e61b094296a4+7:13811:x1875954089699456:12345-192.168.206.26@tcp:41:lfs.0 00000004:00000024:0.0:1789049614.845876:0:14329:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:0.0:1789049614.846014:0:14329:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8d0ab7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b76d50d5-035a-43d0-9ba1-e61b094296a4+7:13811:x1875954089699456:12345-192.168.206.26@tcp:41:lfs.0 Request processed in 208us (483us total) trans 0 rc 0/0 00000100:00100000:0.0:1789049614.846022:0:14329:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.26@tcp, seq: 9 00000100:00080000:2.0:1789049614.846186:0:14324:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789049614.856428:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.26@tcp (source: 12345-192.168.206.26@tcp) 00000100:00100000:3.0:1789049614.856510:0:15016:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954089699584 00000100:00100000:3.0:1789049614.856522:0:15016:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954089699584 00000100:00100000:3.0:1789049614.856591:0:15016:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.26@tcp, seq: 5 00000100:00100000:3.0:1789049614.856601:0:15016:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb900e42680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:b76d50d5-035a-43d0-9ba1-e61b094296a4+6:13811:x1875954089699584:12345-192.168.206.26@tcp:13:lfs.0 00002000:00000024:3.0:1789049614.856636:0:15016:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789049614.856716:0:15016:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb900e42680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:b76d50d5-035a-43d0-9ba1-e61b094296a4+6:13811:x1875954089699584:12345-192.168.206.26@tcp:13:lfs.0 Request processed in 115us (297us total) trans 0 rc 0/0 00000100:00100000:3.0:1789049614.856723:0:15016:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.26@tcp, seq: 5 00000100:00080000:2.0:1789049614.856808:0:14324:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789049614.862221:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.26@tcp (source: 12345-192.168.206.26@tcp) 00000100:00100000:0.0:1789049614.862707:0:15015:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954089699712 00000100:00100000:0.0:1789049614.862716:0:15015:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954089699712 00000100:00100000:0.0:1789049614.862836:0:15015:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.26@tcp, seq: 6 00000100:00100000:0.0:1789049614.862874:0:15015:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8d0ab6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:b76d50d5-035a-43d0-9ba1-e61b094296a4+5:13811:x1875954089699712:12345-192.168.206.26@tcp:13:lfs.0 00002000:00000024:0.0:1789049614.862900:0:15015:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789049614.862998:0:15015:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8d0ab6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:b76d50d5-035a-43d0-9ba1-e61b094296a4+5:13811:x1875954089699712:12345-192.168.206.26@tcp:13:lfs.0 Request processed in 152us (785us total) trans 0 rc 0/0 00000100:00100000:0.0:1789049614.863005:0:15015:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.26@tcp, seq: 6 00000100:00080000:2.0:1789049614.865615:0:14324:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789049615.110362:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.26@tcp (source: 12345-192.168.206.26@tcp) 00000100:00100000:1.0:1789049615.110666:0:14321:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954089699840 00000100:00100000:1.0:1789049615.110677:0:14321:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954089699840 00000100:00100000:1.0:1789049615.110749:0:14321:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.26@tcp, seq: 91 00000100:00100000:1.0:1789049615.110759:0:14321:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb900dc4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fcaa091b-21fd-4d41-8af7-6b63e4c958e5+10:13843:x1875954089699840:12345-192.168.206.26@tcp:101:mount.lustre.0 00010000:00010000:1.0:1789049615.110776:0:14321:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789049615.110792:0:14321:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cb8c28c3400/0xf4f48ce5e1bc0157 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x7fc5e358805a378f expref: -99 pid: 14321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049615.110821:0:14321:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cb8c28c3400/0xf4f48ce5e1bc0157 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a378f expref: 11 pid: 14321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049615.110832:0:14321:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cb8c28c3400/0xf4f48ce5e1bc0157 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a378f expref: 11 pid: 14321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049615.110867:0:14321:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cb8c28c3400, rc 0) 00000100:00100000:1.0:1789049615.110924:0:14321:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb900dc4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fcaa091b-21fd-4d41-8af7-6b63e4c958e5+11:13843:x1875954089699840:12345-192.168.206.26@tcp:101:mount.lustre.0 Request processed in 166us (580us total) trans 0 rc 0/0 00000100:00100000:1.0:1789049615.110932:0:14321:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.26@tcp, seq: 91 00000100:00100000:1.0:1789049615.117931:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.26@tcp (source: 12345-192.168.206.26@tcp) 00000100:00100000:2.0:1789049615.118021:0:14322:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954089699968 00000100:00100000:2.0:1789049615.118031:0:14322:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954089699968 00000100:00100000:2.0:1789049615.118091:0:14322:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.26@tcp, seq: 92 00000100:00100000:2.0:1789049615.118101:0:14322:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb900dc7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fcaa091b-21fd-4d41-8af7-6b63e4c958e5+11:13843:x1875954089699968:12345-192.168.206.26@tcp:501:mount.lustre.0 00000100:00100000:2.0:1789049615.118603:0:14322:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb900dc7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fcaa091b-21fd-4d41-8af7-6b63e4c958e5+11:13843:x1875954089699968:12345-192.168.206.26@tcp:501:mount.lustre.0 Request processed in 501us (679us total) trans 0 rc 0/0 00000100:00100000:2.0:1789049615.118612:0:14322:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.26@tcp, seq: 92 00000100:00100000:3.0:1789049615.176464:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.26@tcp (source: 12345-192.168.206.26@tcp) 00000100:00100000:2.0:1789049615.176716:0:14323:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954089700096 00000100:00100000:2.0:1789049615.176726:0:14323:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954089700096 00000100:00100000:2.0:1789049615.176778:0:14323:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.26@tcp, seq: 93 00000100:00100000:2.0:1789049615.176787:0:14323:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb900dc6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fcaa091b-21fd-4d41-8af7-6b63e4c958e5+11:13843:x1875954089700096:12345-192.168.206.26@tcp:503:mount.lustre.0 00000100:00100000:2.0:1789049615.177099:0:14323:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb900dc6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fcaa091b-21fd-4d41-8af7-6b63e4c958e5+11:13843:x1875954089700096:12345-192.168.206.26@tcp:503:mount.lustre.0 Request processed in 313us (643us total) trans 0 rc 0/0 00000100:00100000:2.0:1789049615.177108:0:14323:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.26@tcp, seq: 93 00000100:00100000:0.0:1789049615.186839:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.26@tcp (source: 12345-192.168.206.26@tcp) 00000100:00100000:2.0:1789049615.189198:0:14322:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954089700224 00000100:00100000:2.0:1789049615.189212:0:14322:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954089700224 00000100:00100000:2.0:1789049615.189296:0:14322:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.26@tcp, seq: 94 00000100:00100000:2.0:1789049615.189306:0:14322:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb900dc6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fcaa091b-21fd-4d41-8af7-6b63e4c958e5+11:13850:x1875954089700224:12345-192.168.206.26@tcp:502:llog_process_th.0 00000100:00100000:2.0:1789049615.189640:0:14322:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb900dc6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fcaa091b-21fd-4d41-8af7-6b63e4c958e5+11:13850:x1875954089700224:12345-192.168.206.26@tcp:502:llog_process_th.0 Request processed in 335us (2807us total) trans 0 rc 0/0 00000100:00100000:2.0:1789049615.189648:0:14322:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.26@tcp, seq: 94 00000100:00100000:0.0:1789049615.213205:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.26@tcp (source: 12345-192.168.206.26@tcp) 00000100:00100000:1.0:1789049615.213316:0:14321:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954089700352 00000100:00100000:1.0:1789049615.213326:0:14321:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954089700352 00000100:00100000:1.0:1789049615.213380:0:14321:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.26@tcp, seq: 95 00000100:00100000:1.0:1789049615.213390:0:14321:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb900dc5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fcaa091b-21fd-4d41-8af7-6b63e4c958e5+11:13850:x1875954089700352:12345-192.168.206.26@tcp:502:llog_process_th.0 00000100:00100000:1.0:1789049615.213663:0:14321:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb900dc5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fcaa091b-21fd-4d41-8af7-6b63e4c958e5+11:13850:x1875954089700352:12345-192.168.206.26@tcp:502:llog_process_th.0 Request processed in 273us (466us total) trans 0 rc 0/0 00000100:00100000:1.0:1789049615.213670:0:14321:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.26@tcp, seq: 95 00000100:00100000:3.0:1789049615.228939:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.26@tcp (source: 12345-192.168.206.26@tcp) 00000100:00100000:2.0:1789049615.229035:0:14322:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954089700480 00000100:00100000:2.0:1789049615.229045:0:14322:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954089700480 00000100:00100000:2.0:1789049615.229101:0:14322:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.26@tcp, seq: 96 00000100:00100000:2.0:1789049615.229111:0:14322:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb900dc4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fcaa091b-21fd-4d41-8af7-6b63e4c958e5+11:13843:x1875954089700480:12345-192.168.206.26@tcp:101:mount.lustre.0 00010000:00010000:2.0:1789049615.229127:0:14322:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789049615.229143:0:14322:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cb900e63400/0xf4f48ce5e1bc015e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x7fc5e358805a37b9 expref: -99 pid: 14322 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049615.229169:0:14322:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cb900e63400/0xf4f48ce5e1bc015e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a37b9 expref: 12 pid: 14322 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049615.229181:0:14322:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cb900e63400/0xf4f48ce5e1bc015e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a37b9 expref: 12 pid: 14322 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049615.229206:0:14322:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cb900e63400, rc 0) 00000100:00100000:2.0:1789049615.229277:0:14322:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb900dc4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fcaa091b-21fd-4d41-8af7-6b63e4c958e5+12:13843:x1875954089700480:12345-192.168.206.26@tcp:101:mount.lustre.0 Request processed in 159us (339us total) trans 0 rc 0/0 00000100:00100000:2.0:1789049615.229284:0:14322:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.26@tcp, seq: 96 00000100:00100000:3.0:1789049615.238787:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.26@tcp (source: 12345-192.168.206.26@tcp) 00000100:00100000:2.0:1789049615.242903:0:14323:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954089700608 00000100:00100000:2.0:1789049615.242922:0:14323:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954089700608 00000100:00100000:2.0:1789049615.242996:0:14323:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.26@tcp, seq: 97 00000100:00100000:2.0:1789049615.243006:0:14323:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb900dc6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fcaa091b-21fd-4d41-8af7-6b63e4c958e5+12:13843:x1875954089700608:12345-192.168.206.26@tcp:256:mount.lustre.0 20000000:01000000:2.0:1789049615.243030:0:14323:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:2.0:1789049615.243053:0:14323:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:2.0:1789049615.243057:0:14323:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:2.0:1789049615.243060:0:14323:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:2.0:1789049615.243062:0:14323:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 8 00000100:00100000:2.0:1789049615.247021:0:14323:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb900dc6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fcaa091b-21fd-4d41-8af7-6b63e4c958e5+12:13843:x1875954089700608:12345-192.168.206.26@tcp:256:mount.lustre.0 Request processed in 4006us (8233us total) trans 0 rc 0/0 00000100:00100000:2.0:1789049615.247036:0:14323:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.26@tcp, seq: 97 00000100:00100000:3.0:1789049615.249927:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.26@tcp (source: 12345-192.168.206.26@tcp) 00000100:00100000:1.0:1789049615.251685:0:14321:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954089700736 00000100:00100000:1.0:1789049615.251699:0:14321:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954089700736 00000100:00100000:1.0:1789049615.251764:0:14321:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.26@tcp, seq: 98 00000100:00100000:1.0:1789049615.251787:0:14321:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb900dc4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fcaa091b-21fd-4d41-8af7-6b63e4c958e5+12:13843:x1875954089700736:12345-192.168.206.26@tcp:101:mount.lustre.0 00010000:00010000:1.0:1789049615.251804:0:14321:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789049615.251819:0:14321:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cb8c28c3e00/0xf4f48ce5e1bc0165 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x7fc5e358805a37c0 expref: -99 pid: 14321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049615.251874:0:14321:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cb8c28c3e00/0xf4f48ce5e1bc0165 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a37c0 expref: 13 pid: 14321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049615.251886:0:14321:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cb8c28c3e00/0xf4f48ce5e1bc0165 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a37c0 expref: 13 pid: 14321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049615.251894:0:14321:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cb8c28c3e00, rc 0) 00000100:00100000:1.0:1789049615.251957:0:14321:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb900dc4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fcaa091b-21fd-4d41-8af7-6b63e4c958e5+13:13843:x1875954089700736:12345-192.168.206.26@tcp:101:mount.lustre.0 Request processed in 172us (2039us total) trans 0 rc 0/0 00000100:00100000:1.0:1789049615.251964:0:14321:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.26@tcp, seq: 98 00000100:00100000:3.0:1789049615.255232:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.26@tcp (source: 12345-192.168.206.26@tcp) 00000100:00100000:2.0:1789049615.255386:0:14323:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954089700864 00000100:00100000:2.0:1789049615.255396:0:14323:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954089700864 00000100:00100000:2.0:1789049615.255449:0:14323:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.26@tcp, seq: 99 00000100:00100000:2.0:1789049615.255459:0:14323:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb900dc7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fcaa091b-21fd-4d41-8af7-6b63e4c958e5+13:13843:x1875954089700864:12345-192.168.206.26@tcp:501:mount.lustre.0 00000100:00100000:2.0:1789049615.255731:0:14323:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb900dc7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fcaa091b-21fd-4d41-8af7-6b63e4c958e5+13:13843:x1875954089700864:12345-192.168.206.26@tcp:501:mount.lustre.0 Request processed in 272us (506us total) trans 0 rc 0/0 00000100:00100000:2.0:1789049615.255739:0:14323:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.26@tcp, seq: 99 00000100:00100000:3.0:1789049615.263093:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.26@tcp (source: 12345-192.168.206.26@tcp) 00000100:00100000:0.0:1789049615.263190:0:14322:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954089700992 00000100:00100000:0.0:1789049615.263198:0:14322:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954089700992 00000100:00100000:0.0:1789049615.263257:0:14322:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.26@tcp, seq: 100 00000100:00100000:0.0:1789049615.263267:0:14322:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb900dc5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fcaa091b-21fd-4d41-8af7-6b63e4c958e5+13:13843:x1875954089700992:12345-192.168.206.26@tcp:503:mount.lustre.0 00000100:00100000:0.0:1789049615.263522:0:14322:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb900dc5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fcaa091b-21fd-4d41-8af7-6b63e4c958e5+13:13843:x1875954089700992:12345-192.168.206.26@tcp:503:mount.lustre.0 Request processed in 256us (436us total) trans 0 rc 0/0 00000100:00100000:0.0:1789049615.263531:0:14322:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.26@tcp, seq: 100 00000100:00100000:3.0:1789049615.273036:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.26@tcp (source: 12345-192.168.206.26@tcp) 00000100:00100000:1.0:1789049615.273196:0:14321:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954089701120 00000100:00100000:1.0:1789049615.273206:0:14321:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954089701120 00000100:00100000:1.0:1789049615.273338:0:14321:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.26@tcp, seq: 101 00000100:00100000:1.0:1789049615.273349:0:14321:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb900dc5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fcaa091b-21fd-4d41-8af7-6b63e4c958e5+13:13855:x1875954089701120:12345-192.168.206.26@tcp:502:llog_process_th.0 00000100:00100000:1.0:1789049615.273997:0:14321:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb900dc5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fcaa091b-21fd-4d41-8af7-6b63e4c958e5+13:13855:x1875954089701120:12345-192.168.206.26@tcp:502:llog_process_th.0 Request processed in 647us (967us total) trans 0 rc 0/0 00000100:00100000:1.0:1789049615.274006:0:14321:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.26@tcp, seq: 101 00000100:00100000:3.0:1789049615.292201:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.26@tcp (source: 12345-192.168.206.26@tcp) 00000100:00100000:2.0:1789049615.295376:0:14323:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954089701248 00000100:00100000:2.0:1789049615.295391:0:14323:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954089701248 00000100:00100000:2.0:1789049615.295466:0:14323:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.26@tcp, seq: 102 00000100:00100000:2.0:1789049615.295476:0:14323:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb900dc7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fcaa091b-21fd-4d41-8af7-6b63e4c958e5+13:13855:x1875954089701248:12345-192.168.206.26@tcp:502:llog_process_th.0 00000100:00100000:2.0:1789049615.295719:0:14323:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb900dc7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fcaa091b-21fd-4d41-8af7-6b63e4c958e5+13:13855:x1875954089701248:12345-192.168.206.26@tcp:502:llog_process_th.0 Request processed in 243us (3526us total) trans 0 rc 0/0 00000100:00100000:2.0:1789049615.295727:0:14323:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.26@tcp, seq: 102 00000100:00100000:3.0:1789049615.307375:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.26@tcp (source: 12345-192.168.206.26@tcp) 00000100:00100000:1.0:1789049615.307990:0:14328:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954089701376 00000100:00100000:1.0:1789049615.308000:0:14328:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954089701376 00000100:00100000:1.0:1789049615.308051:0:14328:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.26@tcp, seq: 10 00000100:00100000:1.0:1789049615.308060:0:14328:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8d0ab5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2354:x1875954089701376:12345-192.168.206.26@tcp:38:mount.lustre.0 00010000:00080000:1.0:1789049615.308088:0:14328:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from 45abea75-ce99-406c-bba5-a167dc77aef6@192.168.206.26@tcp t0 exp 0000000000000000 cur 441 last 0 00000020:00000080:1.0:1789049615.308152:0:14328:0:(genops.c:1384:class_connect()) connect: client 45abea75-ce99-406c-bba5-a167dc77aef6, cookie 0xf4f48ce5e1bc016c 00000004:00100000:1.0:1789049615.308181:0:14328:0:(mdt_handler.c:7311:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:1.0:1789049615.308302:0:14328:0:(import.c:65:import_set_state_nolock()) ffff8cb8c6125000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1789049615.308370:0:14328:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8d0ab5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:45abea75-ce99-406c-bba5-a167dc77aef6+6:2354:x1875954089701376:12345-192.168.206.26@tcp:38:mount.lustre.0 Request processed in 309us (1003us total) trans 0 rc 0/0 00000100:00100000:1.0:1789049615.308378:0:14328:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.26@tcp, seq: 10 00000100:00100000:3.0:1789049615.311464:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.26@tcp (source: 12345-192.168.206.26@tcp) 00000100:00100000:3.0:1789049615.311501:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.26@tcp (source: 12345-192.168.206.26@tcp) 00000100:00100000:0.0:1789049615.311592:0:14329:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954089701504 00000100:00100000:0.0:1789049615.311602:0:14329:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954089701504 00000100:00100000:0.0:1789049615.311673:0:14329:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954089701632 00000100:00100000:0.0:1789049615.311676:0:14329:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954089701632 00000100:00100000:0.0:1789049615.311702:0:14329:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.26@tcp, seq: 11 00000100:00100000:0.0:1789049615.311711:0:14329:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8d0ab7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:45abea75-ce99-406c-bba5-a167dc77aef6+7:0:x1875954089701504:12345-192.168.206.26@tcp:41:mount.lustre.0 00000004:00000024:0.0:1789049615.311765:0:14329:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:0.0:1789049615.311824:0:14329:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8d0ab7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:45abea75-ce99-406c-bba5-a167dc77aef6+7:0:x1875954089701504:12345-192.168.206.26@tcp:41:mount.lustre.0 Request processed in 113us (368us total) trans 0 rc 0/0 00000100:00100000:0.0:1789049615.311830:0:14329:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.26@tcp, seq: 11 00000100:00100000:0.0:1789049615.311876:0:14329:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.26@tcp, seq: 12 00000100:00100000:0.0:1789049615.311884:0:14329:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8d0ab6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:45abea75-ce99-406c-bba5-a167dc77aef6+6:13843:x1875954089701632:12345-192.168.206.26@tcp:41:mount.lustre.0 00000004:00000024:0.0:1789049615.311895:0:14329:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:0.0:1789049615.311917:0:14329:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8d0ab6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:45abea75-ce99-406c-bba5-a167dc77aef6+6:13843:x1875954089701632:12345-192.168.206.26@tcp:41:mount.lustre.0 Request processed in 35us (417us total) trans 0 rc 0/0 00000100:00100000:0.0:1789049615.311923:0:14329:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.26@tcp, seq: 12 00000100:00080000:2.0:1789049615.312009:0:14324:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789049615.323366:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.26@tcp (source: 12345-192.168.206.26@tcp) 00000100:00100000:0.0:1789049615.323468:0:14329:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954089701760 00000100:00100000:0.0:1789049615.323477:0:14329:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954089701760 00000100:00100000:0.0:1789049615.323533:0:14329:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.26@tcp, seq: 13 00000100:00100000:0.0:1789049615.323543:0:14329:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8d0ab4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:45abea75-ce99-406c-bba5-a167dc77aef6+6:13843:x1875954089701760:12345-192.168.206.26@tcp:40:mount.lustre.0 00000100:00100000:0.0:1789049615.323632:0:14329:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8d0ab4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:45abea75-ce99-406c-bba5-a167dc77aef6+6:13843:x1875954089701760:12345-192.168.206.26@tcp:40:mount.lustre.0 Request processed in 89us (274us total) trans 0 rc 0/0 00000100:00100000:0.0:1789049615.323639:0:14329:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.26@tcp, seq: 13 00000100:00100000:3.0:1789049615.335372:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.26@tcp (source: 12345-192.168.206.26@tcp) 00000100:00100000:3.0:1789049615.335409:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.26@tcp (source: 12345-192.168.206.26@tcp) 00000100:00100000:3.0:1789049615.335441:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.26@tcp (source: 12345-192.168.206.26@tcp) 00000100:00100000:1.0:1789049615.335535:0:15013:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954089701888 00000100:00100000:1.0:1789049615.335543:0:15013:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954089701888 00000100:00100000:1.0:1789049615.335582:0:15013:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954089702016 00000100:00100000:1.0:1789049615.335585:0:15013:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954089702016 00000100:00100000:1.0:1789049615.335597:0:15013:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.26@tcp, seq: 10 00000100:00100000:1.0:1789049615.335605:0:15013:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8d0ab5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2354:x1875954089701888:12345-192.168.206.26@tcp:8:mount.lustre.0 00010000:00080000:1.0:1789049615.335644:0:15013:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0000: connection from 45abea75-ce99-406c-bba5-a167dc77aef6@192.168.206.26@tcp t0 exp 0000000000000000 cur 441 last 0 00000020:00000080:1.0:1789049615.335677:0:15013:0:(genops.c:1384:class_connect()) connect: client 45abea75-ce99-406c-bba5-a167dc77aef6, cookie 0xf4f48ce5e1bc0173 00002000:00100000:1.0:1789049615.335687:0:15013:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 45abea75-ce99-406c-bba5-a167dc77aef6/ffff8cb8c6123800 ocd_connect_flags: 0xa046faf2e3640038 ocd_version: 2113a28 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1789049615.335696:0:15013:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:1.0:1789049615.335805:0:15013:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:1.0:1789049615.335833:0:15013:0:(import.c:65:import_set_state_nolock()) ffff8cb8c6122800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1789049615.335912:0:15013:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8d0ab5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:45abea75-ce99-406c-bba5-a167dc77aef6+6:2354:x1875954089701888:12345-192.168.206.26@tcp:8:mount.lustre.0 Request processed in 306us (501us total) trans 0 rc 0/0 00000100:00100000:1.0:1789049615.335920:0:15013:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.26@tcp, seq: 10 00000100:00100000:1.0:1789049615.335937:0:15013:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.26@tcp, seq: 11 00000100:00100000:1.0:1789049615.335941:0:15013:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8d0ab4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2354:x1875954089702016:12345-192.168.206.26@tcp:8:mount.lustre.0 00010000:00080000:1.0:1789049615.335955:0:15013:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0001: connection from 45abea75-ce99-406c-bba5-a167dc77aef6@192.168.206.26@tcp t0 exp 0000000000000000 cur 441 last 0 00000020:00000080:1.0:1789049615.335972:0:15013:0:(genops.c:1384:class_connect()) connect: client 45abea75-ce99-406c-bba5-a167dc77aef6, cookie 0xf4f48ce5e1bc017a 00002000:00100000:1.0:1789049615.335989:0:15013:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 45abea75-ce99-406c-bba5-a167dc77aef6/ffff8cb8db833000 ocd_connect_flags: 0xa046faf2e3640038 ocd_version: 2113a28 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1789049615.335996:0:15013:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:1.0:1789049615.336166:0:15013:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:1.0:1789049615.336181:0:15013:0:(import.c:65:import_set_state_nolock()) ffff8cb8db833800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1789049615.336205:0:15013:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8d0ab4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:45abea75-ce99-406c-bba5-a167dc77aef6+6:2354:x1875954089702016:12345-192.168.206.26@tcp:8:mount.lustre.0 Request processed in 262us (763us total) trans 0 rc 0/0 00000100:00100000:1.0:1789049615.336212:0:15013:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.26@tcp, seq: 11 00000100:00100000:2.0:1789049615.336522:0:14331:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954089702144 00000100:00100000:2.0:1789049615.336528:0:14331:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954089702144 00000100:00100000:2.0:1789049615.336566:0:14331:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.26@tcp, seq: 1 00000100:00100000:2.0:1789049615.336574:0:14331:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8d0ab5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:45abea75-ce99-406c-bba5-a167dc77aef6+6:13843:x1875954089702144:12345-192.168.206.26@tcp:33:mount.lustre.0 00000004:00200000:2.0:1789049615.336628:0:14331:0:(mdt_handler.c:922:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000100:00100000:2.0:1789049615.336668:0:14331:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8d0ab5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:45abea75-ce99-406c-bba5-a167dc77aef6+6:13843:x1875954089702144:12345-192.168.206.26@tcp:33:mount.lustre.0 Request processed in 95us (1304us total) trans 0 rc 0/0 00000100:00100000:2.0:1789049615.336675:0:14331:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.26@tcp, seq: 1 00010000:00010000:3.0:1789049615.450990:0:15620:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789049615.542019:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.26@tcp (source: 12345-192.168.206.26@tcp) 00000100:00100000:2.0:1789049615.542476:0:14328:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954089702272 00000100:00100000:2.0:1789049615.542486:0:14328:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954089702272 00000100:00100000:2.0:1789049615.542548:0:14328:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.26@tcp, seq: 14 00000100:00100000:2.0:1789049615.542558:0:14328:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8d0ab4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:45abea75-ce99-406c-bba5-a167dc77aef6+6:13876:x1875954089702272:12345-192.168.206.26@tcp:101:mkdir.0 00010000:00010000:2.0:1789049615.542578:0:14328:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789049615.542600:0:14328:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb900e63000/0xf4f48ce5e1bc0181 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7fc5e358805a37ea expref: -99 pid: 14328 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049615.542675:0:14328:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb900e62a00/0xf4f48ce5e1bc0188 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049615.542688:0:14328:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cb900e62a00/0xf4f48ce5e1bc0188 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049615.542718:0:14328:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb900e62a00/0xf4f48ce5e1bc0188 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14328 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789049615.542753:0:14328:0:(mdt_handler.c:922:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:2.0:1789049615.542757:0:14328:0:(mdt_handler.c:1587:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1789049615.542776:0:14328:0:(mdt_handler.c:2522:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8cb900e62a00/0xf4f48ce5e1bc0188 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14328 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049615.542802:0:14328:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb900e63000/0xf4f48ce5e1bc0181 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a37ea expref: 8 pid: 14328 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049615.542820:0:14328:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb900e62a00/0xf4f48ce5e1bc0188 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a37ea expref: 7 pid: 14328 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049615.542828:0:14328:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8cb8ce751300) 00010000:00010000:2.0:1789049615.542831:0:14328:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789049615.542835:0:14328:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cb900e62a00, rc 0) 00000100:00100000:2.0:1789049615.542937:0:14328:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8d0ab4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:45abea75-ce99-406c-bba5-a167dc77aef6+7:13876:x1875954089702272:12345-192.168.206.26@tcp:101:mkdir.0 Request processed in 380us (925us total) trans 0 rc 0/0 00000100:00100000:2.0:1789049615.542944:0:14328:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.26@tcp, seq: 14 00010000:00010000:3.0:1789049616.475463:0:14317:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1789049616.880605:0:6731:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 45abea75-ce99-406c-bba5-a167dc77aef6 00000001:00100000:1.0:1789049616.880618:0:6731:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of b76d50d5-035a-43d0-9ba1-e61b094296a4 00000100:00100000:2.0:1789049617.311712:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb900e42300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3311:1875954110661632:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789049617.311776:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789049617.311997:0:15015:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954110661632 00000100:00100000:1.0:1789049617.312005:0:15015:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954110661632 00000100:00080000:2.0:1789049617.312077:0:14324:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789049617.318563:0:15015:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1789049617.318581:0:15015:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb7c5c36a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1875954110661632:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789049617.318631:0:15015:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789049617.318707:0:15015:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb7c5c36a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1875954110661632:12345-0@lo:13:osp-pre-0-0.0 Request processed in 133us (6931us total) trans 0 rc 0/0 00000100:00100000:1.0:1789049617.318714:0:15015:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1789049617.319027:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb900e42300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3311:1875954110661632:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1789049617.501859:0:14316:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1789049617.891944:0:5872:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 45abea75-ce99-406c-bba5-a167dc77aef6 00000001:00100000:1.0:1789049617.891958:0:5872:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of b76d50d5-035a-43d0-9ba1-e61b094296a4 00010000:00010000:3.0:1789049618.524134:0:15620:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1789049618.902477:0:16294:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00000100:00100000:0.0:1789049619.355670:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb8f7b92300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1875954110661760:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789049619.356568:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789049619.356636:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789049619.356643:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb7c5c34e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:817823bd-3ba1-432d-9714-f03a15bff403:3308:1875954110661888:0@lo:400:kworker.0 00000100:00100000:0.0:1789049619.356675:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789049619.356708:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb7c5c34000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3308:1875954110662272:0@lo:400:kworker.0 00000100:00100000:2.0:1789049619.356712:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb7c5c36300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1875954110662016:0@lo:400:kworker.0 00000100:00100000:2.0:1789049619.356751:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789049619.356751:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789049619.356774:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789049619.356775:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789049619.356783:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb7c5c36d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3310:1875954110662144:0@lo:400:kworker.0 00000100:00100000:0.0:1789049619.356783:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb8f7ac8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3308:1875954110662400:0@lo:400:kworker.0 00000100:00100000:1.0:1789049619.356800:0:14321:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954110661888 00000100:00100000:0.0:1789049619.356806:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789049619.356815:0:15013:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954110662016 00000100:00100000:2.0:1789049619.356820:0:15013:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954110662016 00000100:00100000:0.0:1789049619.356832:0:14329:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954110662272 00000100:00100000:0.0:1789049619.356835:0:14329:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954110662272 00000100:00100000:0.0:1789049619.356891:0:14329:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954110662400 00000100:00100000:0.0:1789049619.356895:0:14329:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954110662400 00000100:00100000:1.0:1789049619.356898:0:14321:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954110661888 00000100:00100000:0.0:1789049619.356921:0:14329:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1789049619.356932:0:14329:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8f7b91880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1875954110662272:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789049619.356940:0:14321:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:1.0:1789049619.356949:0:14321:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb900dc7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:817823bd-3ba1-432d-9714-f03a15bff403+19:3308:x1875954110661888:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789049619.357005:0:14321:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb900dc7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:817823bd-3ba1-432d-9714-f03a15bff403+19:3308:x1875954110661888:12345-0@lo:400:kworker.0 Request processed in 57us (328us total) trans 0 rc 0/0 00000100:00100000:1.0:1789049619.357014:0:14321:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:2.0:1789049619.357018:0:15013:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1789049619.357030:0:15013:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8f7ac8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3310:x1875954110662016:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789049619.357067:0:16204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1789049619.357074:0:15013:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8f7ac8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3310:x1875954110662016:12345-0@lo:400:kworker.0 Request processed in 46us (322us total) trans 0 rc 0/0 00000100:00100000:2.0:1789049619.357081:0:15013:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00080000:2.0:1789049619.357102:0:14324:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789049619.357107:0:14324:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789049619.357125:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789049619.357152:0:16204:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8f7b93b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1875954110662400:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789049619.357157:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb7c5c36300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1875954110662016:0@lo:400:kworker.0 00000100:00100000:2.0:1789049619.357184:0:14327:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 4 min 3 max 116 00000100:00100000:2.0:1789049619.357192:0:14327:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt00_004' 00000100:00100000:1.0:1789049619.357194:0:16204:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8f7b93b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1875954110662400:12345-0@lo:400:kworker.0 Request processed in 119us (388us total) trans 0 rc 0/0 00000100:00100000:1.0:1789049619.357202:0:16204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1789049619.357218:0:16204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954110662144 00000100:00100000:1.0:1789049619.357221:0:16204:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954110662144 00000100:00100000:1.0:1789049619.357262:0:16204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1789049619.357270:0:16204:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8f7acad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1875954110662144:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789049619.357313:0:16204:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8f7acad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1875954110662144:12345-0@lo:400:kworker.0 Request processed in 44us (186us total) trans 0 rc 0/0 00000100:00100000:1.0:1789049619.357320:0:16204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1789049619.357676:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb7c5c36d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3310:1875954110662144:0@lo:400:kworker.0 00000100:00100000:1.0:1789049619.357714:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb8f7ac8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3308:1875954110662400:0@lo:400:kworker.0 00000100:00100000:1.0:1789049619.357722:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb7c5c34e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:817823bd-3ba1-432d-9714-f03a15bff403:3308:1875954110661888:0@lo:400:kworker.0 00000100:00100000:3.0:1789049619.359750:0:15015:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954110661760 00000100:00100000:3.0:1789049619.359763:0:15015:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954110661760 00000100:00100000:3.0:1789049619.359864:0:15015:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1789049619.359878:0:15015:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8f7b93800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1875954110661760:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789049619.359914:0:15015:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00080000:2.0:1789049619.360037:0:14324:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789049619.360993:0:14329:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8f7b91880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1875954110662272:12345-0@lo:400:kworker.0 Request processed in 4060us (4238us total) trans 0 rc 0/0 00000100:00100000:1.0:1789049619.361004:0:14329:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1789049619.361074:0:15015:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8f7b93800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1875954110661760:12345-0@lo:13:osp-pre-1-0.0 Request processed in 1200us (4516us total) trans 0 rc 0/0 00000100:00100000:3.0:1789049619.361083:0:15015:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1789049619.362246:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb7c5c34000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3308:1875954110662272:0@lo:400:kworker.0 00000100:00100000:0.0:1789049619.362276:0:3308:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589934593 gen 2 00000100:00100000:0.0:1789049619.362299:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb8f7b92300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1875954110661760:0@lo:13:osp-pre-1-0.0 00000001:00100000:2.0:1789049619.420431:0:7663:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 45abea75-ce99-406c-bba5-a167dc77aef6 00010000:00010000:3.0:1789049619.546988:0:14317:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1789049619.868314:0:14362:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1789049620.572012:0:14316:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789049620.823602:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.26@tcp (source: 12345-192.168.206.26@tcp) 00000100:00100000:0.0:1789049620.823638:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.26@tcp (source: 12345-192.168.206.26@tcp) 00000100:00100000:0.0:1789049620.823660:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.26@tcp (source: 12345-192.168.206.26@tcp) 00000100:00100000:0.0:1789049620.823684:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.26@tcp (source: 12345-192.168.206.26@tcp) 00000100:00100000:0.0:1789049620.823702:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.26@tcp (source: 12345-192.168.206.26@tcp) 00000100:00100000:0.0:1789049620.823720:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.26@tcp (source: 12345-192.168.206.26@tcp) 00000100:00100000:0.0:1789049620.823757:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.26@tcp (source: 12345-192.168.206.26@tcp) 00000100:00100000:0.0:1789049620.823783:0:14328:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954089702528 00000100:00100000:0.0:1789049620.823804:0:14328:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954089702528 00000100:00100000:0.0:1789049620.823876:0:14328:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954089702912 00000100:00100000:0.0:1789049620.823880:0:14328:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954089702912 00000100:00100000:0.0:1789049620.823901:0:14328:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.26@tcp, seq: 19 00000100:00100000:0.0:1789049620.823910:0:14328:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8f7b92300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b76d50d5-035a-43d0-9ba1-e61b094296a4+6:2355:x1875954089702528:12345-192.168.206.26@tcp:400:kworker.0 00000100:00100000:0.0:1789049620.824007:0:14328:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8f7b92300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b76d50d5-035a-43d0-9ba1-e61b094296a4+6:2355:x1875954089702528:12345-192.168.206.26@tcp:400:kworker.0 Request processed in 97us (412us total) trans 0 rc 0/0 00000100:00100000:0.0:1789049620.824015:0:14328:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.26@tcp, seq: 19 00000100:00100000:0.0:1789049620.824032:0:14328:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.26@tcp, seq: 20 00000100:00100000:0.0:1789049620.824039:0:14328:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb9009c2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:45abea75-ce99-406c-bba5-a167dc77aef6+6:2355:x1875954089702912:12345-192.168.206.26@tcp:400:kworker.0 00000100:00100000:0.0:1789049620.824064:0:14328:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb9009c2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:45abea75-ce99-406c-bba5-a167dc77aef6+6:2355:x1875954089702912:12345-192.168.206.26@tcp:400:kworker.0 Request processed in 25us (343us total) trans 0 rc 0/0 00000100:00100000:0.0:1789049620.824069:0:14328:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.26@tcp, seq: 20 00000100:00100000:0.0:1789049620.824087:0:15014:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954089702784 00000100:00100000:0.0:1789049620.824091:0:15014:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954089702784 00000100:00100000:0.0:1789049620.824110:0:15014:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954089703040 00000100:00100000:0.0:1789049620.824113:0:15014:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954089703040 00000100:00100000:0.0:1789049620.824125:0:15014:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954089702656 00000100:00100000:0.0:1789049620.824128:0:15014:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954089702656 00000100:00100000:0.0:1789049620.824139:0:15014:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954089703168 00000100:00100000:0.0:1789049620.824141:0:15014:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954089703168 00000100:00100000:0.0:1789049620.824154:0:15014:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.26@tcp, seq: 5 00000100:00100000:0.0:1789049620.824159:0:15014:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8f7b90700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b76d50d5-035a-43d0-9ba1-e61b094296a4+5:2355:x1875954089702784:12345-192.168.206.26@tcp:400:kworker.0 00000100:00100000:0.0:1789049620.824184:0:15014:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8f7b90700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b76d50d5-035a-43d0-9ba1-e61b094296a4+5:2355:x1875954089702784:12345-192.168.206.26@tcp:400:kworker.0 Request processed in 24us (546us total) trans 0 rc 0/0 00000100:00100000:0.0:1789049620.824189:0:15014:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.26@tcp, seq: 5 00000100:00100000:0.0:1789049620.824201:0:15014:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.26@tcp, seq: 6 00000100:00100000:0.0:1789049620.824208:0:15014:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb9009c1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:45abea75-ce99-406c-bba5-a167dc77aef6+5:2355:x1875954089703040:12345-192.168.206.26@tcp:400:kworker.0 00000100:00100000:0.0:1789049620.824227:0:15014:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb9009c1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:45abea75-ce99-406c-bba5-a167dc77aef6+5:2355:x1875954089703040:12345-192.168.206.26@tcp:400:kworker.0 Request processed in 20us (566us total) trans 0 rc 0/0 00000100:00100000:0.0:1789049620.824255:0:15014:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.26@tcp, seq: 6 00000100:00100000:0.0:1789049620.824268:0:15014:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.26@tcp, seq: 7 00000100:00100000:0.0:1789049620.824274:0:15014:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb9009c0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b76d50d5-035a-43d0-9ba1-e61b094296a4+5:2355:x1875954089702656:12345-192.168.206.26@tcp:400:kworker.0 00000100:00100000:0.0:1789049620.824299:0:15014:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb9009c0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b76d50d5-035a-43d0-9ba1-e61b094296a4+5:2355:x1875954089702656:12345-192.168.206.26@tcp:400:kworker.0 Request processed in 26us (595us total) trans 0 rc 0/0 00000100:00100000:0.0:1789049620.824304:0:15014:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.26@tcp, seq: 7 00000100:00100000:0.0:1789049620.824314:0:15014:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.26@tcp, seq: 8 00000100:00100000:0.0:1789049620.824320:0:15014:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb9009c0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:45abea75-ce99-406c-bba5-a167dc77aef6+5:2355:x1875954089703168:12345-192.168.206.26@tcp:400:kworker.0 00000100:00100000:0.0:1789049620.824349:0:15014:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb9009c0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:45abea75-ce99-406c-bba5-a167dc77aef6+5:2355:x1875954089703168:12345-192.168.206.26@tcp:400:kworker.0 Request processed in 28us (591us total) trans 0 rc 0/0 00000100:00100000:0.0:1789049620.824354:0:15014:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.26@tcp, seq: 8 00000100:00100000:0.0:1789049620.824374:0:14322:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954089702400 00000100:00100000:0.0:1789049620.824377:0:14322:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954089702400 00000100:00100000:0.0:1789049620.824400:0:14322:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.26@tcp, seq: 104 00000100:00100000:0.0:1789049620.824406:0:14322:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb900dc6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fcaa091b-21fd-4d41-8af7-6b63e4c958e5+13:2355:x1875954089702400:12345-192.168.206.26@tcp:400:kworker.0 00000100:00100000:0.0:1789049620.824428:0:14322:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb900dc6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fcaa091b-21fd-4d41-8af7-6b63e4c958e5+13:2355:x1875954089702400:12345-192.168.206.26@tcp:400:kworker.0 Request processed in 22us (743us total) trans 0 rc 0/0 00000100:00100000:0.0:1789049620.824433:0:14322:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.26@tcp, seq: 104 00000100:00080000:0.0:1789049620.824461:0:14324:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1789049620.824465:0:14324:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789049620.824467:0:14324:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1789049621.597021:0:15620:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789049622.428669:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1789049622.428691:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb8f7ac9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3311:1875954110662528:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789049622.428755:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789049622.428950:0:15016:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954110662528 00000100:00100000:1.0:1789049622.428958:0:15016:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954110662528 00000100:00100000:1.0:1789049622.429020:0:15016:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1789049622.429031:0:15016:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8f7ac9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1875954110662528:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789049622.429063:0:15016:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789049622.429108:0:15016:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8f7ac9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1875954110662528:12345-0@lo:13:osp-pre-0-0.0 Request processed in 80us (353us total) trans 0 rc 0/0 00000100:00100000:1.0:1789049622.429125:0:15016:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1789049622.429171:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb8f7ac9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3311:1875954110662528:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1789049622.430923:0:14324:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1789049622.619005:0:14317:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1789049622.802397:0:16445:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffda06a3a30 20000000:00000080:2.0:1789049622.802413:0:16445:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff8cb7c5fa5c00 uarg=0000000000000000 20000000:01000000:2.0:1789049622.802444:0:16445:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:2.0:1789049622.802449:0:16445:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:2.0:1789049622.802454:0:16445:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:2.0:1789049622.803617:0:16446:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 5 count 10 20000000:00000400:3.0:1789049622.803824:0:16445:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 10000000:01000000:3.0:1789049622.810540:0:16445:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:3.0:1789049622.810571:0:16445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8cb8d6715000/0xf4f48ce5e1bc018f lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049622.810641:0:16445:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8cb8c28c2c00/0xf4f48ce5e1bbfe86 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf4f48ce5e1bbfe7f expref: 18 pid: 14321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049622.810651:0:16445:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8cb8c6b35000/0xf4f48ce5e1bbfed3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf4f48ce5e1bbfecc expref: 18 pid: 14322 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049622.810658:0:16445:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8cb7c4c39600/0xf4f48ce5e1bc0007 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf4f48ce5e1bc0000 expref: 18 pid: 14322 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049622.810668:0:16445:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8cb900e62800/0xf4f48ce5e1bc012d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a375e expref: 12 pid: 14322 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049622.810675:0:16445:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8cb8c28c3e00/0xf4f48ce5e1bc0165 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a37c0 expref: 12 pid: 14321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049622.810682:0:16445:0:(ldlm_resource.c:1751:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8cb8d6715000/0xf4f48ce5e1bc018f lrc: 8/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 16445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049622.810781:0:16445:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8cb8c28c3e00/0xf4f48ce5e1bc0165 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a37c0 expref: 12 pid: 14321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049622.810797:0:16445:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8cb8c28c3e00/0xf4f48ce5e1bc0165 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a37c0 expref: 12 pid: 14321 timeout: 548 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789049622.810823:0:16445:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb8d0ab7800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16445:1875954110662656:192.168.206.26@tcp:104: 00010000:00010000:3.0:1789049622.811172:0:16445:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8cb900e62800/0xf4f48ce5e1bc012d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a375e expref: 12 pid: 14322 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049622.811181:0:16445:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8cb900e62800/0xf4f48ce5e1bc012d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a375e expref: 12 pid: 14322 timeout: 548 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789049622.811190:0:16445:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb8d0ab5c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16445:1875954110662784:192.168.206.26@tcp:104: 00010000:00010000:3.0:1789049622.811216:0:16445:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8cb7c4c39600/0xf4f48ce5e1bc0007 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf4f48ce5e1bc0000 expref: 18 pid: 14322 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049622.811225:0:16445:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8cb7c4c39600/0xf4f48ce5e1bc0007 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf4f48ce5e1bc0000 expref: 18 pid: 14322 timeout: 548 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789049622.811245:0:16445:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb8d0ab4000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16445:1875954110662912:0@lo:104: 00000100:00100000:3.0:1789049622.811278:0:16445:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1789049622.811317:0:16445:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8cb8c6b35000/0xf4f48ce5e1bbfed3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf4f48ce5e1bbfecc expref: 18 pid: 14322 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049622.811332:0:16445:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8cb8c6b35000/0xf4f48ce5e1bbfed3 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf4f48ce5e1bbfecc expref: 18 pid: 14322 timeout: 548 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789049622.811340:0:16445:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb8df4d1c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16445:1875954110663040:0@lo:104: 00000100:00100000:3.0:1789049622.811357:0:16445:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1789049622.811376:0:16445:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8cb8c28c2c00/0xf4f48ce5e1bbfe86 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf4f48ce5e1bbfe7f expref: 18 pid: 14321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049622.811384:0:16445:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8cb8c28c2c00/0xf4f48ce5e1bbfe86 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf4f48ce5e1bbfe7f expref: 18 pid: 14321 timeout: 548 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789049622.811398:0:16445:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb8df4d1f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16445:1875954110663168:0@lo:104: 00000100:00100000:3.0:1789049622.811419:0:16445:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789049622.811427:0:16445:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cb8d742a780 going to sleep for 11 seconds 00000100:00100000:2.0:1789049622.811534:0:14312:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:2.0:1789049622.811546:0:14312:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954110662912 00000100:00100000:2.0:1789049622.811553:0:14312:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954110662912 00000100:00100000:2.0:1789049622.811647:0:14312:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954110663040 00000100:00100000:2.0:1789049622.811652:0:14312:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954110663040 00000100:00100000:2.0:1789049622.811664:0:14312:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954110663168 00000100:00100000:2.0:1789049622.811667:0:14312:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954110663168 00000100:00100000:2.0:1789049622.811678:0:14312:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1789049622.811685:0:14312:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8d0ab7100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:817823bd-3ba1-432d-9714-f03a15bff403+5:16445:x1875954110662912:12345-0@lo:104: 00010000:00010000:2.0:1789049622.811771:0:14312:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.126@tcp lock: ffff8cb8d6714800/0xf4f48ce5e1bc0000 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xf4f48ce5e1bc0007 expref: -99 pid: 15730 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049622.811836:0:14312:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1789049622.811862:0:14312:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8d0ab7100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:817823bd-3ba1-432d-9714-f03a15bff403+5:16445:x1875954110662912:12345-0@lo:104: Request processed in 157us (563us total) trans 0 rc 0/0 00000100:00100000:2.0:1789049622.811869:0:14312:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1789049622.811883:0:14312:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1789049622.811888:0:14312:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8df4d0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:817823bd-3ba1-432d-9714-f03a15bff403+4:16445:x1875954110663040:12345-0@lo:104: 00010000:00010000:2.0:1789049622.811895:0:14312:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.126@tcp lock: ffff8cb900e63800/0xf4f48ce5e1bbfecc lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xf4f48ce5e1bbfed3 expref: -99 pid: 15010 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049622.811926:0:14312:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1789049622.811931:0:14312:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8df4d0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:817823bd-3ba1-432d-9714-f03a15bff403+4:16445:x1875954110663040:12345-0@lo:104: Request processed in 43us (573us total) trans 0 rc 0/0 00000100:00100000:2.0:1789049622.811936:0:14312:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1789049622.811947:0:14312:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1789049622.811952:0:14312:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb7c45be450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:817823bd-3ba1-432d-9714-f03a15bff403+3:16445:x1875954110663168:12345-0@lo:104: 00010000:00010000:2.0:1789049622.811959:0:14312:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.126@tcp lock: ffff8cb900e63a00/0xf4f48ce5e1bbfe7f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xf4f48ce5e1bbfe86 expref: -99 pid: 14325 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789049622.812162:0:16445:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb8d0ab4000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16445:1875954110662912:0@lo:104: 00000100:00100000:3.0:1789049622.812169:0:16445:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb8df4d1c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16445:1875954110663040:0@lo:104: 00000100:00100000:3.0:1789049622.812176:0:16445:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb8df4d1f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16445:1875954110663168:0@lo:104: 00010000:00010000:3.0:1789049622.815127:0:14316:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1789049622.815138:0:14316:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.126@tcp lock: ffff8cb8d6714800/0xf4f48ce5e1bc0000 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xf4f48ce5e1bc0007 expref: -99 pid: 15730 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049622.815149:0:14316:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cb8d6714800 already unused, calling callback (ffffffffc1ca3c20) 10000000:00010000:3.0:1789049622.815154:0:14316:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.126@tcp lock: ffff8cb8d6714800/0xf4f48ce5e1bc0000 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xf4f48ce5e1bc0007 expref: -99 pid: 15730 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049622.815164:0:14316:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.126@tcp lock: ffff8cb8d6714800/0xf4f48ce5e1bc0000 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xf4f48ce5e1bc0007 expref: -99 pid: 15730 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789049622.815170:0:14316:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.126@tcp lock: ffff8cb8d6714800/0xf4f48ce5e1bc0000 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xf4f48ce5e1bc0007 expref: -99 pid: 15730 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789049622.815176:0:14316:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1789049622.815238:0:14316:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.126@tcp lock: ffff8cb8d6714800/0xf4f48ce5e1bc0000 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf4f48ce5e1bc0007 expref: -99 pid: 15730 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049622.815245:0:14316:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789049622.815266:0:14316:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.126@tcp lock: ffff8cb8d6714800/0xf4f48ce5e1bc0000 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf4f48ce5e1bc0007 expref: -99 pid: 15730 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049622.815286:0:14316:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.126@tcp lock: ffff8cb8d6714800/0xf4f48ce5e1bc0000 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf4f48ce5e1bc0007 expref: -99 pid: 15730 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049622.815299:0:14316:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789049622.815302:0:14316:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.126@tcp lock: ffff8cb900e63800/0xf4f48ce5e1bbfecc lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xf4f48ce5e1bbfed3 expref: -99 pid: 15010 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049622.815308:0:14316:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cb900e63800 already unused, calling callback (ffffffffc1ca3c20) 10000000:00010000:3.0:1789049622.815311:0:14316:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.126@tcp lock: ffff8cb900e63800/0xf4f48ce5e1bbfecc lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xf4f48ce5e1bbfed3 expref: -99 pid: 15010 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049622.815317:0:14316:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.126@tcp lock: ffff8cb900e63800/0xf4f48ce5e1bbfecc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xf4f48ce5e1bbfed3 expref: -99 pid: 15010 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789049622.815439:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb8df4d0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:817823bd-3ba1-432d-9714-f03a15bff403:3311:1875954110663296:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789049622.815497:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789049622.815557:0:14313:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954110663296 00000100:00100000:1.0:1789049622.815564:0:14313:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954110663296 00010000:00010000:1.0:1789049622.815603:0:14313:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8cb7c4c39600/0xf4f48ce5e1bc0007 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf4f48ce5e1bc0000 expref: 19 pid: 14322 timeout: 548 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789049622.815633:0:14313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1789049622.815642:0:14313:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb900e40a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:817823bd-3ba1-432d-9714-f03a15bff403+19:3311:x1875954110663296:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789049622.815654:0:14313:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789049622.815658:0:14313:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8cb7c4c39600/0xf4f48ce5e1bc0007 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf4f48ce5e1bc0000 expref: 19 pid: 14322 timeout: 548 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049622.815668:0:14313:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8cb7c4c39600/0xf4f48ce5e1bc0007 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf4f48ce5e1bc0000 expref: 19 pid: 14322 timeout: 548 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049622.815681:0:14313:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cb7c4c39600/0xf4f48ce5e1bc0007 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf4f48ce5e1bc0000 expref: 19 pid: 14322 timeout: 548 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049622.815694:0:14313:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789049622.815733:0:14313:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb900e40a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:817823bd-3ba1-432d-9714-f03a15bff403+18:3311:x1875954110663296:12345-0@lo:103:ldlm_bl.0 Request processed in 92us (235us total) trans 0 rc 0/0 00000100:00100000:1.0:1789049622.815740:0:14313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1789049622.815778:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb8df4d0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:817823bd-3ba1-432d-9714-f03a15bff403:3311:1875954110663296:0@lo:103:ldlm_bl.0 10000000:00010000:3.0:1789049622.815828:0:14316:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.126@tcp lock: ffff8cb900e63800/0xf4f48ce5e1bbfecc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xf4f48ce5e1bbfed3 expref: -99 pid: 15010 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789049622.815834:0:14316:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1789049622.816227:0:14312:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1789049622.816244:0:14312:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb7c45be450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:817823bd-3ba1-432d-9714-f03a15bff403+3:16445:x1875954110663168:12345-0@lo:104: Request processed in 4290us (4823us total) trans 0 rc 0/0 00000100:00100000:2.0:1789049622.816252:0:14312:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00010000:2.0:1789049622.816307:0:15620:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789049622.816312:0:15620:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.126@tcp lock: ffff8cb900e63a00/0xf4f48ce5e1bbfe7f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xf4f48ce5e1bbfe86 expref: -99 pid: 14325 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049622.816329:0:15620:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cb900e63a00 already unused, calling callback (ffffffffc1ca3c20) 10000000:00010000:2.0:1789049622.816333:0:15620:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.126@tcp lock: ffff8cb900e63a00/0xf4f48ce5e1bbfe7f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xf4f48ce5e1bbfe86 expref: -99 pid: 14325 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049622.816340:0:15620:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.126@tcp lock: ffff8cb900e63a00/0xf4f48ce5e1bbfe7f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xf4f48ce5e1bbfe86 expref: -99 pid: 14325 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789049622.816346:0:15620:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.126@tcp lock: ffff8cb900e63a00/0xf4f48ce5e1bbfe7f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xf4f48ce5e1bbfe86 expref: -99 pid: 14325 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789049622.816351:0:15620:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1789049622.816375:0:15620:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.126@tcp lock: ffff8cb900e63a00/0xf4f48ce5e1bbfe7f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf4f48ce5e1bbfe86 expref: -99 pid: 14325 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049622.816382:0:15620:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789049622.816399:0:15620:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.126@tcp lock: ffff8cb900e63a00/0xf4f48ce5e1bbfe7f lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf4f48ce5e1bbfe86 expref: -99 pid: 14325 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049622.816406:0:15620:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.126@tcp lock: ffff8cb900e63a00/0xf4f48ce5e1bbfe7f lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf4f48ce5e1bbfe86 expref: -99 pid: 14325 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049622.816427:0:15620:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789049622.816428:0:15620:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789049622.816430:0:15620:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789049622.816466:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb8f7ac9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:817823bd-3ba1-432d-9714-f03a15bff403:3308:1875954110663424:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789049622.816499:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789049622.816544:0:14314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954110663424 00000100:00100000:2.0:1789049622.816550:0:14314:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954110663424 00010000:00010000:2.0:1789049622.816566:0:14314:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8cb8c28c2c00/0xf4f48ce5e1bbfe86 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf4f48ce5e1bbfe7f expref: 18 pid: 14321 timeout: 548 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789049622.816595:0:14314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1789049622.816602:0:14314:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8f7acb100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:817823bd-3ba1-432d-9714-f03a15bff403+18:3308:x1875954110663424:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789049622.816609:0:14314:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789049622.816613:0:14314:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8cb8c28c2c00/0xf4f48ce5e1bbfe86 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf4f48ce5e1bbfe7f expref: 18 pid: 14321 timeout: 548 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049622.816620:0:14314:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8cb8c28c2c00/0xf4f48ce5e1bbfe86 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf4f48ce5e1bbfe7f expref: 18 pid: 14321 timeout: 548 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049622.816632:0:14314:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cb8c28c2c00/0xf4f48ce5e1bbfe86 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf4f48ce5e1bbfe7f expref: 18 pid: 14321 timeout: 548 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049622.816640:0:14314:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789049622.816666:0:14314:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8f7acb100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:817823bd-3ba1-432d-9714-f03a15bff403+17:3308:x1875954110663424:12345-0@lo:103:ldlm_bl.0 Request processed in 65us (168us total) trans 0 rc 0/0 00000100:00100000:2.0:1789049622.816672:0:14314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1789049622.816696:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb8f7ac9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:817823bd-3ba1-432d-9714-f03a15bff403:3308:1875954110663424:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789049622.816811:0:14317:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789049622.817304:0:14316:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.126@tcp lock: ffff8cb900e63800/0xf4f48ce5e1bbfecc lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf4f48ce5e1bbfed3 expref: -99 pid: 15010 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049622.817312:0:14316:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:2.0:1789049622.817417:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb9009c0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:817823bd-3ba1-432d-9714-f03a15bff403:3309:1875954110663552:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789049622.817450:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1789049622.817533:0:14316:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.126@tcp lock: ffff8cb900e63800/0xf4f48ce5e1bbfecc lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf4f48ce5e1bbfed3 expref: -99 pid: 15010 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049622.817541:0:14316:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.126@tcp lock: ffff8cb900e63800/0xf4f48ce5e1bbfecc lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf4f48ce5e1bbfed3 expref: -99 pid: 15010 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049622.817555:0:14316:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789049622.817557:0:14316:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789049622.817559:0:14316:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789049622.817668:0:14315:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954110663552 00000100:00100000:1.0:1789049622.817674:0:14315:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954110663552 00010000:00010000:1.0:1789049622.817695:0:14315:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8cb8c6b35000/0xf4f48ce5e1bbfed3 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf4f48ce5e1bbfecc expref: 17 pid: 14322 timeout: 548 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789049622.817725:0:14315:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1789049622.817733:0:14315:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8fcf48850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:817823bd-3ba1-432d-9714-f03a15bff403+17:3309:x1875954110663552:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789049622.817741:0:14315:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789049622.817745:0:14315:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8cb8c6b35000/0xf4f48ce5e1bbfed3 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf4f48ce5e1bbfecc expref: 17 pid: 14322 timeout: 548 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049622.817754:0:14315:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8cb8c6b35000/0xf4f48ce5e1bbfed3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf4f48ce5e1bbfecc expref: 17 pid: 14322 timeout: 548 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049622.817765:0:14315:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cb8c6b35000/0xf4f48ce5e1bbfed3 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf4f48ce5e1bbfecc expref: 17 pid: 14322 timeout: 548 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049622.817774:0:14315:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789049622.818375:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.26@tcp (source: 12345-192.168.206.26@tcp) 00000100:00100000:3.0:1789049622.818623:0:16445:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb8d0ab5c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16445:1875954110662784:192.168.206.26@tcp:104: 00000100:00100000:1.0:1789049622.818874:0:14315:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8fcf48850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:817823bd-3ba1-432d-9714-f03a15bff403+16:3309:x1875954110663552:12345-0@lo:103:ldlm_bl.0 Request processed in 1141us (1423us total) trans 0 rc 0/0 00000100:00100000:1.0:1789049622.818884:0:14315:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1789049622.818929:0:14315:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954089703296 00000100:00100000:1.0:1789049622.818935:0:14315:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954089703296 00010000:00010000:1.0:1789049622.818952:0:14315:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8cb900e62800/0xf4f48ce5e1bc012d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a375e expref: 13 pid: 14322 timeout: 548 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789049622.818974:0:14315:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.26@tcp, seq: 7 00000100:00100000:1.0:1789049622.818981:0:14315:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb9009c0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:fcaa091b-21fd-4d41-8af7-6b63e4c958e5+13:2358:x1875954089703296:12345-192.168.206.26@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1789049622.819212:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.26@tcp (source: 12345-192.168.206.26@tcp) 00000100:00100000:3.0:1789049622.819249:0:16445:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb8d0ab7800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16445:1875954110662656:192.168.206.26@tcp:104: 00010000:00010000:3.0:1789049622.819279:0:16445:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8cb8d6715000/0xf4f48ce5e1bc018f lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 16445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789049622.819539:0:14314:0:(service.c:3467:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:0.0:1789049622.819559:0:14314:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cn00_003' 00000100:00100000:3.0:1789049622.820189:0:14314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954089703424 00000100:00100000:3.0:1789049622.820196:0:14314:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954089703424 00010000:00010000:3.0:1789049622.820222:0:14314:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8cb8c28c3e00/0xf4f48ce5e1bc0165 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a37c0 expref: 14 pid: 14321 timeout: 548 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789049622.820266:0:14314:0:(service.c:3467:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:3.0:1789049622.820275:0:14314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.26@tcp, seq: 8 00000100:00100000:3.0:1789049622.820282:0:14314:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8df4d0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:fcaa091b-21fd-4d41-8af7-6b63e4c958e5+14:2357:x1875954089703424:12345-192.168.206.26@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789049622.820291:0:14314:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789049622.820295:0:14314:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8cb8c28c3e00/0xf4f48ce5e1bc0165 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a37c0 expref: 14 pid: 14321 timeout: 548 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049622.820305:0:14314:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8cb8c28c3e00/0xf4f48ce5e1bc0165 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a37c0 expref: 14 pid: 14321 timeout: 548 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049622.820332:0:14314:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cb8c28c3e00/0xf4f48ce5e1bc0165 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a37c0 expref: 14 pid: 14321 timeout: 548 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049622.820346:0:14314:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789049622.820394:0:14314:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8df4d0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:fcaa091b-21fd-4d41-8af7-6b63e4c958e5+13:2357:x1875954089703424:12345-192.168.206.26@tcp:103:ldlm_bl.0 Request processed in 112us (1182us total) trans 0 rc 0/0 00000100:00100000:3.0:1789049622.820401:0:14314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.26@tcp, seq: 8 00010000:00010000:1.0:1789049622.820922:0:14315:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789049622.820938:0:14315:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8cb900e62800/0xf4f48ce5e1bc012d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a375e expref: 12 pid: 14322 timeout: 548 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049622.820948:0:14315:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8cb900e62800/0xf4f48ce5e1bc012d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a375e expref: 12 pid: 14322 timeout: 548 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049622.820959:0:14315:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cb900e62800/0xf4f48ce5e1bc012d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a375e expref: 12 pid: 14322 timeout: 548 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049622.820969:0:14315:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8cb8d6715000/0xf4f48ce5e1bc018f lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 16445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049622.820977:0:14315:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cb8d6715000/0xf4f48ce5e1bc018f lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 16445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049622.821260:0:14315:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8cb8d6715000/0xf4f48ce5e1bc018f lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 16445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049622.821270:0:14315:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8cb8d6715000/0xf4f48ce5e1bc018f lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 16445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049622.821277:0:14315:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8cb8d6715000/0xf4f48ce5e1bc018f lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 16445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049622.821284:0:14315:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8cb8d6715000/0xf4f48ce5e1bc018f lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 16445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049622.821290:0:14315:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cb8d6715000 already unused, calling callback (ffffffffc166a8f0) 00010000:00010000:1.0:1789049622.821294:0:14315:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8cb8d6715000/0xf4f48ce5e1bc018f lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 16445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049622.821302:0:14315:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8cb8d6715000/0xf4f48ce5e1bc018f lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 16445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789049622.821499:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb9009c0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:817823bd-3ba1-432d-9714-f03a15bff403:3309:1875954110663552:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789049622.824098:0:16445:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8cb8d6715000/0xf4f48ce5e1bc018f lrc: 5/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049622.824115:0:16445:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8cb8d6715000/0xf4f48ce5e1bc018f lrc: 5/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049622.824674:0:14315:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8cb8d6715000/0xf4f48ce5e1bc018f lrc: 3/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049622.824687:0:14315:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cb8d6715000/0xf4f48ce5e1bc018f lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049622.824707:0:14315:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789049622.824815:0:14315:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb9009c0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:fcaa091b-21fd-4d41-8af7-6b63e4c958e5+11:2358:x1875954089703296:12345-192.168.206.26@tcp:103:ldlm_bl.0 Request processed in 5829us (6439us total) trans 0 rc 0/0 00000100:00100000:1.0:1789049622.824824:0:14315:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.26@tcp, seq: 7 00010000:00010000:2.0:1789049623.643269:0:15620:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789049624.474957:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1789049624.474978:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb9009c1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3311:1875954110663680:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789049624.475050:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789049624.475094:0:15016:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954110663680 00000100:00100000:3.0:1789049624.475102:0:15016:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954110663680 00000100:00100000:3.0:1789049624.475163:0:15016:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1789049624.475172:0:15016:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb9009c1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1875954110663680:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789049624.475214:0:15016:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789049624.475274:0:15016:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb9009c1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1875954110663680:12345-0@lo:13:osp-pre-1-0.0 Request processed in 99us (220us total) trans 0 rc 0/0 00000100:00100000:3.0:1789049624.475281:0:15016:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1789049624.475336:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb9009c1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3311:1875954110663680:0@lo:13:osp-pre-1-0.0 00000100:00080000:0.0:1789049624.477130:0:14324:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789049624.478200:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb9009c1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3310:1875954110664192:0@lo:400:kworker.0 00000100:00100000:0.0:1789049624.478270:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789049624.478313:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1789049624.478319:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb9009c3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:817823bd-3ba1-432d-9714-f03a15bff403:3310:1875954110663808:0@lo:400:kworker.0 00000100:00100000:0.0:1789049624.478346:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789049624.478370:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb9009c1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3310:1875954110664320:0@lo:400:kworker.0 00000100:00100000:0.0:1789049624.478389:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789049624.478412:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb9009c0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1875954110663936:0@lo:400:kworker.0 00000100:00100000:0.0:1789049624.478436:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789049624.478452:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789049624.478458:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb9009c2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3308:1875954110664064:0@lo:400:kworker.0 00000100:00100000:0.0:1789049624.478476:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789049624.478517:0:14323:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954110663808 00000100:00100000:0.0:1789049624.478525:0:14323:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954110663808 00000100:00100000:0.0:1789049624.478564:0:14323:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:0.0:1789049624.478572:0:14323:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb900dc4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:817823bd-3ba1-432d-9714-f03a15bff403+16:3310:x1875954110663808:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789049624.478616:0:14323:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb900dc4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:817823bd-3ba1-432d-9714-f03a15bff403+16:3310:x1875954110663808:12345-0@lo:400:kworker.0 Request processed in 45us (269us total) trans 0 rc 0/0 00000100:00100000:0.0:1789049624.478623:0:14323:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:0.0:1789049624.478653:0:14328:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954110664192 00000100:00100000:0.0:1789049624.478657:0:14328:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954110664192 00000100:00100000:0.0:1789049624.478684:0:14328:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954110664320 00000100:00100000:0.0:1789049624.478687:0:14328:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954110664320 00000100:00100000:0.0:1789049624.478706:0:14328:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954110664064 00000100:00100000:0.0:1789049624.478709:0:14328:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954110664064 00000100:00100000:0.0:1789049624.478722:0:14328:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1789049624.478728:0:14328:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb9009c3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1875954110664192:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789049624.478758:0:14328:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb9009c3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1875954110664192:12345-0@lo:400:kworker.0 Request processed in 31us (489us total) trans 0 rc 0/0 00000100:00100000:0.0:1789049624.478765:0:14328:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1789049624.478777:0:14328:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1789049624.478782:0:14328:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb9009c3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1875954110664320:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789049624.478807:0:14328:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb9009c3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1875954110664320:12345-0@lo:400:kworker.0 Request processed in 25us (416us total) trans 0 rc 0/0 00000100:00100000:0.0:1789049624.478812:0:14328:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1789049624.478823:0:14328:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1789049624.478829:0:14328:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb9009c2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1875954110664064:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789049624.478882:0:14328:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb9009c2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1875954110664064:12345-0@lo:400:kworker.0 Request processed in 53us (405us total) trans 0 rc 0/0 00000100:00100000:0.0:1789049624.478897:0:14328:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1789049624.480092:0:15014:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954110663936 00000100:00100000:0.0:1789049624.480100:0:15014:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954110663936 00000100:00100000:0.0:1789049624.480144:0:15014:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1789049624.480150:0:15014:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb9009c3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3308:x1875954110663936:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789049624.480203:0:15014:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb9009c3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3308:x1875954110663936:12345-0@lo:400:kworker.0 Request processed in 52us (1765us total) trans 0 rc 0/0 00000100:00100000:0.0:1789049624.480209:0:15014:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00080000:0.0:1789049624.480253:0:14324:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1789049624.480257:0:14324:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789049624.480287:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb9009c2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3308:1875954110664064:0@lo:400:kworker.0 00000100:00100000:0.0:1789049624.480449:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb9009c0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1875954110663936:0@lo:400:kworker.0 00000100:00100000:0.0:1789049624.480486:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb9009c3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:817823bd-3ba1-432d-9714-f03a15bff403:3310:1875954110663808:0@lo:400:kworker.0 00000100:00100000:0.0:1789049624.480496:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb9009c1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3310:1875954110664320:0@lo:400:kworker.0 00000100:00100000:0.0:1789049624.480506:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb9009c1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3310:1875954110664192:0@lo:400:kworker.0 00000100:00100000:3.0:1789049624.581382:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.26@tcp (source: 12345-192.168.206.26@tcp) 00000100:00100000:0.0:1789049624.583601:0:14321:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954089703552 00000100:00100000:0.0:1789049624.583615:0:14321:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954089703552 00000100:00100000:0.0:1789049624.583673:0:14321:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.26@tcp, seq: 106 00000100:00100000:0.0:1789049624.583682:0:14321:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8d6a27850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fcaa091b-21fd-4d41-8af7-6b63e4c958e5+11:13729:x1875954089703552:12345-192.168.206.26@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789049624.583697:0:14321:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789049624.583716:0:14321:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cb7c4c38e00/0xf4f48ce5e1bc0196 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x7fc5e358805a37f1 expref: -99 pid: 14321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049624.583740:0:14321:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cb7c4c38e00/0xf4f48ce5e1bc0196 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a37f1 expref: 12 pid: 14321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049624.583765:0:14321:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cb7c4c38e00/0xf4f48ce5e1bc0196 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a37f1 expref: 12 pid: 14321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049624.583773:0:14321:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cb7c4c38e00, rc 0) 00000100:00100000:0.0:1789049624.583832:0:14321:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8d6a27850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fcaa091b-21fd-4d41-8af7-6b63e4c958e5+12:13729:x1875954089703552:12345-192.168.206.26@tcp:101:ll_cfg_requeue.0 Request processed in 150us (2456us total) trans 0 rc 0/0 00000100:00100000:0.0:1789049624.583839:0:14321:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.26@tcp, seq: 106 00000100:00100000:0.0:1789049624.590166:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.26@tcp (source: 12345-192.168.206.26@tcp) 00000100:00100000:1.0:1789049624.590248:0:14322:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954089703680 00000100:00100000:1.0:1789049624.590259:0:14322:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954089703680 00000100:00100000:1.0:1789049624.590310:0:14322:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.26@tcp, seq: 107 00000100:00100000:1.0:1789049624.590321:0:14322:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8d6a24850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fcaa091b-21fd-4d41-8af7-6b63e4c958e5+12:13729:x1875954089703680:12345-192.168.206.26@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789049624.590591:0:14322:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8d6a24850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fcaa091b-21fd-4d41-8af7-6b63e4c958e5+12:13729:x1875954089703680:12345-192.168.206.26@tcp:501:ll_cfg_requeue.0 Request processed in 271us (433us total) trans 0 rc 0/0 00000100:00100000:1.0:1789049624.590600:0:14322:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.26@tcp, seq: 107 00000100:00100000:3.0:1789049624.604600:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.26@tcp (source: 12345-192.168.206.26@tcp) 00000100:00100000:1.0:1789049624.604638:0:14323:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954089703808 00000100:00100000:1.0:1789049624.604647:0:14323:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954089703808 00000100:00100000:1.0:1789049624.604698:0:14323:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.26@tcp, seq: 108 00000100:00100000:1.0:1789049624.604707:0:14323:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8d6a25450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fcaa091b-21fd-4d41-8af7-6b63e4c958e5+12:13729:x1875954089703808:12345-192.168.206.26@tcp:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789049624.604931:0:14323:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8d6a25450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fcaa091b-21fd-4d41-8af7-6b63e4c958e5+12:13729:x1875954089703808:12345-192.168.206.26@tcp:503:ll_cfg_requeue.0 Request processed in 224us (360us total) trans 0 rc 0/0 00000100:00100000:1.0:1789049624.604939:0:14323:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.26@tcp, seq: 108 00000100:00100000:2.0:1789049624.625671:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.26@tcp (source: 12345-192.168.206.26@tcp) 00000100:00100000:0.0:1789049624.625740:0:14321:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954089703936 00000100:00100000:0.0:1789049624.625749:0:14321:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954089703936 00000100:00100000:0.0:1789049624.625799:0:14321:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.26@tcp, seq: 109 00000100:00100000:0.0:1789049624.625808:0:14321:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8d6a24450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fcaa091b-21fd-4d41-8af7-6b63e4c958e5+12:13729:x1875954089703936:12345-192.168.206.26@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789049624.625824:0:14321:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789049624.625870:0:14321:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cb7c4c39e00/0xf4f48ce5e1bc019d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x7fc5e358805a37f8 expref: -99 pid: 14321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049624.625898:0:14321:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cb7c4c39e00/0xf4f48ce5e1bc019d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a37f8 expref: 13 pid: 14321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049624.625908:0:14321:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cb7c4c39e00/0xf4f48ce5e1bc019d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a37f8 expref: 13 pid: 14321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049624.625918:0:14321:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cb7c4c39e00, rc 0) 00000100:00100000:0.0:1789049624.625970:0:14321:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8d6a24450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fcaa091b-21fd-4d41-8af7-6b63e4c958e5+13:13729:x1875954089703936:12345-192.168.206.26@tcp:101:ll_cfg_requeue.0 Request processed in 163us (306us total) trans 0 rc 0/0 00000100:00100000:0.0:1789049624.625977:0:14321:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.26@tcp, seq: 109 00000100:00100000:3.0:1789049624.636054:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.26@tcp (source: 12345-192.168.206.26@tcp) 00000100:00100000:1.0:1789049624.636266:0:14323:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954089704064 00000100:00100000:1.0:1789049624.636275:0:14323:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954089704064 00000100:00100000:1.0:1789049624.636336:0:14323:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.26@tcp, seq: 110 00000100:00100000:1.0:1789049624.636345:0:14323:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8d6a26c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fcaa091b-21fd-4d41-8af7-6b63e4c958e5+13:13729:x1875954089704064:12345-192.168.206.26@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789049624.636604:0:14323:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8d6a26c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fcaa091b-21fd-4d41-8af7-6b63e4c958e5+13:13729:x1875954089704064:12345-192.168.206.26@tcp:501:ll_cfg_requeue.0 Request processed in 259us (558us total) trans 0 rc 0/0 00000100:00100000:1.0:1789049624.636612:0:14323:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.26@tcp, seq: 110 00000100:00100000:2.0:1789049624.643361:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.26@tcp (source: 12345-192.168.206.26@tcp) 00000100:00100000:3.0:1789049624.647275:0:14322:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954089704192 00000100:00100000:3.0:1789049624.647290:0:14322:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954089704192 00000100:00100000:3.0:1789049624.647398:0:14322:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.26@tcp, seq: 111 00000100:00100000:3.0:1789049624.647409:0:14322:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8d6a27450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fcaa091b-21fd-4d41-8af7-6b63e4c958e5+13:13729:x1875954089704192:12345-192.168.206.26@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789049624.647750:0:14322:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8d6a27450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fcaa091b-21fd-4d41-8af7-6b63e4c958e5+13:13729:x1875954089704192:12345-192.168.206.26@tcp:503:ll_cfg_requeue.0 Request processed in 343us (4398us total) trans 0 rc 0/0 00000100:00100000:3.0:1789049624.647759:0:14322:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.26@tcp, seq: 111 00010000:00010000:1.0:1789049624.670062:0:14317:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1789049624.859430:0:14325:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1789049624.859438:0:14325:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8cb7c10e3800 from 10 10000000:01000000:1.0:1789049624.859444:0:14325:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1789049624.859488:0:14325:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.126@tcp lock: ffff8cb8c28c2800/0xf4f48ce5e1bc01a4 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14325 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049624.859501:0:14325:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.126@tcp lock: ffff8cb8c28c2800/0xf4f48ce5e1bc01a4 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14325 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049624.859512:0:14325:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.126@tcp lock: ffff8cb8c28c2800/0xf4f48ce5e1bc01a4 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14325 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789049624.859538:0:14325:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb900e41c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:817823bd-3ba1-432d-9714-f03a15bff403:14325:1875954110664448:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1789049624.859604:0:14325:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789049624.859651:0:14325:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cb8c5975a80 going to sleep for 11 seconds 00000100:00100000:0.0:1789049624.860098:0:14321:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954110664448 00000100:00100000:0.0:1789049624.860106:0:14321:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954110664448 00000100:00100000:0.0:1789049624.860167:0:14321:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:0.0:1789049624.860177:0:14321:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8d6a26450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:817823bd-3ba1-432d-9714-f03a15bff403+16:14325:x1875954110664448:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789049624.860190:0:14321:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789049624.860203:0:14321:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cb7c4c39a00/0xf4f48ce5e1bc01ab lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xf4f48ce5e1bc01a4 expref: -99 pid: 14321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049624.860344:0:14321:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cb7c4c39a00/0xf4f48ce5e1bc01ab lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf4f48ce5e1bc01a4 expref: 17 pid: 14321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049624.860355:0:14321:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cb7c4c39a00/0xf4f48ce5e1bc01ab lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf4f48ce5e1bc01a4 expref: 17 pid: 14321 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049624.860363:0:14321:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cb7c4c39a00, rc 0) 00000100:00100000:0.0:1789049624.860415:0:14321:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8d6a26450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:817823bd-3ba1-432d-9714-f03a15bff403+17:14325:x1875954110664448:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 238us (809us total) trans 0 rc 0/0 00000100:00100000:0.0:1789049624.860422:0:14321:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:1.0:1789049624.860965:0:14325:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb900e41c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:817823bd-3ba1-432d-9714-f03a15bff403:14325:1875954110664448:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789049624.860981:0:14325:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.126@tcp lock: ffff8cb8c28c2800/0xf4f48ce5e1bc01a4 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf4f48ce5e1bc01ab expref: -99 pid: 14325 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049624.860991:0:14325:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.126@tcp lock: ffff8cb8c28c2800/0xf4f48ce5e1bc01a4 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xf4f48ce5e1bc01ab expref: -99 pid: 14325 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789049624.861052:0:14325:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb900e41c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:817823bd-3ba1-432d-9714-f03a15bff403:14325:1875954110664576:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789049624.861090:0:14325:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789049624.861124:0:14325:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cb8c5975a80 going to sleep for 11 seconds 00000100:00100000:2.0:1789049624.861169:0:14322:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954110664576 00000100:00100000:2.0:1789049624.861174:0:14322:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954110664576 00000100:00100000:2.0:1789049624.861208:0:14322:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:2.0:1789049624.861215:0:14322:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8d6a24c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:817823bd-3ba1-432d-9714-f03a15bff403+17:14325:x1875954110664576:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789049624.861455:0:14322:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8d6a24c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:817823bd-3ba1-432d-9714-f03a15bff403+17:14325:x1875954110664576:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 240us (364us total) trans 0 rc 0/0 00000100:00100000:2.0:1789049624.861463:0:14322:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:0.0:1789049624.863121:0:14325:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb900e41c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:817823bd-3ba1-432d-9714-f03a15bff403:14325:1875954110664576:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789049624.863185:0:14325:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb9009c1f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:817823bd-3ba1-432d-9714-f03a15bff403:14325:1875954110664704:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789049624.864075:0:14325:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789049624.864133:0:14325:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cb900bbe3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789049624.864165:0:14321:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954110664704 00000100:00100000:2.0:1789049624.864173:0:14321:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954110664704 00000100:00100000:2.0:1789049624.864235:0:14321:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:2.0:1789049624.864244:0:14321:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8d6a24050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:817823bd-3ba1-432d-9714-f03a15bff403+17:14325:x1875954110664704:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789049624.864436:0:14321:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8d6a24050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:817823bd-3ba1-432d-9714-f03a15bff403+17:14325:x1875954110664704:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 193us (363us total) trans 0 rc 0/0 00000100:00100000:2.0:1789049624.864445:0:14321:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:1.0:1789049624.864528:0:14325:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb9009c1f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:817823bd-3ba1-432d-9714-f03a15bff403:14325:1875954110664704:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1789049624.865268:0:16518:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:2.0:1789049624.865568:0:14325:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:2.0:1789049624.865591:0:14325:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.126@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1789049624.865601:0:14325:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.126@tcp lock: ffff8cb8c28c2800/0xf4f48ce5e1bc01a4 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf4f48ce5e1bc01ab expref: -99 pid: 14325 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049624.865612:0:14325:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.126@tcp lock: ffff8cb8c28c2800/0xf4f48ce5e1bc01a4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf4f48ce5e1bc01ab expref: -99 pid: 14325 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789049624.865630:0:14325:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1789049624.865633:0:14325:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8cb8cdf0e000 from 10 10000000:01000000:2.0:1789049624.865636:0:14325:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1789049624.865669:0:14325:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.126@tcp lock: ffff8cb900e63000/0xf4f48ce5e1bc01b2 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14325 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049624.865677:0:14325:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.126@tcp lock: ffff8cb900e63000/0xf4f48ce5e1bc01b2 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14325 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049624.865687:0:14325:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.126@tcp lock: ffff8cb900e63000/0xf4f48ce5e1bc01b2 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14325 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789049624.865707:0:14325:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb8f7ac9f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:817823bd-3ba1-432d-9714-f03a15bff403:14325:1875954110664832:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1789049624.865752:0:14325:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789049624.865787:0:14325:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cb900da9c00 going to sleep for 11 seconds 00000100:00100000:1.0:1789049624.865830:0:14323:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954110664832 00000100:00100000:1.0:1789049624.865836:0:14323:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954110664832 00000100:00100000:1.0:1789049624.865905:0:14323:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:1.0:1789049624.865913:0:14323:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8d6a27050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:817823bd-3ba1-432d-9714-f03a15bff403+17:14325:x1875954110664832:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789049624.865925:0:14323:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789049624.865938:0:14323:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cb8c28c2e00/0xf4f48ce5e1bc01b9 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xf4f48ce5e1bc01b2 expref: -99 pid: 14323 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049624.865958:0:14323:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cb8c28c2e00/0xf4f48ce5e1bc01b9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf4f48ce5e1bc01b2 expref: 18 pid: 14323 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049624.865967:0:14323:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cb8c28c2e00/0xf4f48ce5e1bc01b9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf4f48ce5e1bc01b2 expref: 18 pid: 14323 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049624.865975:0:14323:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cb8c28c2e00, rc 0) 00000100:00100000:1.0:1789049624.866008:0:14323:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8d6a27050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:817823bd-3ba1-432d-9714-f03a15bff403+18:14325:x1875954110664832:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 96us (256us total) trans 0 rc 0/0 00000100:00100000:1.0:1789049624.866015:0:14323:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00100000:2.0:1789049624.866173:0:14325:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb8f7ac9f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:817823bd-3ba1-432d-9714-f03a15bff403:14325:1875954110664832:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789049624.866187:0:14325:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.126@tcp lock: ffff8cb900e63000/0xf4f48ce5e1bc01b2 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf4f48ce5e1bc01b9 expref: -99 pid: 14325 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049624.866196:0:14325:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.126@tcp lock: ffff8cb900e63000/0xf4f48ce5e1bc01b2 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xf4f48ce5e1bc01b9 expref: -99 pid: 14325 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789049624.866249:0:14325:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb8f7ac9f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:817823bd-3ba1-432d-9714-f03a15bff403:14325:1875954110664960:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789049624.866276:0:14325:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789049624.866301:0:14325:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cb900da9c00 going to sleep for 11 seconds 00000100:00100000:1.0:1789049624.866345:0:14323:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954110664960 00000100:00100000:1.0:1789049624.866349:0:14323:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954110664960 00000100:00100000:1.0:1789049624.866377:0:14323:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:1.0:1789049624.866383:0:14323:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8d6a26050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:817823bd-3ba1-432d-9714-f03a15bff403+18:14325:x1875954110664960:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789049624.866588:0:14323:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8d6a26050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:817823bd-3ba1-432d-9714-f03a15bff403+18:14325:x1875954110664960:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 204us (311us total) trans 0 rc 0/0 00000100:00100000:1.0:1789049624.866601:0:14323:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00100000:2.0:1789049624.867073:0:14325:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb8f7ac9f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:817823bd-3ba1-432d-9714-f03a15bff403:14325:1875954110664960:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789049624.867107:0:14325:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb8f7ac9f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:817823bd-3ba1-432d-9714-f03a15bff403:14325:1875954110665088:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789049624.867155:0:14325:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789049624.867184:0:14325:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cb900da9c00 going to sleep for 11 seconds 00000100:00100000:1.0:1789049624.867237:0:14323:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954110665088 00000100:00100000:1.0:1789049624.867243:0:14323:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954110665088 00000100:00100000:1.0:1789049624.867272:0:14323:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:1.0:1789049624.867279:0:14323:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8d6a26850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:817823bd-3ba1-432d-9714-f03a15bff403+18:14325:x1875954110665088:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789049624.867432:0:14323:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8d6a26850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:817823bd-3ba1-432d-9714-f03a15bff403+18:14325:x1875954110665088:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 152us (276us total) trans 0 rc 0/0 00000100:00100000:1.0:1789049624.867440:0:14323:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00100000:2.0:1789049624.867562:0:14325:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb8f7ac9f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:817823bd-3ba1-432d-9714-f03a15bff403:14325:1875954110665088:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1789049624.868643:0:16519:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:1.0:1789049624.869414:0:14325:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:1.0:1789049624.869436:0:14325:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.126@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1789049624.869446:0:14325:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.126@tcp lock: ffff8cb900e63000/0xf4f48ce5e1bc01b2 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf4f48ce5e1bc01b9 expref: -99 pid: 14325 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049624.869458:0:14325:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.126@tcp lock: ffff8cb900e63000/0xf4f48ce5e1bc01b2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf4f48ce5e1bc01b9 expref: -99 pid: 14325 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789049624.869468:0:14325:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1789049624.869470:0:14325:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8cb8d1a86000 from 10 10000000:01000000:1.0:1789049624.869473:0:14325:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1789049624.869506:0:14325:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.126@tcp lock: ffff8cb8c28c2200/0xf4f48ce5e1bc01c0 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14325 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049624.869514:0:14325:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.126@tcp lock: ffff8cb8c28c2200/0xf4f48ce5e1bc01c0 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14325 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049624.869524:0:14325:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.126@tcp lock: ffff8cb8c28c2200/0xf4f48ce5e1bc01c0 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14325 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789049624.869546:0:14325:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb900e40a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:817823bd-3ba1-432d-9714-f03a15bff403:14325:1875954110665216:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1789049624.869611:0:14325:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789049624.869655:0:14325:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cb8d742ad80 going to sleep for 11 seconds 00000100:00100000:0.0:1789049624.869883:0:14323:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954110665216 00000100:00100000:0.0:1789049624.869890:0:14323:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954110665216 00000100:00100000:0.0:1789049624.869933:0:14323:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:0.0:1789049624.869944:0:14323:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8d6a25c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:817823bd-3ba1-432d-9714-f03a15bff403+18:14325:x1875954110665216:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789049624.869956:0:14323:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789049624.869974:0:14323:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cb7c4c38a00/0xf4f48ce5e1bc01c7 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xf4f48ce5e1bc01c0 expref: -99 pid: 14323 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049624.869996:0:14323:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cb7c4c38a00/0xf4f48ce5e1bc01c7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf4f48ce5e1bc01c0 expref: 19 pid: 14323 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049624.870007:0:14323:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cb7c4c38a00/0xf4f48ce5e1bc01c7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf4f48ce5e1bc01c0 expref: 19 pid: 14323 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049624.870015:0:14323:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cb7c4c38a00, rc 0) 00000100:00100000:0.0:1789049624.870055:0:14323:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8d6a25c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:817823bd-3ba1-432d-9714-f03a15bff403+19:14325:x1875954110665216:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 114us (445us total) trans 0 rc 0/0 00000100:00100000:0.0:1789049624.870062:0:14323:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00100000:1.0:1789049624.870361:0:14325:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb900e40a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:817823bd-3ba1-432d-9714-f03a15bff403:14325:1875954110665216:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789049624.870374:0:14325:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.126@tcp lock: ffff8cb8c28c2200/0xf4f48ce5e1bc01c0 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf4f48ce5e1bc01c7 expref: -99 pid: 14325 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049624.870383:0:14325:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.126@tcp lock: ffff8cb8c28c2200/0xf4f48ce5e1bc01c0 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xf4f48ce5e1bc01c7 expref: -99 pid: 14325 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789049624.870434:0:14325:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb900e40a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:817823bd-3ba1-432d-9714-f03a15bff403:14325:1875954110665344:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789049624.870461:0:14325:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789049624.870483:0:14325:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cb8d742ad80 going to sleep for 11 seconds 00000100:00100000:0.0:1789049624.870524:0:14322:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954110665344 00000100:00100000:0.0:1789049624.870529:0:14322:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954110665344 00000100:00100000:0.0:1789049624.870558:0:14322:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:0.0:1789049624.870565:0:14322:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8d6a25050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:817823bd-3ba1-432d-9714-f03a15bff403+19:14325:x1875954110665344:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789049624.870803:0:14322:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8d6a25050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:817823bd-3ba1-432d-9714-f03a15bff403+19:14325:x1875954110665344:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 237us (340us total) trans 0 rc 0/0 00000100:00100000:0.0:1789049624.870810:0:14322:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00000100:00100000:0.0:1789049624.870839:0:14325:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb900e40a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:817823bd-3ba1-432d-9714-f03a15bff403:14325:1875954110665344:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789049624.870894:0:14325:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb9009c1880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:817823bd-3ba1-432d-9714-f03a15bff403:14325:1875954110665472:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789049624.870932:0:14325:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789049624.870949:0:14325:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cb900bbef00 going to sleep for 11 seconds 00000100:00100000:0.0:1789049624.870966:0:14322:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954110665472 00000100:00100000:0.0:1789049624.870970:0:14322:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954110665472 00000100:00100000:0.0:1789049624.870987:0:14322:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:0.0:1789049624.870992:0:14322:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8d6a25850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:817823bd-3ba1-432d-9714-f03a15bff403+19:14325:x1875954110665472:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789049624.871126:0:14322:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8d6a25850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:817823bd-3ba1-432d-9714-f03a15bff403+19:14325:x1875954110665472:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 132us (192us total) trans 0 rc 0/0 00000100:00100000:0.0:1789049624.871132:0:14322:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00000100:00100000:0.0:1789049624.871165:0:14325:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb9009c1880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:817823bd-3ba1-432d-9714-f03a15bff403:14325:1875954110665472:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1789049624.871691:0:16520:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:0.0:1789049624.871743:0:14325:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:0.0:1789049624.871759:0:14325:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.126@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1789049624.871766:0:14325:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.126@tcp lock: ffff8cb8c28c2200/0xf4f48ce5e1bc01c0 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf4f48ce5e1bc01c7 expref: -99 pid: 14325 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049624.871775:0:14325:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.126@tcp lock: ffff8cb8c28c2200/0xf4f48ce5e1bc01c0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf4f48ce5e1bc01c7 expref: -99 pid: 14325 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049625.693666:0:14316:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789049625.924963:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.26@tcp (source: 12345-192.168.206.26@tcp) 00000100:00100000:1.0:1789049625.925003:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.26@tcp (source: 12345-192.168.206.26@tcp) 00000100:00100000:1.0:1789049625.925036:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.26@tcp (source: 12345-192.168.206.26@tcp) 00000100:00100000:1.0:1789049625.925123:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.26@tcp (source: 12345-192.168.206.26@tcp) 00000100:00100000:1.0:1789049625.925139:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.26@tcp (source: 12345-192.168.206.26@tcp) 00000100:00100000:0.0:1789049625.925240:0:14328:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954089704448 00000100:00100000:0.0:1789049625.925250:0:14328:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954089704448 00000100:00100000:0.0:1789049625.925313:0:14328:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.26@tcp, seq: 24 00000100:00100000:0.0:1789049625.925324:0:14328:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb900e40a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b76d50d5-035a-43d0-9ba1-e61b094296a4+6:2356:x1875954089704448:12345-192.168.206.26@tcp:400:kworker.0 00000100:00100000:0.0:1789049625.925393:0:14328:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb900e40a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b76d50d5-035a-43d0-9ba1-e61b094296a4+6:2356:x1875954089704448:12345-192.168.206.26@tcp:400:kworker.0 Request processed in 70us (440us total) trans 0 rc 0/0 00000100:00100000:0.0:1789049625.925400:0:14328:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.26@tcp, seq: 24 00000100:00100000:0.0:1789049625.925424:0:14322:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954089704320 00000100:00100000:0.0:1789049625.925427:0:14322:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954089704320 00000100:00100000:0.0:1789049625.925451:0:14322:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.26@tcp, seq: 121 00000100:00100000:0.0:1789049625.925458:0:14322:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8d6a27c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fcaa091b-21fd-4d41-8af7-6b63e4c958e5+13:2356:x1875954089704320:12345-192.168.206.26@tcp:400:kworker.0 00000100:00100000:0.0:1789049625.925484:0:14322:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8d6a27c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fcaa091b-21fd-4d41-8af7-6b63e4c958e5+13:2356:x1875954089704320:12345-192.168.206.26@tcp:400:kworker.0 Request processed in 26us (361us total) trans 0 rc 0/0 00000100:00100000:0.0:1789049625.925503:0:14322:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.26@tcp, seq: 121 00000100:00080000:0.0:1789049625.925527:0:14324:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789049625.936236:0:15014:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954089704704 00000100:00100000:3.0:1789049625.936251:0:15014:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954089704704 00000100:00100000:3.0:1789049625.936654:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.26@tcp (source: 12345-192.168.206.26@tcp) 00000100:00100000:1.0:1789049625.937490:0:14327:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954089704832 00000100:00100000:1.0:1789049625.937498:0:14327:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954089704832 00000100:00100000:1.0:1789049625.937559:0:14327:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.26@tcp, seq: 25 00000100:00100000:1.0:1789049625.937570:0:14327:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8df4d1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:45abea75-ce99-406c-bba5-a167dc77aef6+6:2356:x1875954089704832:12345-192.168.206.26@tcp:400:kworker.0 00000100:00100000:1.0:1789049625.937632:0:14327:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8df4d1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:45abea75-ce99-406c-bba5-a167dc77aef6+6:2356:x1875954089704832:12345-192.168.206.26@tcp:400:kworker.0 Request processed in 64us (982us total) trans 0 rc 0/0 00000100:00100000:1.0:1789049625.937639:0:14327:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.26@tcp, seq: 25 00000100:00080000:1.0:1789049625.937662:0:14324:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789049625.937822:0:15014:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954089704960 00000100:00100000:1.0:1789049625.937826:0:15014:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954089704960 00000100:00100000:3.0:1789049625.937858:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.26@tcp (source: 12345-192.168.206.26@tcp) 00000100:00100000:1.0:1789049625.937875:0:15014:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954089704576 00000100:00100000:1.0:1789049625.937879:0:15014:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954089704576 00000100:00100000:1.0:1789049625.937892:0:15014:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954089705088 00000100:00100000:1.0:1789049625.937894:0:15014:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954089705088 00000100:00100000:1.0:1789049625.937907:0:15014:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.26@tcp, seq: 10 00000100:00100000:1.0:1789049625.937914:0:15014:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb900e41c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b76d50d5-035a-43d0-9ba1-e61b094296a4+5:2356:x1875954089704704:12345-192.168.206.26@tcp:400:kworker.0 00000100:00100000:1.0:1789049625.937957:0:15014:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb900e41c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b76d50d5-035a-43d0-9ba1-e61b094296a4+5:2356:x1875954089704704:12345-192.168.206.26@tcp:400:kworker.0 Request processed in 39us (12948us total) trans 0 rc 0/0 00000100:00100000:1.0:1789049625.937964:0:15014:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.26@tcp, seq: 10 00000100:00100000:1.0:1789049625.937977:0:15014:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.26@tcp, seq: 11 00000100:00100000:1.0:1789049625.937983:0:15014:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb900e41180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:45abea75-ce99-406c-bba5-a167dc77aef6+5:2356:x1875954089704960:12345-192.168.206.26@tcp:400:kworker.0 00000100:00100000:1.0:1789049625.938008:0:15014:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb900e41180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:45abea75-ce99-406c-bba5-a167dc77aef6+5:2356:x1875954089704960:12345-192.168.206.26@tcp:400:kworker.0 Request processed in 25us (12971us total) trans 0 rc 0/0 00000100:00100000:1.0:1789049625.938015:0:15014:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.26@tcp, seq: 11 00000100:00100000:1.0:1789049625.938026:0:15014:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.26@tcp, seq: 12 00000100:00100000:1.0:1789049625.938033:0:15014:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb900e42300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b76d50d5-035a-43d0-9ba1-e61b094296a4+5:2356:x1875954089704576:12345-192.168.206.26@tcp:400:kworker.0 00000100:00100000:1.0:1789049625.938075:0:15014:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb900e42300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b76d50d5-035a-43d0-9ba1-e61b094296a4+5:2356:x1875954089704576:12345-192.168.206.26@tcp:400:kworker.0 Request processed in 42us (12934us total) trans 0 rc 0/0 00000100:00100000:1.0:1789049625.938081:0:15014:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.26@tcp, seq: 12 00000100:00100000:1.0:1789049625.938099:0:15014:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.26@tcp, seq: 13 00000100:00100000:1.0:1789049625.938105:0:15014:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8df4d1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:45abea75-ce99-406c-bba5-a167dc77aef6+5:2356:x1875954089705088:12345-192.168.206.26@tcp:400:kworker.0 00000100:00100000:1.0:1789049625.938130:0:15014:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8df4d1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:45abea75-ce99-406c-bba5-a167dc77aef6+5:2356:x1875954089705088:12345-192.168.206.26@tcp:400:kworker.0 Request processed in 25us (288us total) trans 0 rc 0/0 00000100:00100000:1.0:1789049625.938135:0:15014:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.26@tcp, seq: 13 00000100:00080000:1.0:1789049625.938149:0:14324:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1789049625.938157:0:14324:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:2.0:1789049626.722068:0:15620:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789049627.241475:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.26@tcp (source: 12345-192.168.206.26@tcp) 00000100:00100000:0.0:1789049627.241651:0:16306:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954089705216 00000100:00100000:0.0:1789049627.241660:0:16306:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954089705216 00000100:00100000:0.0:1789049627.241728:0:16306:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.26@tcp, seq: 15 00000100:00100000:0.0:1789049627.241737:0:16306:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8f7ac9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b76d50d5-035a-43d0-9ba1-e61b094296a4+6:14387:x1875954089705216:12345-192.168.206.26@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789049627.241756:0:16306:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789049627.241775:0:16306:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb7c4c38c00/0xf4f48ce5e1bc01ce lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7fc5e358805a37ff expref: -99 pid: 16306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049627.241834:0:16306:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb7c4c39600/0xf4f48ce5e1bc01d5 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 16306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049627.241874:0:16306:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cb7c4c39600/0xf4f48ce5e1bc01d5 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 16306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049627.241887:0:16306:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb7c4c39600/0xf4f48ce5e1bc01d5 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 16306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049627.241900:0:16306:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb7c4c38600/0xf4f48ce5e1bc01dc lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 16306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049627.241906:0:16306:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cb7c4c38600/0xf4f48ce5e1bc01dc lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049627.241912:0:16306:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb7c4c38600/0xf4f48ce5e1bc01dc lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16306 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:1.0:1789049627.242231:0:14324:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1789049627.244666:0:16306:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb7c4c38200/0xf4f48ce5e1bc01e3 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 16306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049627.244699:0:16306:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cb7c4c38200/0xf4f48ce5e1bc01e3 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049627.244711:0:16306:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb7c4c38200/0xf4f48ce5e1bc01e3 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16306 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789049627.244741:0:16306:0:(mdt_handler.c:922:mdt_pack_attr2body()) [0x200000002:0x1:0x0]: returning size 16384 00000004:00200000:0.0:1789049627.244744:0:16306:0:(mdt_handler.c:1587:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1789049627.244778:0:16306:0:(mdt_handler.c:2522:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8cb7c4c38200/0xf4f48ce5e1bc01e3 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049627.244789:0:16306:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb7c4c39600/0xf4f48ce5e1bc01d5 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 16306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049627.244795:0:16306:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cb7c4c39600/0xf4f48ce5e1bc01d5 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 16306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049627.244802:0:16306:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cb7c4c39600/0xf4f48ce5e1bc01d5 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 16306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049627.244806:0:16306:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cb7c4c39600 already unused, calling callback (ffffffffc20ca4f0) 00010000:00010000:0.0:1789049627.244810:0:16306:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb7c4c39600/0xf4f48ce5e1bc01d5 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 16306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049627.244817:0:16306:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb7c4c39600/0xf4f48ce5e1bc01d5 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 16306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049627.244828:0:16306:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8cb8ce751300) 00010000:00010000:0.0:1789049627.244831:0:16306:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789049627.244835:0:16306:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cb7c4c39600/0xf4f48ce5e1bc01d5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 16306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049627.244867:0:16306:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb7c4c39600/0xf4f48ce5e1bc01d5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 16306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049627.244879:0:16306:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb7c4c38600/0xf4f48ce5e1bc01dc lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049627.244885:0:16306:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cb7c4c38600/0xf4f48ce5e1bc01dc lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 16306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049627.244892:0:16306:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cb7c4c38600/0xf4f48ce5e1bc01dc lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049627.244897:0:16306:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cb7c4c38600 already unused, calling callback (ffffffffc20ca4f0) 00010000:00010000:0.0:1789049627.244899:0:16306:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb7c4c38600/0xf4f48ce5e1bc01dc lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049627.244905:0:16306:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb7c4c38600/0xf4f48ce5e1bc01dc lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 16306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049627.244911:0:16306:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b979c7a (ffff8cb8ce751900) 00010000:00010000:0.0:1789049627.244913:0:16306:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789049627.244916:0:16306:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cb7c4c38600/0xf4f48ce5e1bc01dc lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049627.244921:0:16306:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb7c4c38600/0xf4f48ce5e1bc01dc lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049627.244955:0:16306:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb7c4c38c00/0xf4f48ce5e1bc01ce lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a37ff expref: 8 pid: 16306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049627.244979:0:16306:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb7c4c38200/0xf4f48ce5e1bc01e3 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a37ff expref: 7 pid: 16306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049627.244985:0:16306:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff8cb8ce751e00) 00010000:00010000:0.0:1789049627.244987:0:16306:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1789049627.244989:0:16306:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cb7c4c38200, rc 0) 00000100:00100000:0.0:1789049627.245053:0:16306:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8f7ac9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b76d50d5-035a-43d0-9ba1-e61b094296a4+7:14387:x1875954089705216:12345-192.168.206.26@tcp:101:lhsmtool_posix.0 Request processed in 3316us (3595us total) trans 0 rc 0/0 00000100:00100000:0.0:1789049627.245061:0:16306:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.26@tcp, seq: 15 00000100:00100000:3.0:1789049627.250279:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.26@tcp (source: 12345-192.168.206.26@tcp) 00000100:00100000:0.0:1789049627.250566:0:14329:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954089705472 00000100:00100000:0.0:1789049627.250576:0:14329:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954089705472 00000100:00100000:0.0:1789049627.250629:0:14329:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.26@tcp, seq: 16 00000100:00100000:0.0:1789049627.250638:0:14329:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8df4d1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b76d50d5-035a-43d0-9ba1-e61b094296a4+7:14387:x1875954089705472:12345-192.168.206.26@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789049627.250657:0:14329:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789049627.250673:0:14329:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb7c4c39c00/0xf4f48ce5e1bc01ea lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7fc5e358805a3806 expref: -99 pid: 14329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049627.250738:0:14329:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d776fc00/0xf4f48ce5e1bc01f1 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049627.250750:0:14329:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d776fc00/0xf4f48ce5e1bc01f1 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049627.250760:0:14329:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d776fc00/0xf4f48ce5e1bc01f1 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049627.250810:0:14329:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d776f000/0xf4f48ce5e1bc01f8 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049627.250829:0:14329:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d776f000/0xf4f48ce5e1bc01f8 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049627.250836:0:14329:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d776f000/0xf4f48ce5e1bc01f8 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049627.253272:0:14329:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d776f600/0xf4f48ce5e1bc01ff lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049627.253293:0:14329:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d776f600/0xf4f48ce5e1bc01ff lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049627.253414:0:14329:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d776f600/0xf4f48ce5e1bc01ff lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14329 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789049627.253427:0:14329:0:(mdt_handler.c:922:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 16384 00010000:00010000:0.0:1789049627.253775:0:14329:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d776fc00/0xf4f48ce5e1bc01f1 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049627.253783:0:14329:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d776fc00/0xf4f48ce5e1bc01f1 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049627.253789:0:14329:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d776fc00/0xf4f48ce5e1bc01f1 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049627.253795:0:14329:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cb8d776fc00 already unused, calling callback (ffffffffc20ca4f0) 00010000:00010000:0.0:1789049627.253798:0:14329:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d776fc00/0xf4f48ce5e1bc01f1 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049627.253805:0:14329:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d776fc00/0xf4f48ce5e1bc01f1 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049627.253827:0:14329:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff8cb8ce751e00) 00010000:00010000:0.0:1789049627.253829:0:14329:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789049627.253833:0:14329:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d776fc00/0xf4f48ce5e1bc01f1 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049627.253839:0:14329:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d776fc00/0xf4f48ce5e1bc01f1 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049627.253869:0:14329:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d776f000/0xf4f48ce5e1bc01f8 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049627.253875:0:14329:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d776f000/0xf4f48ce5e1bc01f8 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049627.253880:0:14329:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d776f000/0xf4f48ce5e1bc01f8 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049627.253885:0:14329:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cb8d776f000 already unused, calling callback (ffffffffc20ca4f0) 00010000:00010000:0.0:1789049627.253887:0:14329:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d776f000/0xf4f48ce5e1bc01f8 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049627.253892:0:14329:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d776f000/0xf4f48ce5e1bc01f8 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049627.253899:0:14329:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff8cb8ce751100) 00010000:00010000:0.0:1789049627.253901:0:14329:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789049627.253904:0:14329:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d776f000/0xf4f48ce5e1bc01f8 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049627.253909:0:14329:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d776f000/0xf4f48ce5e1bc01f8 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049627.257809:0:14329:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb7c4c39c00/0xf4f48ce5e1bc01ea lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a3806 expref: 10 pid: 14329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049627.257834:0:14329:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d776f600/0xf4f48ce5e1bc01ff lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a3806 expref: 9 pid: 14329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049627.257864:0:14329:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8cb8ce751900) 00010000:00010000:0.0:1789049627.257867:0:14329:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789049627.257870:0:14329:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cb8d776f600, rc 0) 00000100:00100000:0.0:1789049627.258003:0:14329:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8df4d1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b76d50d5-035a-43d0-9ba1-e61b094296a4+9:14387:x1875954089705472:12345-192.168.206.26@tcp:101:lhsmtool_posix.0 Request processed in 7363us (7730us total) trans 8589934593 rc 0/0 00000100:00100000:0.0:1789049627.258011:0:14329:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.26@tcp, seq: 16 00000100:00100000:3.0:1789049627.269990:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.26@tcp (source: 12345-192.168.206.26@tcp) 00000100:00100000:1.0:1789049627.270476:0:16204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954089705600 00000100:00100000:1.0:1789049627.270486:0:16204:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954089705600 00000100:00100000:1.0:1789049627.270545:0:16204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.26@tcp, seq: 17 00000100:00100000:1.0:1789049627.270563:0:16204:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8df4d0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b76d50d5-035a-43d0-9ba1-e61b094296a4+9:14387:x1875954089705600:12345-192.168.206.26@tcp:59:lhsmtool_posix.0 00000100:00100000:1.0:1789049627.270659:0:16204:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8df4d0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b76d50d5-035a-43d0-9ba1-e61b094296a4+9:14387:x1875954089705600:12345-192.168.206.26@tcp:59:lhsmtool_posix.0 Request processed in 104us (676us total) trans 0 rc 0/0 00000100:00100000:1.0:1789049627.270666:0:16204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.26@tcp, seq: 17 00000100:00100000:3.0:1789049627.344277:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.26@tcp (source: 12345-192.168.206.26@tcp) 00000100:00100000:0.0:1789049627.344377:0:16306:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954089705728 00000100:00100000:0.0:1789049627.344386:0:16306:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954089705728 00000100:00100000:0.0:1789049627.344441:0:16306:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.26@tcp, seq: 18 00000100:00100000:0.0:1789049627.344450:0:16306:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8df4d2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b76d50d5-035a-43d0-9ba1-e61b094296a4+9:14393:x1875954089705728:12345-192.168.206.26@tcp:101:lfs.0 00010000:00010000:0.0:1789049627.344469:0:16306:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789049627.344486:0:16306:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d776f000/0xf4f48ce5e1bc020d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7fc5e358805a380d expref: -99 pid: 16306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049627.344539:0:16306:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d776fc00/0xf4f48ce5e1bc0214 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 16306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049627.344553:0:16306:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d776fc00/0xf4f48ce5e1bc0214 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 16306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049627.344576:0:16306:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d776fc00/0xf4f48ce5e1bc0214 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 16306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049627.344603:0:16306:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d776e800/0xf4f48ce5e1bc021b lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 16306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049627.344611:0:16306:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d776e800/0xf4f48ce5e1bc021b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049627.344617:0:16306:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d776e800/0xf4f48ce5e1bc021b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049627.344791:0:16306:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d776fc00/0xf4f48ce5e1bc0214 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 16306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049627.344799:0:16306:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d776fc00/0xf4f48ce5e1bc0214 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 16306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049627.344806:0:16306:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d776fc00/0xf4f48ce5e1bc0214 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 16306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049627.344812:0:16306:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cb8d776fc00 already unused, calling callback (ffffffffc20ca4f0) 00010000:00010000:0.0:1789049627.344816:0:16306:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d776fc00/0xf4f48ce5e1bc0214 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 16306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049627.344828:0:16306:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d776fc00/0xf4f48ce5e1bc0214 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 16306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049627.344840:0:16306:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8cb8ce751300) 00010000:00010000:0.0:1789049627.344884:0:16306:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789049627.344890:0:16306:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d776fc00/0xf4f48ce5e1bc0214 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 16306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049627.344908:0:16306:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d776fc00/0xf4f48ce5e1bc0214 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 16306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049627.344928:0:16306:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d776e800/0xf4f48ce5e1bc021b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049627.344935:0:16306:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d776e800/0xf4f48ce5e1bc021b lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 16306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049627.344942:0:16306:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d776e800/0xf4f48ce5e1bc021b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049627.344948:0:16306:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cb8d776e800 already unused, calling callback (ffffffffc20ca4f0) 00010000:00010000:0.0:1789049627.344952:0:16306:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d776e800/0xf4f48ce5e1bc021b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049627.344959:0:16306:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d776e800/0xf4f48ce5e1bc021b lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 16306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049627.344968:0:16306:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff8cb8ce751100) 00010000:00010000:0.0:1789049627.344970:0:16306:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789049627.344973:0:16306:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d776e800/0xf4f48ce5e1bc021b lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049627.344978:0:16306:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d776e800/0xf4f48ce5e1bc021b lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049627.345007:0:16306:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d776f000/0xf4f48ce5e1bc020d lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a380d expref: 10 pid: 16306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049627.345018:0:16306:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8cb8ce751300) 00010000:00010000:0.0:1789049627.345020:0:16306:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789049627.345030:0:16306:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d776f000/0xf4f48ce5e1bc020d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a380d expref: 10 pid: 16306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049627.345040:0:16306:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cb8d776f000, rc 0) 00000100:00100000:0.0:1789049627.345097:0:16306:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8df4d2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b76d50d5-035a-43d0-9ba1-e61b094296a4+9:14393:x1875954089705728:12345-192.168.206.26@tcp:101:lfs.0 Request processed in 648us (828us total) trans 0 rc 301/301 00000100:00100000:0.0:1789049627.345106:0:16306:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.26@tcp, seq: 18 00000100:00100000:3.0:1789049627.359876:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.26@tcp (source: 12345-192.168.206.26@tcp) 00000100:00100000:1.0:1789049627.360458:0:14336:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954089705856 00000100:00100000:1.0:1789049627.360468:0:14336:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954089705856 00000100:00100000:1.0:1789049627.360522:0:14336:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.26@tcp, seq: 0 00000100:00100000:1.0:1789049627.360531:0:14336:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8df4d1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:b76d50d5-035a-43d0-9ba1-e61b094296a4+9:14393:x1875954089705856:12345-192.168.206.26@tcp:700:lfs.0 00000100:00100000:1.0:1789049627.360620:0:14336:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8df4d1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:b76d50d5-035a-43d0-9ba1-e61b094296a4+9:14393:x1875954089705856:12345-192.168.206.26@tcp:700:lfs.0 Request processed in 89us (783us total) trans 0 rc 0/0 00000100:00100000:1.0:1789049627.360775:0:14336:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.26@tcp, seq: 0 00000100:00100000:3.0:1789049627.364478:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.26@tcp (source: 12345-192.168.206.26@tcp) 00000100:00100000:0.0:1789049627.364999:0:14329:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954089706112 00000100:00100000:0.0:1789049627.365009:0:14329:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954089706112 00000100:00100000:0.0:1789049627.365066:0:14329:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.26@tcp, seq: 19 00000100:00100000:0.0:1789049627.365077:0:14329:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8df4d3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b76d50d5-035a-43d0-9ba1-e61b094296a4+9:14393:x1875954089706112:12345-192.168.206.26@tcp:36:lfs.0 00010000:00010000:0.0:1789049627.365127:0:14329:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789049627.365151:0:14329:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb7c4c39000/0xf4f48ce5e1bc0150 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a3788 expref: 9 pid: 14329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049627.365172:0:14329:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8cb8ce751300) 00010000:00010000:0.0:1789049627.365176:0:14329:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789049627.365383:0:14329:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d776f000/0xf4f48ce5e1bc0222 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049627.365397:0:14329:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb900e62a00/0xf4f48ce5e1bc0188 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a37ea expref: 5 pid: 14328 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049627.365405:0:14329:0:(ldlm_resource.c:1751:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d776f000/0xf4f48ce5e1bc0222 lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049627.365436:0:14329:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8cb900e62a00/0xf4f48ce5e1bc0188 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a37ea expref: 5 pid: 14328 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049627.365463:0:14329:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb900e62a00/0xf4f48ce5e1bc0188 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a37ea expref: 5 pid: 14328 timeout: 553 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789049627.365476:0:14329:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb9009c1880 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14329:1875954110665600:192.168.206.26@tcp:104: 00000100:00100000:0.0:1789049627.365583:0:14329:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cb900bbecc0 going to sleep for 11 seconds 00000100:00100000:2.0:1789049627.370286:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.26@tcp (source: 12345-192.168.206.26@tcp) 00000100:00100000:3.0:1789049627.370403:0:14314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954089706240 00000100:00100000:3.0:1789049627.370412:0:14314:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954089706240 00010000:00010000:3.0:1789049627.370482:0:14314:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cb900e62a00/0xf4f48ce5e1bc0188 lrc: 5/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a37ea expref: 6 pid: 14328 timeout: 553 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789049627.370523:0:14314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.26@tcp, seq: 9 00000100:00100000:3.0:1789049627.370532:0:14314:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8f7aca680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:45abea75-ce99-406c-bba5-a167dc77aef6+6:2357:x1875954089706240:12345-192.168.206.26@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789049627.370546:0:14314:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789049627.370563:0:14314:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8cb900e62a00/0xf4f48ce5e1bc0188 lrc: 5/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a37ea expref: 6 pid: 14328 timeout: 553 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049627.370577:0:14314:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8cb900e62a00/0xf4f48ce5e1bc0188 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a37ea expref: 6 pid: 14328 timeout: 553 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049627.370598:0:14314:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8cb8ce751300) 00010000:00010000:3.0:1789049627.370604:0:14314:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d776f000/0xf4f48ce5e1bc0222 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049627.370613:0:14314:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d776f000/0xf4f48ce5e1bc0222 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 14329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049627.370620:0:14314:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d776f000/0xf4f48ce5e1bc0222 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 14329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049627.370648:0:14314:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789049627.370978:0:14314:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8f7aca680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:45abea75-ce99-406c-bba5-a167dc77aef6+6:2357:x1875954089706240:12345-192.168.206.26@tcp:103:ldlm_bl.0 Request processed in 445us (700us total) trans 0 rc 0/0 00000100:00100000:3.0:1789049627.370987:0:14314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.26@tcp, seq: 9 00000100:00080000:1.0:1789049627.371202:0:14324:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1789049627.372611:0:14329:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb900e62a00/0xf4f48ce5e1bc0188 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a37ea expref: 5 pid: 14328 timeout: 553 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789049627.372747:0:14329:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb9009c1880 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14329:1875954110665600:192.168.206.26@tcp:104: 00010000:00010000:0.0:1789049627.372772:0:14329:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d776f000/0xf4f48ce5e1bc0222 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049627.372782:0:14329:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d776f000/0xf4f48ce5e1bc0222 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049627.372788:0:14329:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d776f000/0xf4f48ce5e1bc0222 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049627.372813:0:14329:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d776e800/0xf4f48ce5e1bc0229 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049627.372826:0:14329:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d776e800/0xf4f48ce5e1bc0229 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049627.373278:0:14329:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d776e800/0xf4f48ce5e1bc0229 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14329 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789049627.377173:0:14329:0:(mdt_handler.c:922:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00010000:00010000:0.0:1789049627.377197:0:14329:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d776f000/0xf4f48ce5e1bc0222 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049627.377219:0:14329:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d776f000/0xf4f48ce5e1bc0222 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049627.377227:0:14329:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d776f000/0xf4f48ce5e1bc0222 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049627.377234:0:14329:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cb8d776f000 already unused, calling callback (ffffffffc20ca4f0) 00010000:00010000:0.0:1789049627.377238:0:14329:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d776f000/0xf4f48ce5e1bc0222 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049627.377247:0:14329:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d776f000/0xf4f48ce5e1bc0222 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049627.377262:0:14329:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8cb8ce751300) 00010000:00010000:0.0:1789049627.377265:0:14329:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789049627.377270:0:14329:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d776f000/0xf4f48ce5e1bc0222 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049627.377276:0:14329:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d776f000/0xf4f48ce5e1bc0222 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14329 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789049627.377297:0:14329:0:(mdt_handler.c:4507:mdt_save_lock()) ### save lock request 000000000520d72f reply state 000000000395d359 transno 8589934594 ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d776e800/0xf4f48ce5e1bc0229 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14329 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789049627.377305:0:14329:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1789049627.377406:0:14329:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8df4d3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b76d50d5-035a-43d0-9ba1-e61b094296a4+10:14393:x1875954089706112:12345-192.168.206.26@tcp:36:lfs.0 Request processed in 12327us (12931us total) trans 8589934594 rc 0/0 00000100:00100000:0.0:1789049627.377414:0:14329:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.26@tcp, seq: 19 00010000:00010000:3.0:1789049627.382768:0:3294:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d776e800/0xf4f48ce5e1bc0229 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049627.382786:0:3294:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d776e800/0xf4f48ce5e1bc0229 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049627.382809:0:3294:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d776e800/0xf4f48ce5e1bc0229 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049627.382815:0:3294:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cb8d776e800 already unused, calling callback (ffffffffc20ca4f0) 00010000:00010000:3.0:1789049627.382819:0:3294:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d776e800/0xf4f48ce5e1bc0229 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049627.382827:0:3294:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d776e800/0xf4f48ce5e1bc0229 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049627.382880:0:3294:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff8cb8ce751100) 00010000:00010000:3.0:1789049627.382884:0:3294:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789049627.382889:0:3294:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d776e800/0xf4f48ce5e1bc0229 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049627.382906:0:3294:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d776e800/0xf4f48ce5e1bc0229 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14329 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789049627.488613:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.26@tcp (source: 12345-192.168.206.26@tcp) 00000100:00100000:1.0:1789049627.488731:0:16204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954089706368 00000100:00100000:1.0:1789049627.488742:0:16204:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954089706368 00000100:00100000:1.0:1789049627.488813:0:16204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.26@tcp, seq: 20 00000100:00100000:1.0:1789049627.488825:0:16204:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8f7acbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b76d50d5-035a-43d0-9ba1-e61b094296a4+9:14401:x1875954089706368:12345-192.168.206.26@tcp:101:lctl.0 00010000:00010000:1.0:1789049627.488880:0:16204:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789049627.488915:0:16204:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c3800/0xf4f48ce5e1bc0230 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7fc5e358805a3814 expref: -99 pid: 16204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049627.488974:0:16204:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c2600/0xf4f48ce5e1bc0237 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 16204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049627.489013:0:16204:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c2600/0xf4f48ce5e1bc0237 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 16204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049627.489027:0:16204:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c2600/0xf4f48ce5e1bc0237 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 16204 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789049627.489064:0:16204:0:(mdt_handler.c:922:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:1.0:1789049627.489067:0:16204:0:(mdt_handler.c:1587:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1789049627.489546:0:16204:0:(mdt_handler.c:2522:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c2600/0xf4f48ce5e1bc0237 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 16204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049627.489576:0:16204:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c3800/0xf4f48ce5e1bc0230 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a3814 expref: 11 pid: 16204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049627.489595:0:16204:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c2600/0xf4f48ce5e1bc0237 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a3814 expref: 10 pid: 16204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049627.489604:0:16204:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8cb8c396d500) 00010000:00010000:1.0:1789049627.489606:0:16204:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1789049627.489610:0:16204:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cb8c28c2600, rc 0) 00000100:00100000:1.0:1789049627.489677:0:16204:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8f7acbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b76d50d5-035a-43d0-9ba1-e61b094296a4+10:14401:x1875954089706368:12345-192.168.206.26@tcp:101:lctl.0 Request processed in 853us (1071us total) trans 0 rc 0/0 00000100:00100000:1.0:1789049627.489684:0:16204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.26@tcp, seq: 20 00000100:00100000:0.0:1789049627.547094:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb900e40380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1875954110665728:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789049627.547122:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.26@tcp (source: 12345-192.168.206.26@tcp) 00000100:00100000:0.0:1789049627.547168:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789049627.547187:0:14327:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954089706496 00000100:00100000:1.0:1789049627.547195:0:14327:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954089706496 00000100:00100000:1.0:1789049627.547250:0:14327:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.26@tcp, seq: 21 00000100:00100000:1.0:1789049627.547259:0:14327:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8f7acaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:45abea75-ce99-406c-bba5-a167dc77aef6+5:14402:x1875954089706496:12345-192.168.206.26@tcp:101:lfs.0 00010000:00010000:1.0:1789049627.547276:0:14327:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:2.0:1789049627.547295:0:15016:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954110665728 00000100:00100000:2.0:1789049627.547299:0:15016:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954110665728 00010000:00010000:1.0:1789049627.547312:0:14327:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c3800/0xf4f48ce5e1bc023e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7fc5e358805a381b expref: -99 pid: 14327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789049627.547341:0:15016:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1789049627.547347:0:15016:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb9009c1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1875954110665728:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789049627.547371:0:15016:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00010000:00010000:1.0:1789049627.547373:0:14327:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c3e00/0xf4f48ce5e1bc0245 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049627.547385:0:14327:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c3e00/0xf4f48ce5e1bc0245 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049627.547397:0:14327:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c3e00/0xf4f48ce5e1bc0245 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14327 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789049627.547413:0:15016:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb9009c1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1875954110665728:12345-0@lo:13:osp-pre-0-0.0 Request processed in 67us (246us total) trans 0 rc 0/0 00000100:00100000:2.0:1789049627.547420:0:15016:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000004:00200000:1.0:1789049627.547430:0:14327:0:(mdt_handler.c:922:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:1.0:1789049627.547433:0:14327:0:(mdt_handler.c:1587:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1789049627.547452:0:14327:0:(mdt_handler.c:2522:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c3e00/0xf4f48ce5e1bc0245 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14327 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789049627.547459:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb900e40380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1875954110665728:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1789049627.547473:0:14327:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c3800/0xf4f48ce5e1bc023e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a381b expref: 7 pid: 14327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049627.547489:0:14327:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c3e00/0xf4f48ce5e1bc0245 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a381b expref: 6 pid: 14327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049627.547498:0:14327:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8cb8c396d500) 00010000:00010000:1.0:1789049627.547500:0:14327:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1789049627.547504:0:14327:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cb8c28c3e00, rc 0) 00000100:00080000:0.0:1789049627.547524:0:14324:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789049627.547548:0:14327:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8f7acaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:45abea75-ce99-406c-bba5-a167dc77aef6+6:14402:x1875954089706496:12345-192.168.206.26@tcp:101:lfs.0 Request processed in 290us (430us total) trans 0 rc 0/0 00000100:00100000:1.0:1789049627.547555:0:14327:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.26@tcp, seq: 21 00000100:00100000:3.0:1789049627.560451:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.26@tcp (source: 12345-192.168.206.26@tcp) 00000100:00100000:0.0:1789049627.560568:0:14329:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954089706624 00000100:00100000:0.0:1789049627.560577:0:14329:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954089706624 00000100:00100000:0.0:1789049627.560636:0:14329:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.26@tcp, seq: 22 00000100:00100000:0.0:1789049627.560647:0:14329:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8df4d2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:45abea75-ce99-406c-bba5-a167dc77aef6+6:14402:x1875954089706624:12345-192.168.206.26@tcp:101:lfs.0 00010000:00010000:0.0:1789049627.560666:0:14329:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789049627.560683:0:14329:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d776f000/0xf4f48ce5e1bc024c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7fc5e358805a3822 expref: -99 pid: 14329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049627.560751:0:14329:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d776fc00/0xf4f48ce5e1bc0253 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049627.560765:0:14329:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d776fc00/0xf4f48ce5e1bc0253 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049627.560777:0:14329:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d776fc00/0xf4f48ce5e1bc0253 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049627.560791:0:14329:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d776ea00/0xf4f48ce5e1bc025a lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049627.560798:0:14329:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d776ea00/0xf4f48ce5e1bc025a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049627.560814:0:14329:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d776ea00/0xf4f48ce5e1bc025a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049627.560989:0:14329:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d776f400/0xf4f48ce5e1bc0261 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049627.561013:0:14329:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d776f400/0xf4f48ce5e1bc0261 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049627.561021:0:14329:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d776f400/0xf4f48ce5e1bc0261 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14329 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789049627.561049:0:14329:0:(mdt_handler.c:922:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00000004:00200000:0.0:1789049627.561052:0:14329:0:(mdt_handler.c:1587:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1789049627.561068:0:14329:0:(mdt_handler.c:2522:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d776f400/0xf4f48ce5e1bc0261 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049627.561079:0:14329:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d776fc00/0xf4f48ce5e1bc0253 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049627.561086:0:14329:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d776fc00/0xf4f48ce5e1bc0253 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049627.561093:0:14329:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d776fc00/0xf4f48ce5e1bc0253 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049627.561099:0:14329:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cb8d776fc00 already unused, calling callback (ffffffffc20ca4f0) 00010000:00010000:0.0:1789049627.561103:0:14329:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d776fc00/0xf4f48ce5e1bc0253 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049627.561110:0:14329:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d776fc00/0xf4f48ce5e1bc0253 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049627.561121:0:14329:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8cb8c396d500) 00010000:00010000:0.0:1789049627.561124:0:14329:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789049627.561128:0:14329:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d776fc00/0xf4f48ce5e1bc0253 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049627.561143:0:14329:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d776fc00/0xf4f48ce5e1bc0253 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049627.561157:0:14329:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d776ea00/0xf4f48ce5e1bc025a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049627.561163:0:14329:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d776ea00/0xf4f48ce5e1bc025a lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049627.561169:0:14329:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d776ea00/0xf4f48ce5e1bc025a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049627.561173:0:14329:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cb8d776ea00 already unused, calling callback (ffffffffc20ca4f0) 00010000:00010000:0.0:1789049627.561176:0:14329:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d776ea00/0xf4f48ce5e1bc025a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049627.561182:0:14329:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d776ea00/0xf4f48ce5e1bc025a lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049627.561188:0:14329:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff8cb8ce751300) 00010000:00010000:0.0:1789049627.561191:0:14329:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789049627.561194:0:14329:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d776ea00/0xf4f48ce5e1bc025a lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049627.561199:0:14329:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d776ea00/0xf4f48ce5e1bc025a lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049627.561244:0:14329:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d776f000/0xf4f48ce5e1bc024c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a3822 expref: 8 pid: 14329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049627.561269:0:14329:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d776f400/0xf4f48ce5e1bc0261 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a3822 expref: 7 pid: 14329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049627.561277:0:14329:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8cb8ce751a00) 00010000:00010000:0.0:1789049627.561279:0:14329:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1789049627.561282:0:14329:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cb8d776f400, rc 0) 00000100:00100000:0.0:1789049627.561342:0:14329:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8df4d2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:45abea75-ce99-406c-bba5-a167dc77aef6+7:14402:x1875954089706624:12345-192.168.206.26@tcp:101:lfs.0 Request processed in 697us (903us total) trans 0 rc 0/0 00000100:00100000:0.0:1789049627.561351:0:14329:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.26@tcp, seq: 22 00000100:00100000:3.0:1789049627.589893:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.26@tcp (source: 12345-192.168.206.26@tcp) 00000100:00100000:0.0:1789049627.589973:0:16306:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954089706880 00000100:00100000:0.0:1789049627.589984:0:16306:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954089706880 00000100:00100000:0.0:1789049627.590082:0:16306:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.26@tcp, seq: 23 00000100:00100000:0.0:1789049627.590093:0:16306:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8df4d3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:45abea75-ce99-406c-bba5-a167dc77aef6+7:14402:x1875954089706880:12345-192.168.206.26@tcp:101:lfs.0 00010000:00010000:0.0:1789049627.590113:0:16306:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789049627.590133:0:16306:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d776f000/0xf4f48ce5e1bc0268 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7fc5e358805a3829 expref: -99 pid: 16306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789049627.590247:0:16306:0:(mdt_handler.c:922:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00010000:00010000:0.0:1789049627.590730:0:16306:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d776f000/0xf4f48ce5e1bc0268 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a3829 expref: 9 pid: 16306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049627.590744:0:16306:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8cb8c396d500) 00010000:00010000:0.0:1789049627.590748:0:16306:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1789049627.590754:0:16306:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d776f000/0xf4f48ce5e1bc0268 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a3829 expref: 9 pid: 16306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049627.590786:0:16306:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cb8d776f000, rc 0) 00000100:00100000:0.0:1789049627.590886:0:16306:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8df4d3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:45abea75-ce99-406c-bba5-a167dc77aef6+8:14402:x1875954089706880:12345-192.168.206.26@tcp:101:lfs.0 Request processed in 794us (999us total) trans 8589934595 rc 301/301 00000100:00100000:0.0:1789049627.590954:0:16306:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.26@tcp, seq: 23 00000100:00100000:2.0:1789049627.599276:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.26@tcp (source: 12345-192.168.206.26@tcp) 00000100:00100000:1.0:1789049627.599414:0:14327:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954089707136 00000100:00100000:1.0:1789049627.599435:0:14327:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954089707136 00000100:00100000:1.0:1789049627.599493:0:14327:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.26@tcp, seq: 24 00000100:00100000:1.0:1789049627.599503:0:14327:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8f7acb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:45abea75-ce99-406c-bba5-a167dc77aef6+8:14402:x1875954089707136:12345-192.168.206.26@tcp:36:lfs.0 00010000:00010000:1.0:1789049627.599562:0:14327:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789049627.599589:0:14327:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d776f400/0xf4f48ce5e1bc0261 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a3822 expref: 8 pid: 14329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049627.599610:0:14327:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8cb8ce751a00) 00010000:00010000:1.0:1789049627.599620:0:14327:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789049627.599654:0:14327:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c3800/0xf4f48ce5e1bc0276 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049627.599667:0:14327:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c3800/0xf4f48ce5e1bc0276 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049627.599677:0:14327:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c3800/0xf4f48ce5e1bc0276 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14327 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789049627.600088:0:14327:0:(mdt_handler.c:4507:mdt_save_lock()) ### save lock request 000000003c1eb79b reply state 00000000d671a9bc transno 8589934596 ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c3800/0xf4f48ce5e1bc0276 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14327 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789049627.600098:0:14327:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:1.0:1789049627.600107:0:14327:0:(mdt_handler.c:922:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00000100:00100000:1.0:1789049627.600184:0:14327:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8f7acb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:45abea75-ce99-406c-bba5-a167dc77aef6+9:14402:x1875954089707136:12345-192.168.206.26@tcp:36:lfs.0 Request processed in 682us (916us total) trans 8589934596 rc 0/0 00000100:00100000:1.0:1789049627.600192:0:14327:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.26@tcp, seq: 24 00010000:00010000:0.0:1789049627.603816:0:3295:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c3800/0xf4f48ce5e1bc0276 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049627.603869:0:3295:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c3800/0xf4f48ce5e1bc0276 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049627.603879:0:3295:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c3800/0xf4f48ce5e1bc0276 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049627.603886:0:3295:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cb8c28c3800 already unused, calling callback (ffffffffc20ca4f0) 00010000:00010000:0.0:1789049627.603890:0:3295:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c3800/0xf4f48ce5e1bc0276 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049627.603898:0:3295:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c3800/0xf4f48ce5e1bc0276 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049627.603914:0:3295:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8cb8c396d300) 00010000:00010000:0.0:1789049627.603917:0:3295:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00010000:00010000:0.0:1789049627.603921:0:3295:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c3800/0xf4f48ce5e1bc0276 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049627.603928:0:3295:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c3800/0xf4f48ce5e1bc0276 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14327 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789049627.608059:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.26@tcp (source: 12345-192.168.206.26@tcp) 00000100:00100000:1.0:1789049627.608332:0:14330:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954089707392 00000100:00100000:1.0:1789049627.608343:0:14330:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954089707392 00000100:00100000:1.0:1789049627.608399:0:14330:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.26@tcp, seq: 2 00000100:00100000:1.0:1789049627.608409:0:14330:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8f7ac9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:45abea75-ce99-406c-bba5-a167dc77aef6+8:14402:x1875954089707392:12345-192.168.206.26@tcp:35:lfs.0 00000100:00100000:1.0:1789049627.608656:0:14330:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8f7ac9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:45abea75-ce99-406c-bba5-a167dc77aef6+9:14402:x1875954089707392:12345-192.168.206.26@tcp:35:lfs.0 Request processed in 249us (606us total) trans 8589934597 rc 0/0 00000100:00100000:1.0:1789049627.608664:0:14330:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.26@tcp, seq: 2 00000100:00100000:3.0:1789049627.619279:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.26@tcp (source: 12345-192.168.206.26@tcp) 00000100:00100000:1.0:1789049627.620246:0:16204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954089707648 00000100:00100000:1.0:1789049627.620257:0:16204:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954089707648 00000100:00100000:1.0:1789049627.620467:0:16204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.26@tcp, seq: 25 00000100:00100000:1.0:1789049627.620478:0:16204:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8df4d2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:45abea75-ce99-406c-bba5-a167dc77aef6+9:14402:x1875954089707648:12345-192.168.206.26@tcp:101:lfs.0 00010000:00010000:1.0:1789049627.620514:0:16204:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789049627.620541:0:16204:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c2c00/0xf4f48ce5e1bc027d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7fc5e358805a3830 expref: -99 pid: 16204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049627.620616:0:16204:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c3c00/0xf4f48ce5e1bc0284 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 16204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049627.620642:0:16204:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c3c00/0xf4f48ce5e1bc0284 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 16204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049627.620654:0:16204:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c3c00/0xf4f48ce5e1bc0284 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 16204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049627.620680:0:16204:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c3200/0xf4f48ce5e1bc028b lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 16204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049627.620687:0:16204:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c3200/0xf4f48ce5e1bc028b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049627.620694:0:16204:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c3200/0xf4f48ce5e1bc028b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16204 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789049627.620810:0:16204:0:(mdt_handler.c:922:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00010000:00010000:1.0:1789049627.620935:0:16204:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c3c00/0xf4f48ce5e1bc0284 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 16204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049627.620944:0:16204:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c3c00/0xf4f48ce5e1bc0284 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 16204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049627.620950:0:16204:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c3c00/0xf4f48ce5e1bc0284 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 16204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049627.620956:0:16204:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cb8c28c3c00 already unused, calling callback (ffffffffc20ca4f0) 00010000:00010000:1.0:1789049627.620961:0:16204:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c3c00/0xf4f48ce5e1bc0284 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 16204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049627.620968:0:16204:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c3c00/0xf4f48ce5e1bc0284 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 16204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049627.620979:0:16204:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8cb8c396d500) 00010000:00010000:1.0:1789049627.620982:0:16204:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789049627.620987:0:16204:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c3c00/0xf4f48ce5e1bc0284 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 16204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049627.620993:0:16204:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c3c00/0xf4f48ce5e1bc0284 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 16204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049627.621003:0:16204:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c3200/0xf4f48ce5e1bc028b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049627.621008:0:16204:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c3200/0xf4f48ce5e1bc028b lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 16204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049627.621013:0:16204:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c3200/0xf4f48ce5e1bc028b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049627.621027:0:16204:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cb8c28c3200 already unused, calling callback (ffffffffc20ca4f0) 00010000:00010000:1.0:1789049627.621031:0:16204:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c3200/0xf4f48ce5e1bc028b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049627.621036:0:16204:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c3200/0xf4f48ce5e1bc028b lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 16204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049627.621043:0:16204:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff8cb8c396de00) 00010000:00010000:1.0:1789049627.621046:0:16204:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789049627.621048:0:16204:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c3200/0xf4f48ce5e1bc028b lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049627.621054:0:16204:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c3200/0xf4f48ce5e1bc028b lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049627.621089:0:16204:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c2c00/0xf4f48ce5e1bc027d lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a3830 expref: 11 pid: 16204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049627.621111:0:16204:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8cb8c396d500) 00010000:00010000:1.0:1789049627.621113:0:16204:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1789049627.621117:0:16204:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c2c00/0xf4f48ce5e1bc027d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a3830 expref: 11 pid: 16204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049627.621126:0:16204:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cb8c28c2c00, rc 0) 00000100:00100000:1.0:1789049627.621198:0:16204:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8df4d2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:45abea75-ce99-406c-bba5-a167dc77aef6+10:14402:x1875954089707648:12345-192.168.206.26@tcp:101:lfs.0 Request processed in 721us (1926us total) trans 8589934598 rc 301/301 00000100:00100000:1.0:1789049627.621220:0:16204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.26@tcp, seq: 25 00000100:00100000:3.0:1789049627.626085:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.26@tcp (source: 12345-192.168.206.26@tcp) 00000100:00100000:0.0:1789049627.627064:0:16306:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954089707776 00000100:00100000:0.0:1789049627.627088:0:16306:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954089707776 00000100:00100000:0.0:1789049627.627183:0:16306:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.26@tcp, seq: 26 00000100:00100000:0.0:1789049627.627193:0:16306:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8df4d1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:45abea75-ce99-406c-bba5-a167dc77aef6+10:14402:x1875954089707776:12345-192.168.206.26@tcp:101:lfs.0 00010000:00010000:0.0:1789049627.627228:0:16306:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789049627.627251:0:16306:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d776f000/0xf4f48ce5e1bc0299 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7fc5e358805a3837 expref: -99 pid: 16306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049627.627349:0:16306:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d776ea00/0xf4f48ce5e1bc02a0 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 16306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049627.627362:0:16306:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d776ea00/0xf4f48ce5e1bc02a0 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 16306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049627.627374:0:16306:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d776ea00/0xf4f48ce5e1bc02a0 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 16306 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789049627.627396:0:16306:0:(mdt_handler.c:922:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00000004:00200000:0.0:1789049627.627399:0:16306:0:(mdt_handler.c:1587:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1789049627.627413:0:16306:0:(mdt_handler.c:2522:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d776ea00/0xf4f48ce5e1bc02a0 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 16306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049627.627435:0:16306:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d776f000/0xf4f48ce5e1bc0299 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a3837 expref: 12 pid: 16306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049627.627452:0:16306:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d776ea00/0xf4f48ce5e1bc02a0 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a3837 expref: 11 pid: 16306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049627.627460:0:16306:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8cb8ce751300) 00010000:00010000:0.0:1789049627.627462:0:16306:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1789049627.627465:0:16306:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cb8d776ea00, rc 0) 00000100:00100000:0.0:1789049627.627561:0:16306:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8df4d1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:45abea75-ce99-406c-bba5-a167dc77aef6+11:14402:x1875954089707776:12345-192.168.206.26@tcp:101:lfs.0 Request processed in 369us (1485us total) trans 0 rc 0/0 00000100:00100000:0.0:1789049627.627569:0:16306:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.26@tcp, seq: 26 00000100:00100000:3.0:1789049627.632618:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.26@tcp (source: 12345-192.168.206.26@tcp) 00000100:00100000:1.0:1789049627.632733:0:14330:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954089707904 00000100:00100000:1.0:1789049627.632760:0:14330:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954089707904 00000100:00100000:1.0:1789049627.632818:0:14330:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.26@tcp, seq: 3 00000100:00100000:1.0:1789049627.632829:0:14330:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8df4d0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:45abea75-ce99-406c-bba5-a167dc77aef6+11:14402:x1875954089707904:12345-192.168.206.26@tcp:37:lfs.0 00000100:00100000:1.0:1789049627.644453:0:14330:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8df4d0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:45abea75-ce99-406c-bba5-a167dc77aef6+11:14402:x1875954089707904:12345-192.168.206.26@tcp:37:lfs.0 Request processed in 11617us (11839us total) trans 0 rc 0/0 00000100:00100000:1.0:1789049627.644466:0:14330:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.26@tcp, seq: 3 00000100:00100000:3.0:1789049627.653820:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.26@tcp (source: 12345-192.168.206.26@tcp) 00000100:00100000:2.0:1789049627.654007:0:14331:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954089708160 00000100:00100000:2.0:1789049627.654017:0:14331:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954089708160 00000100:00100000:2.0:1789049627.654078:0:14331:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.26@tcp, seq: 4 00000100:00100000:2.0:1789049627.654088:0:14331:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8db324c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:45abea75-ce99-406c-bba5-a167dc77aef6+11:14402:x1875954089708160:12345-192.168.206.26@tcp:35:lfs.0 00000100:00100000:2.0:1789049627.654326:0:14331:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8db324c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:45abea75-ce99-406c-bba5-a167dc77aef6+12:14402:x1875954089708160:12345-192.168.206.26@tcp:35:lfs.0 Request processed in 239us (514us total) trans 8589934599 rc 0/0 00000100:00100000:2.0:1789049627.654351:0:14331:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.26@tcp, seq: 4 00000100:00100000:2.0:1789049627.720610:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.26@tcp (source: 12345-192.168.206.26@tcp) 00000100:00100000:0.0:1789049627.720734:0:14329:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954089708288 00000100:00100000:0.0:1789049627.720745:0:14329:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954089708288 00000100:00100000:0.0:1789049627.720811:0:14329:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.26@tcp, seq: 27 00000100:00100000:0.0:1789049627.720823:0:14329:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8f7ac9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b76d50d5-035a-43d0-9ba1-e61b094296a4+10:14408:x1875954089708288:12345-192.168.206.26@tcp:101:bash.0 00010000:00010000:0.0:1789049627.720917:0:14329:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789049627.720983:0:14329:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d776f000/0xf4f48ce5e1bc02a7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7fc5e358805a383e expref: -99 pid: 14329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049627.721049:0:14329:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d776fc00/0xf4f48ce5e1bc02ae lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049627.721063:0:14329:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d776fc00/0xf4f48ce5e1bc02ae lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049627.721076:0:14329:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d776fc00/0xf4f48ce5e1bc02ae lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049627.721091:0:14329:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d776fa00/0xf4f48ce5e1bc02b5 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049627.721098:0:14329:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d776fa00/0xf4f48ce5e1bc02b5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049627.721105:0:14329:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d776fa00/0xf4f48ce5e1bc02b5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049627.721196:0:14329:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d776f200/0xf4f48ce5e1bc02bc lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049627.721231:0:14329:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d776f200/0xf4f48ce5e1bc02bc lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049627.721240:0:14329:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d776f200/0xf4f48ce5e1bc02bc lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14329 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789049627.721269:0:14329:0:(mdt_handler.c:922:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00000004:00200000:0.0:1789049627.721272:0:14329:0:(mdt_handler.c:1587:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1789049627.721323:0:14329:0:(mdt_handler.c:2522:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d776f200/0xf4f48ce5e1bc02bc lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049627.721335:0:14329:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d776fc00/0xf4f48ce5e1bc02ae lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049627.721342:0:14329:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d776fc00/0xf4f48ce5e1bc02ae lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049627.721348:0:14329:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d776fc00/0xf4f48ce5e1bc02ae lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049627.721355:0:14329:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cb8d776fc00 already unused, calling callback (ffffffffc20ca4f0) 00010000:00010000:0.0:1789049627.721359:0:14329:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d776fc00/0xf4f48ce5e1bc02ae lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049627.721366:0:14329:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d776fc00/0xf4f48ce5e1bc02ae lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049627.721378:0:14329:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8cb8c396d500) 00010000:00010000:0.0:1789049627.721381:0:14329:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789049627.721386:0:14329:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d776fc00/0xf4f48ce5e1bc02ae lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049627.721403:0:14329:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d776fc00/0xf4f48ce5e1bc02ae lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049627.721418:0:14329:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d776fa00/0xf4f48ce5e1bc02b5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049627.721424:0:14329:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d776fa00/0xf4f48ce5e1bc02b5 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049627.721430:0:14329:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d776fa00/0xf4f48ce5e1bc02b5 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049627.721435:0:14329:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cb8d776fa00 already unused, calling callback (ffffffffc20ca4f0) 00010000:00010000:0.0:1789049627.721438:0:14329:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d776fa00/0xf4f48ce5e1bc02b5 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049627.721444:0:14329:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d776fa00/0xf4f48ce5e1bc02b5 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049627.721452:0:14329:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff8cb8ce751b00) 00010000:00010000:0.0:1789049627.721455:0:14329:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789049627.721458:0:14329:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d776fa00/0xf4f48ce5e1bc02b5 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049627.721464:0:14329:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d776fa00/0xf4f48ce5e1bc02b5 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049627.721495:0:14329:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d776f000/0xf4f48ce5e1bc02a7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a383e expref: 12 pid: 14329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049627.721778:0:14329:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d776f200/0xf4f48ce5e1bc02bc lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a383e expref: 11 pid: 14329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049627.721786:0:14329:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8cb8ce751300) 00010000:00010000:0.0:1789049627.721789:0:14329:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1789049627.721792:0:14329:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cb8d776f200, rc 0) 00000100:00100000:0.0:1789049627.721907:0:14329:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8f7ac9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b76d50d5-035a-43d0-9ba1-e61b094296a4+11:14408:x1875954089708288:12345-192.168.206.26@tcp:101:bash.0 Request processed in 1086us (1306us total) trans 0 rc 0/0 00000100:00100000:0.0:1789049627.721915:0:14329:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.26@tcp, seq: 27 00000100:00100000:3.0:1789049627.737454:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.26@tcp (source: 12345-192.168.206.26@tcp) 00000100:00100000:1.0:1789049627.737693:0:16204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954089708544 00000100:00100000:1.0:1789049627.737702:0:16204:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954089708544 00000100:00100000:1.0:1789049627.737767:0:16204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.26@tcp, seq: 28 00000100:00100000:1.0:1789049627.737777:0:16204:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8df4d2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b76d50d5-035a-43d0-9ba1-e61b094296a4+11:14408:x1875954089708544:12345-192.168.206.26@tcp:101:bash.0 00010000:00010000:1.0:1789049627.737797:0:16204:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789049627.737816:0:16204:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c2c00/0xf4f48ce5e1bc02c3 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7fc5e358805a3845 expref: -99 pid: 16204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049627.737962:0:16204:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c3200/0xf4f48ce5e1bc02ca lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 16204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049627.737978:0:16204:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d776ea00/0xf4f48ce5e1bc02a0 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a3837 expref: 11 pid: 16306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049627.737987:0:16204:0:(ldlm_resource.c:1751:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c3200/0xf4f48ce5e1bc02ca lrc: 4/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 16204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049627.738033:0:16204:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d776ea00/0xf4f48ce5e1bc02a0 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a3837 expref: 11 pid: 16306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049627.738321:0:16204:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d776ea00/0xf4f48ce5e1bc02a0 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a3837 expref: 11 pid: 16306 timeout: 553 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789049627.738356:0:16204:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb900e41f80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:16204:1875954110665856:192.168.206.26@tcp:104: 00000100:00100000:1.0:1789049627.738517:0:16204:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cb7c6d8f180 going to sleep for 11 seconds 00010000:00010000:1.0:1789049627.740480:0:14317:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789049627.748624:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.26@tcp (source: 12345-192.168.206.26@tcp) 00000100:00100000:0.0:1789049627.748899:0:14315:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954089708672 00000100:00100000:0.0:1789049627.748908:0:14315:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954089708672 00010000:00010000:0.0:1789049627.748953:0:14315:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d776ea00/0xf4f48ce5e1bc02a0 lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a3837 expref: 12 pid: 16306 timeout: 553 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789049627.749002:0:14315:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.26@tcp, seq: 10 00000100:00100000:0.0:1789049627.749012:0:14315:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8df4d3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:45abea75-ce99-406c-bba5-a167dc77aef6+12:2357:x1875954089708672:12345-192.168.206.26@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789049627.749047:0:14315:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789049627.749055:0:14315:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d776ea00/0xf4f48ce5e1bc02a0 lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a3837 expref: 12 pid: 16306 timeout: 553 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049627.749068:0:14315:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d776ea00/0xf4f48ce5e1bc02a0 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a3837 expref: 12 pid: 16306 timeout: 553 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049627.749089:0:14315:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8cb8ce751300) 00010000:00010000:0.0:1789049627.749094:0:14315:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c3200/0xf4f48ce5e1bc02ca lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 16204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049627.749119:0:14315:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c3200/0xf4f48ce5e1bc02ca lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 16204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049627.749127:0:14315:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c3200/0xf4f48ce5e1bc02ca lrc: 4/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 16204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049627.749147:0:14315:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789049627.749210:0:14315:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8df4d3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:45abea75-ce99-406c-bba5-a167dc77aef6+12:2357:x1875954089708672:12345-192.168.206.26@tcp:103:ldlm_bl.0 Request processed in 191us (586us total) trans 0 rc 0/0 00000100:00100000:0.0:1789049627.749218:0:14315:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.26@tcp, seq: 10 00010000:00010000:1.0:1789049627.749399:0:16204:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d776ea00/0xf4f48ce5e1bc02a0 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a3837 expref: 11 pid: 16306 timeout: 553 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789049627.749418:0:16204:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb900e41f80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:16204:1875954110665856:192.168.206.26@tcp:104: 00010000:00010000:1.0:1789049627.749440:0:16204:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c3200/0xf4f48ce5e1bc02ca lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 16204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049627.749449:0:16204:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c3200/0xf4f48ce5e1bc02ca lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 16204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049627.749454:0:16204:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c3200/0xf4f48ce5e1bc02ca lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 16204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049627.749518:0:16204:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c3c00/0xf4f48ce5e1bc02d1 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 16204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049627.749528:0:16204:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c3c00/0xf4f48ce5e1bc02d1 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049627.749536:0:16204:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c3c00/0xf4f48ce5e1bc02d1 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049627.750530:0:16204:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c3800/0xf4f48ce5e1bc02d8 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 16204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049627.750542:0:16204:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c3800/0xf4f48ce5e1bc02d8 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049627.751626:0:16204:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c3800/0xf4f48ce5e1bc02d8 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16204 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789049627.751640:0:16204:0:(mdt_handler.c:922:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:1.0:1789049627.752452:0:16204:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c3200/0xf4f48ce5e1bc02ca lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 16204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049627.752462:0:16204:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c3200/0xf4f48ce5e1bc02ca lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 16204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049627.752469:0:16204:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c3200/0xf4f48ce5e1bc02ca lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 16204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049627.752474:0:16204:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cb8c28c3200 already unused, calling callback (ffffffffc20ca4f0) 00010000:00010000:1.0:1789049627.752478:0:16204:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c3200/0xf4f48ce5e1bc02ca lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 16204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049627.752486:0:16204:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c3200/0xf4f48ce5e1bc02ca lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 16204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049627.752498:0:16204:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8cb8ce751300) 00010000:00010000:1.0:1789049627.752501:0:16204:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789049627.752505:0:16204:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c3200/0xf4f48ce5e1bc02ca lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 16204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049627.752510:0:16204:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c3200/0xf4f48ce5e1bc02ca lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 16204 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789049627.752526:0:16204:0:(mdt_handler.c:4507:mdt_save_lock()) ### save lock request 000000006de95790 reply state 00000000f578a14b transno 8589934600 ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c3c00/0xf4f48ce5e1bc02d1 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16204 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789049627.752984:0:16204:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1789049627.753033:0:16204:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c2c00/0xf4f48ce5e1bc02c3 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a3845 expref: 14 pid: 16204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049627.753048:0:16204:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c3800/0xf4f48ce5e1bc02d8 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a3845 expref: 13 pid: 16204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049627.753056:0:16204:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8cb8c396d100) 00010000:00010000:1.0:1789049627.753058:0:16204:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 9 00010000:00010000:1.0:1789049627.753060:0:16204:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cb8c28c3800, rc 0) 00000100:00100000:1.0:1789049627.753151:0:16204:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8df4d2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b76d50d5-035a-43d0-9ba1-e61b094296a4+14:14408:x1875954089708544:12345-192.168.206.26@tcp:101:bash.0 Request processed in 15375us (15705us total) trans 8589934600 rc 0/0 00000100:00100000:1.0:1789049627.753160:0:16204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.26@tcp, seq: 28 00010000:00010000:1.0:1789049627.758996:0:3294:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c3c00/0xf4f48ce5e1bc02d1 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049627.759012:0:3294:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c3c00/0xf4f48ce5e1bc02d1 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 16204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049627.759174:0:3294:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c3c00/0xf4f48ce5e1bc02d1 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049627.759180:0:3294:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cb8c28c3c00 already unused, calling callback (ffffffffc20ca4f0) 00010000:00010000:1.0:1789049627.759184:0:3294:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c3c00/0xf4f48ce5e1bc02d1 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049627.759192:0:3294:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c3c00/0xf4f48ce5e1bc02d1 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 16204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049627.759230:0:3294:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff8cb8c396de00) 00010000:00010000:1.0:1789049627.759233:0:3294:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789049627.759238:0:3294:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c3c00/0xf4f48ce5e1bc02d1 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049627.759245:0:3294:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c3c00/0xf4f48ce5e1bc02d1 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16204 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789049627.776602:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.26@tcp (source: 12345-192.168.206.26@tcp) 00000100:00100000:0.0:1789049627.776778:0:16306:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954089708800 00000100:00100000:0.0:1789049627.776789:0:16306:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954089708800 00000100:00100000:0.0:1789049627.776885:0:16306:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.26@tcp, seq: 29 00000100:00100000:0.0:1789049627.776896:0:16306:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8df4d3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b76d50d5-035a-43d0-9ba1-e61b094296a4+13:14408:x1875954089708800:12345-192.168.206.26@tcp:101:bash.0 00010000:00010000:0.0:1789049627.776919:0:16306:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789049627.776938:0:16306:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d776f000/0xf4f48ce5e1bc02e6 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7fc5e358805a384c expref: -99 pid: 16306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049627.777005:0:16306:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d776fa00/0xf4f48ce5e1bc02ed lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 16306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049627.777217:0:16306:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d776fa00/0xf4f48ce5e1bc02ed lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 16306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049627.777230:0:16306:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d776fa00/0xf4f48ce5e1bc02ed lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 16306 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789049627.777269:0:16306:0:(mdt_handler.c:922:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:0.0:1789049627.777273:0:16306:0:(mdt_handler.c:1587:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1789049627.777407:0:16306:0:(mdt_handler.c:2522:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d776fa00/0xf4f48ce5e1bc02ed lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 16306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049627.777418:0:16306:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d776fa00/0xf4f48ce5e1bc02ed lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 16306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049627.777443:0:16306:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d776f000/0xf4f48ce5e1bc02e6 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a384c expref: 15 pid: 16306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049627.777460:0:16306:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d776fa00/0xf4f48ce5e1bc02ed lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a384c expref: 14 pid: 16306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049627.777468:0:16306:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8cb8c396d100) 00010000:00010000:0.0:1789049627.777471:0:16306:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789049627.777474:0:16306:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cb8d776fa00, rc 0) 00000100:00100000:0.0:1789049627.777595:0:16306:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8df4d3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b76d50d5-035a-43d0-9ba1-e61b094296a4+14:14408:x1875954089708800:12345-192.168.206.26@tcp:101:bash.0 Request processed in 701us (1003us total) trans 0 rc 0/0 00000100:00100000:0.0:1789049627.777603:0:16306:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.26@tcp, seq: 29 00000100:00100000:0.0:1789049627.787829:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.26@tcp (source: 12345-192.168.206.26@tcp) 00000100:00100000:2.0:1789049627.787966:0:14331:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954089709056 00000100:00100000:2.0:1789049627.787975:0:14331:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954089709056 00000100:00100000:2.0:1789049627.788132:0:14331:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.26@tcp, seq: 5 00000100:00100000:2.0:1789049627.788143:0:14331:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb9009c3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b76d50d5-035a-43d0-9ba1-e61b094296a4+14:14408:x1875954089709056:12345-192.168.206.26@tcp:35:bash.0 00000001:00080000:2.0:1789049627.788424:0:14331:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934601 00000100:00100000:2.0:1789049627.788550:0:14331:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb9009c3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b76d50d5-035a-43d0-9ba1-e61b094296a4+16:14408:x1875954089709056:12345-192.168.206.26@tcp:35:bash.0 Request processed in 401us (721us total) trans 8589934602 rc 0/0 00000100:00100000:2.0:1789049627.788559:0:14331:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.26@tcp, seq: 5 00000020:00080000:2.0:1789049627.788563:0:14331:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1789049627.923345:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.26@tcp (source: 12345-192.168.206.26@tcp) 00000100:00100000:0.0:1789049627.923445:0:14328:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954089709312 00000100:00100000:0.0:1789049627.923454:0:14328:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954089709312 00000100:00100000:0.0:1789049627.923514:0:14328:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.26@tcp, seq: 30 00000100:00100000:0.0:1789049627.923525:0:14328:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8f7ac8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b76d50d5-035a-43d0-9ba1-e61b094296a4+16:14418:x1875954089709312:12345-192.168.206.26@tcp:101:lfs.0 00010000:00010000:0.0:1789049627.923547:0:14328:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789049627.923575:0:14328:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d776f000/0xf4f48ce5e1bc02f4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7fc5e358805a3853 expref: -99 pid: 14328 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789049627.923656:0:14328:0:(mdt_handler.c:922:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00010000:00010000:0.0:1789049627.923779:0:14328:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d776f000/0xf4f48ce5e1bc02f4 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a3853 expref: 18 pid: 14328 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049627.923808:0:14328:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8cb8c396d500) 00010000:00010000:0.0:1789049627.923810:0:14328:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1789049627.923816:0:14328:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d776f000/0xf4f48ce5e1bc02f4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a3853 expref: 18 pid: 14328 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049627.923830:0:14328:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cb8d776f000, rc 0) 00000100:00100000:0.0:1789049627.923931:0:14328:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8f7ac8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b76d50d5-035a-43d0-9ba1-e61b094296a4+17:14418:x1875954089709312:12345-192.168.206.26@tcp:101:lfs.0 Request processed in 408us (595us total) trans 8589934603 rc 301/301 00000100:00100000:0.0:1789049627.923938:0:14328:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.26@tcp, seq: 30 00000100:00100000:3.0:1789049627.933138:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.26@tcp (source: 12345-192.168.206.26@tcp) 00000100:00100000:1.0:1789049627.933289:0:14330:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954089709568 00000100:00100000:1.0:1789049627.933299:0:14330:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954089709568 00000100:00100000:1.0:1789049627.933360:0:14330:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.26@tcp, seq: 6 00000100:00100000:1.0:1789049627.933371:0:14330:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8df4d0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b76d50d5-035a-43d0-9ba1-e61b094296a4+17:14418:x1875954089709568:12345-192.168.206.26@tcp:35:lfs.0 00000100:00100000:1.0:1789049627.933599:0:14330:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8df4d0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b76d50d5-035a-43d0-9ba1-e61b094296a4+18:14418:x1875954089709568:12345-192.168.206.26@tcp:35:lfs.0 Request processed in 229us (469us total) trans 8589934604 rc 0/0 00000100:00100000:1.0:1789049627.933607:0:14330:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.26@tcp, seq: 6 00000100:00100000:3.0:1789049627.977243:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.26@tcp (source: 12345-192.168.206.26@tcp) 00000100:00100000:1.0:1789049627.977361:0:16204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954089709824 00000100:00100000:1.0:1789049627.977370:0:16204:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954089709824 00000100:00100000:1.0:1789049627.977425:0:16204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.26@tcp, seq: 31 00000100:00100000:1.0:1789049627.977434:0:16204:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8df4d0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b76d50d5-035a-43d0-9ba1-e61b094296a4+18:14421:x1875954089709824:12345-192.168.206.26@tcp:101:lfs.0 00010000:00010000:1.0:1789049627.977457:0:16204:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789049627.977474:0:16204:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c3c00/0xf4f48ce5e1bc0302 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7fc5e358805a385a expref: -99 pid: 16204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049627.977572:0:16204:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c2c00/0xf4f48ce5e1bc0309 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 16204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049627.977586:0:16204:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c2c00/0xf4f48ce5e1bc0309 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 16204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049627.977606:0:16204:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c2c00/0xf4f48ce5e1bc0309 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 16204 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789049627.977619:0:16204:0:(mdt_handler.c:922:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:1.0:1789049627.977752:0:16204:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c3c00/0xf4f48ce5e1bc0302 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a385a expref: 21 pid: 16204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049627.977770:0:16204:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c2c00/0xf4f48ce5e1bc0309 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a385a expref: 20 pid: 16204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049627.977778:0:16204:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8cb8c396d100) 00010000:00010000:1.0:1789049627.977781:0:16204:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789049627.977784:0:16204:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cb8c28c2c00, rc 0) 00000100:00100000:1.0:1789049627.977980:0:16204:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8df4d0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b76d50d5-035a-43d0-9ba1-e61b094296a4+20:14421:x1875954089709824:12345-192.168.206.26@tcp:101:lfs.0 Request processed in 546us (745us total) trans 8589934605 rc 0/0 00000100:00100000:1.0:1789049627.977988:0:16204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.26@tcp, seq: 31 00000100:00100000:3.0:1789049627.983460:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.26@tcp (source: 12345-192.168.206.26@tcp) 00000100:00100000:3.0:1789049627.983501:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.26@tcp (source: 12345-192.168.206.26@tcp) 00000100:00100000:2.0:1789049627.983579:0:16447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954089709952 00000100:00100000:2.0:1789049627.983588:0:16447:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954089709952 00000100:00100000:2.0:1789049627.983640:0:16447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.26@tcp, seq: 0 00000100:00100000:2.0:1789049627.983648:0:16447:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8df4d0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b76d50d5-035a-43d0-9ba1-e61b094296a4+20:2355:x1875954089709952:12345-192.168.206.26@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789049627.983661:0:16447:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789049627.983690:0:16447:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c2c00/0xf4f48ce5e1bc0309 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a385a expref: 20 pid: 16204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049627.983707:0:16447:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8cb8c396d100) 00010000:00010000:2.0:1789049627.983711:0:16447:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789049627.983761:0:16447:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8df4d0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b76d50d5-035a-43d0-9ba1-e61b094296a4+19:2355:x1875954089709952:12345-192.168.206.26@tcp:103:ldlm_bl.0 Request processed in 114us (310us total) trans 0 rc 0/0 00000100:00100000:2.0:1789049627.983768:0:16447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.26@tcp, seq: 0 00000100:00100000:0.0:1789049627.984457:0:16306:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954089710080 00000100:00100000:0.0:1789049627.984462:0:16306:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954089710080 00000100:00100000:0.0:1789049627.984497:0:16306:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.26@tcp, seq: 32 00000100:00100000:0.0:1789049627.984505:0:16306:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8df260a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b76d50d5-035a-43d0-9ba1-e61b094296a4+19:14421:x1875954089710080:12345-192.168.206.26@tcp:54:lfs.0 00010000:00010000:0.0:1789049627.984561:0:16306:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d776fc00/0xf4f48ce5e1bc0317 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 16306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049627.984575:0:16306:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d776fc00/0xf4f48ce5e1bc0317 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 16306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049627.984585:0:16306:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d776fc00/0xf4f48ce5e1bc0317 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 16306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049627.984606:0:16306:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d776fc00/0xf4f48ce5e1bc0317 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 16306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049627.984613:0:16306:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d776fc00/0xf4f48ce5e1bc0317 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 16306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049627.984635:0:16306:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d776fc00/0xf4f48ce5e1bc0317 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 16306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049627.984641:0:16306:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cb8d776fc00 already unused, calling callback (ffffffffc20ca4f0) 00010000:00010000:0.0:1789049627.984645:0:16306:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d776fc00/0xf4f48ce5e1bc0317 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 16306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049627.984653:0:16306:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d776fc00/0xf4f48ce5e1bc0317 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 16306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049627.984661:0:16306:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8cb8c396d100) 00010000:00010000:0.0:1789049627.984663:0:16306:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1789049627.984667:0:16306:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d776fc00/0xf4f48ce5e1bc0317 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 16306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049627.984753:0:16306:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d776fc00/0xf4f48ce5e1bc0317 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 16306 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789049627.985178:0:16306:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8df260a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b76d50d5-035a-43d0-9ba1-e61b094296a4+19:14421:x1875954089710080:12345-192.168.206.26@tcp:54:lfs.0 Request processed in 671us (1673us total) trans 0 rc 0/0 00000100:00100000:0.0:1789049627.985186:0:16306:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.26@tcp, seq: 32 00000100:00100000:3.0:1789049627.987377:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.26@tcp (source: 12345-192.168.206.26@tcp) 00000100:00100000:1.0:1789049627.989320:0:14330:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954089710336 00000100:00100000:1.0:1789049627.989332:0:14330:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954089710336 00000100:00100000:1.0:1789049627.989423:0:14330:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.26@tcp, seq: 7 00000100:00100000:1.0:1789049627.989433:0:14330:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8df261180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b76d50d5-035a-43d0-9ba1-e61b094296a4+19:14421:x1875954089710336:12345-192.168.206.26@tcp:35:lfs.0 00000100:00100000:1.0:1789049627.989665:0:14330:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8df261180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b76d50d5-035a-43d0-9ba1-e61b094296a4+20:14421:x1875954089710336:12345-192.168.206.26@tcp:35:lfs.0 Request processed in 233us (2294us total) trans 8589934606 rc 0/0 00000100:00100000:1.0:1789049627.989681:0:14330:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.26@tcp, seq: 7 00000040:00080000:3.0:1789049628.061440:0:14362:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000001:00080000:3.0:1789049628.110382:0:5872:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934603 is committed 00000001:00080000:3.0:1789049628.110399:0:5872:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934595 is committed 00000001:00080000:3.0:1789049628.110408:0:5872:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934606 is committed 00000001:00080000:3.0:1789049628.110416:0:5872:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934598 is committed 00000001:00080000:3.0:1789049628.110427:0:5872:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934599 is committed 00000100:00100000:3.0:1789049628.302592:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.26@tcp (source: 12345-192.168.206.26@tcp) 00000100:00100000:1.0:1789049628.302742:0:14327:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954089710592 00000100:00100000:1.0:1789049628.302752:0:14327:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954089710592 00000100:00100000:1.0:1789049628.302817:0:14327:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.26@tcp, seq: 33 00000100:00100000:1.0:1789049628.302826:0:14327:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8df263800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b76d50d5-035a-43d0-9ba1-e61b094296a4+11:14452:x1875954089710592:12345-192.168.206.26@tcp:101:cat.0 00010000:00010000:1.0:1789049628.302921:0:14327:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789049628.302944:0:14327:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c3200/0xf4f48ce5e1bc031e lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7fc5e358805a3861 expref: -99 pid: 14327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049628.303049:0:14327:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c2c00/0xf4f48ce5e1bc0325 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049628.303066:0:14327:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c2c00/0xf4f48ce5e1bc0325 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049628.303077:0:14327:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c2c00/0xf4f48ce5e1bc0325 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14327 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789049628.303089:0:14327:0:(mdt_handler.c:922:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:1.0:1789049628.303448:0:14327:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c3200/0xf4f48ce5e1bc031e lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a3861 expref: 14 pid: 14327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049628.303466:0:14327:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c2c00/0xf4f48ce5e1bc0325 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a3861 expref: 13 pid: 14327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049628.303474:0:14327:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8cb8c396d100) 00010000:00010000:1.0:1789049628.303477:0:14327:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789049628.303480:0:14327:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cb8c28c2c00, rc 0) 00000100:00100000:1.0:1789049628.303542:0:14327:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8df263800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b76d50d5-035a-43d0-9ba1-e61b094296a4+13:14452:x1875954089710592:12345-192.168.206.26@tcp:101:cat.0 Request processed in 717us (959us total) trans 8589934607 rc 0/0 00000100:00100000:1.0:1789049628.303557:0:14327:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.26@tcp, seq: 33 00000100:00100000:3.0:1789049628.309185:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.26@tcp (source: 12345-192.168.206.26@tcp) 00000100:00100000:2.0:1789049628.309278:0:14331:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954089710848 00000100:00100000:2.0:1789049628.309301:0:14331:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954089710848 00000100:00100000:2.0:1789049628.309357:0:14331:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.26@tcp, seq: 8 00000100:00100000:2.0:1789049628.309366:0:14331:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8df261880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b76d50d5-035a-43d0-9ba1-e61b094296a4+13:14452:x1875954089710848:12345-192.168.206.26@tcp:35:cat.0 00000001:00080000:2.0:1789049628.309607:0:14331:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934608 00000100:00100000:2.0:1789049628.309703:0:14331:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8df261880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b76d50d5-035a-43d0-9ba1-e61b094296a4+15:14452:x1875954089710848:12345-192.168.206.26@tcp:35:cat.0 Request processed in 338us (525us total) trans 8589934609 rc 0/0 00000100:00100000:2.0:1789049628.309711:0:14331:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.26@tcp, seq: 8 00000020:00080000:2.0:1789049628.309715:0:14331:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1789049628.312042:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.26@tcp (source: 12345-192.168.206.26@tcp) 00000100:00100000:0.0:1789049628.312136:0:14315:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954089710976 00000100:00100000:0.0:1789049628.312145:0:14315:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954089710976 00000100:00100000:0.0:1789049628.312214:0:14315:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.26@tcp, seq: 1 00000100:00100000:0.0:1789049628.312223:0:14315:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8df260700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b76d50d5-035a-43d0-9ba1-e61b094296a4+15:2358:x1875954089710976:12345-192.168.206.26@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789049628.312237:0:14315:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789049628.312259:0:14315:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c2c00/0xf4f48ce5e1bc0325 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a3861 expref: 15 pid: 14327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049628.312294:0:14315:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8cb8c396d100) 00010000:00010000:0.0:1789049628.312299:0:14315:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789049628.312352:0:14315:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8df260700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b76d50d5-035a-43d0-9ba1-e61b094296a4+14:2358:x1875954089710976:12345-192.168.206.26@tcp:103:ldlm_bl.0 Request processed in 130us (317us total) trans 0 rc 0/0 00000100:00100000:0.0:1789049628.312359:0:14315:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.26@tcp, seq: 1 00000100:00100000:3.0:1789049628.377379:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.26@tcp (source: 12345-192.168.206.26@tcp) 00000100:00100000:1.0:1789049628.377480:0:16204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954089711232 00000100:00100000:1.0:1789049628.377490:0:16204:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954089711232 00000100:00100000:1.0:1789049628.377557:0:16204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.26@tcp, seq: 34 00000100:00100000:1.0:1789049628.377582:0:16204:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8df260000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b76d50d5-035a-43d0-9ba1-e61b094296a4+14:14458:x1875954089711232:12345-192.168.206.26@tcp:101:dd.0 00010000:00010000:1.0:1789049628.377605:0:16204:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789049628.377623:0:16204:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c3200/0xf4f48ce5e1bc0333 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7fc5e358805a3868 expref: -99 pid: 16204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049628.377905:0:16204:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c3c00/0xf4f48ce5e1bc033a lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 16204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049628.377921:0:16204:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c3800/0xf4f48ce5e1bc02d8 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a3845 expref: 15 pid: 16204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049628.377929:0:16204:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d776fa00/0xf4f48ce5e1bc02ed lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a384c expref: 15 pid: 16306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049628.377937:0:16204:0:(ldlm_resource.c:1751:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c3c00/0xf4f48ce5e1bc033a lrc: 5/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 16204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049628.377968:0:16204:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d776fa00/0xf4f48ce5e1bc02ed lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a384c expref: 15 pid: 16306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049628.377981:0:16204:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d776fa00/0xf4f48ce5e1bc02ed lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a384c expref: 15 pid: 16306 timeout: 554 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789049628.377992:0:16204:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb900e41f80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:16204:1875954110665984:192.168.206.26@tcp:104: 00010000:00010000:1.0:1789049628.378141:0:16204:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c3800/0xf4f48ce5e1bc02d8 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a3845 expref: 15 pid: 16204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049628.378150:0:16204:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c3800/0xf4f48ce5e1bc02d8 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a3845 expref: 15 pid: 16204 timeout: 554 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789049628.378167:0:16204:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb900e43b80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:16204:1875954110666112:192.168.206.26@tcp:104: 00000100:00100000:1.0:1789049628.378194:0:16204:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cb8c59763c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789049628.381740:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.26@tcp (source: 12345-192.168.206.26@tcp) 00000100:00100000:3.0:1789049628.381777:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.26@tcp (source: 12345-192.168.206.26@tcp) 00000100:00100000:0.0:1789049628.381868:0:14314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954089711360 00000100:00100000:0.0:1789049628.381877:0:14314:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954089711360 00010000:00010000:0.0:1789049628.381913:0:14314:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d776fa00/0xf4f48ce5e1bc02ed lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a384c expref: 16 pid: 16306 timeout: 554 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789049628.381949:0:14314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954089711488 00000100:00100000:0.0:1789049628.381953:0:14314:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954089711488 00010000:00010000:0.0:1789049628.381965:0:14314:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c3800/0xf4f48ce5e1bc02d8 lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a3845 expref: 17 pid: 16204 timeout: 554 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789049628.381987:0:14314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.26@tcp, seq: 11 00000100:00100000:0.0:1789049628.381996:0:14314:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8fcf4b850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b76d50d5-035a-43d0-9ba1-e61b094296a4+17:2357:x1875954089711360:12345-192.168.206.26@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789049628.382008:0:14314:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789049628.382014:0:14314:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d776fa00/0xf4f48ce5e1bc02ed lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a384c expref: 17 pid: 16306 timeout: 554 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049628.382028:0:14314:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d776fa00/0xf4f48ce5e1bc02ed lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a384c expref: 17 pid: 16306 timeout: 554 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049628.382048:0:14314:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8cb8c396d100) 00010000:00010000:0.0:1789049628.382053:0:14314:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c3c00/0xf4f48ce5e1bc033a lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 16204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049628.382074:0:14314:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c3c00/0xf4f48ce5e1bc033a lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 16204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049628.382080:0:14314:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789049628.382137:0:14314:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8fcf4b850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b76d50d5-035a-43d0-9ba1-e61b094296a4+17:2357:x1875954089711360:12345-192.168.206.26@tcp:103:ldlm_bl.0 Request processed in 142us (406us total) trans 0 rc 0/0 00000100:00100000:0.0:1789049628.382145:0:14314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.26@tcp, seq: 11 00000100:00100000:0.0:1789049628.382187:0:14314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.26@tcp, seq: 12 00000100:00100000:0.0:1789049628.382195:0:14314:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8df262d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b76d50d5-035a-43d0-9ba1-e61b094296a4+16:2357:x1875954089711488:12345-192.168.206.26@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789049628.382213:0:14314:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789049628.382218:0:14314:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c3800/0xf4f48ce5e1bc02d8 lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a3845 expref: 16 pid: 16204 timeout: 554 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049628.382227:0:14314:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c3800/0xf4f48ce5e1bc02d8 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a3845 expref: 16 pid: 16204 timeout: 554 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049628.382237:0:14314:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8cb8c396d100) 00010000:00010000:0.0:1789049628.382241:0:14314:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c3c00/0xf4f48ce5e1bc033a lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 16204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049628.382248:0:14314:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c3c00/0xf4f48ce5e1bc033a lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 16204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049628.382255:0:14314:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c3c00/0xf4f48ce5e1bc033a lrc: 4/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 16204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049628.382270:0:14314:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789049628.382289:0:14314:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8df262d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b76d50d5-035a-43d0-9ba1-e61b094296a4+16:2357:x1875954089711488:12345-192.168.206.26@tcp:103:ldlm_bl.0 Request processed in 94us (511us total) trans 0 rc 0/0 00000100:00100000:0.0:1789049628.382303:0:14314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.26@tcp, seq: 12 00010000:00010000:1.0:1789049628.382946:0:16204:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d776fa00/0xf4f48ce5e1bc02ed lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a384c expref: 15 pid: 16306 timeout: 554 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789049628.382964:0:16204:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb900e41f80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:16204:1875954110665984:192.168.206.26@tcp:104: 00010000:00010000:1.0:1789049628.382976:0:16204:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c3800/0xf4f48ce5e1bc02d8 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a3845 expref: 14 pid: 16204 timeout: 554 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789049628.382986:0:16204:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb900e43b80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:16204:1875954110666112:192.168.206.26@tcp:104: 00010000:00010000:1.0:1789049628.383008:0:16204:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c3c00/0xf4f48ce5e1bc033a lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049628.383016:0:16204:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c3c00/0xf4f48ce5e1bc033a lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049628.383022:0:16204:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c3c00/0xf4f48ce5e1bc033a lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16204 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789049628.383042:0:16204:0:(mdt_handler.c:922:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:1.0:1789049628.383217:0:16204:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c3200/0xf4f48ce5e1bc0333 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a3868 expref: 15 pid: 16204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049628.383232:0:16204:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c3c00/0xf4f48ce5e1bc033a lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a3868 expref: 14 pid: 16204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049628.383250:0:16204:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8cb8c396d100) 00010000:00010000:1.0:1789049628.383253:0:16204:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1789049628.383255:0:16204:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cb8c28c3c00, rc 0) 00000100:00100000:1.0:1789049628.383336:0:16204:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8df260000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b76d50d5-035a-43d0-9ba1-e61b094296a4+14:14458:x1875954089711232:12345-192.168.206.26@tcp:101:dd.0 Request processed in 5757us (5966us total) trans 8589934610 rc 0/0 00000100:00100000:1.0:1789049628.383343:0:16204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.26@tcp, seq: 34 00000100:00100000:3.0:1789049628.386606:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.26@tcp (source: 12345-192.168.206.26@tcp) 00000100:00100000:0.0:1789049628.386684:0:16306:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954089711744 00000100:00100000:0.0:1789049628.386694:0:16306:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954089711744 00000100:00100000:0.0:1789049628.386751:0:16306:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.26@tcp, seq: 35 00000100:00100000:0.0:1789049628.386760:0:16306:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8df261f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b76d50d5-035a-43d0-9ba1-e61b094296a4+14:14458:x1875954089711744:12345-192.168.206.26@tcp:36:dd.0 00010000:00010000:0.0:1789049628.387018:0:16306:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d776e400/0xf4f48ce5e1bc0348 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 16306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049628.387034:0:16306:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d776e400/0xf4f48ce5e1bc0348 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 16306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049628.387046:0:16306:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d776e400/0xf4f48ce5e1bc0348 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 16306 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789049628.387129:0:16306:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934611 00000004:00010000:0.0:1789049628.387158:0:16306:0:(mdt_handler.c:4507:mdt_save_lock()) ### save lock request 00000000bc3f1b74 reply state 00000000428f8400 transno 8589934612 ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d776e400/0xf4f48ce5e1bc0348 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 16306 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789049628.387167:0:16306:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1789049628.387882:0:16306:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8df261f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b76d50d5-035a-43d0-9ba1-e61b094296a4+17:14458:x1875954089711744:12345-192.168.206.26@tcp:36:dd.0 Request processed in 1119us (1280us total) trans 8589934612 rc 0/0 00000100:00100000:0.0:1789049628.387889:0:16306:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.26@tcp, seq: 35 00000020:00080000:0.0:1789049628.387894:0:16306:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1789049628.390629:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.26@tcp (source: 12345-192.168.206.26@tcp) 00000100:00100000:1.0:1789049628.391038:0:14327:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954089711872 00000100:00100000:1.0:1789049628.391048:0:14327:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954089711872 00000100:00100000:1.0:1789049628.391118:0:14327:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.26@tcp, seq: 36 00000100:00100000:1.0:1789049628.391128:0:14327:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8df263100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b76d50d5-035a-43d0-9ba1-e61b094296a4+17:14458:x1875954089711872:12345-192.168.206.26@tcp:101:dd.0 00010000:00010000:1.0:1789049628.391149:0:14327:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789049628.391168:0:14327:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c2c00/0xf4f48ce5e1bc034f lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7fc5e358805a386f expref: -99 pid: 14327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049628.391231:0:14327:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c2c00/0xf4f48ce5e1bc034f lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a386f expref: 18 pid: 14327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049628.391247:0:14327:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c2c00/0xf4f48ce5e1bc034f lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a386f expref: 18 pid: 14327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049628.391265:0:14327:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8cb8c396d100) 00010000:00010000:1.0:1789049628.391269:0:14327:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1789049628.391272:0:14327:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cb8c28c2c00, rc 0) 00000100:00100000:1.0:1789049628.391315:0:14327:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8df263100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b76d50d5-035a-43d0-9ba1-e61b094296a4+18:14458:x1875954089711872:12345-192.168.206.26@tcp:101:dd.0 Request processed in 189us (694us total) trans 0 rc 0/0 00000100:00100000:1.0:1789049628.391337:0:14327:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.26@tcp, seq: 36 00010000:00010000:0.0:1789049628.391662:0:3295:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d776e400/0xf4f48ce5e1bc0348 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 16306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049628.391680:0:3295:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d776e400/0xf4f48ce5e1bc0348 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 16306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049628.391687:0:3295:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d776e400/0xf4f48ce5e1bc0348 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 16306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049628.391700:0:3295:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cb8d776e400 already unused, calling callback (ffffffffc20ca4f0) 00010000:00010000:0.0:1789049628.391704:0:3295:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d776e400/0xf4f48ce5e1bc0348 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 16306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049628.391712:0:3295:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d776e400/0xf4f48ce5e1bc0348 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 16306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049628.391724:0:3295:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8cb8c396d100) 00010000:00010000:0.0:1789049628.391726:0:3295:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789049628.391730:0:3295:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d776e400/0xf4f48ce5e1bc0348 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 16306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049628.391736:0:3295:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d776e400/0xf4f48ce5e1bc0348 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 16306 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789049628.409519:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.26@tcp (source: 12345-192.168.206.26@tcp) 00000100:00100000:0.0:1789049628.409657:0:14314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954089712128 00000100:00100000:0.0:1789049628.409666:0:14314:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954089712128 00000100:00100000:0.0:1789049628.409740:0:14314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.26@tcp, seq: 2 00000100:00100000:0.0:1789049628.409750:0:14314:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb900e43b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b76d50d5-035a-43d0-9ba1-e61b094296a4+17:14458:x1875954089712128:12345-192.168.206.26@tcp:103:dd.0 00010000:00010000:0.0:1789049628.409763:0:14314:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789049628.409785:0:14314:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c2c00/0xf4f48ce5e1bc034f lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a386f expref: 17 pid: 14327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049628.409804:0:14314:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8cb8c396d100) 00010000:00010000:0.0:1789049628.409809:0:14314:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789049628.409901:0:14314:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb900e43b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b76d50d5-035a-43d0-9ba1-e61b094296a4+16:14458:x1875954089712128:12345-192.168.206.26@tcp:103:dd.0 Request processed in 153us (391us total) trans 0 rc 0/0 00000100:00100000:0.0:1789049628.409909:0:14314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.26@tcp, seq: 2 00000100:00100000:2.0:1789049628.412325:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.26@tcp (source: 12345-192.168.206.26@tcp) 00000100:00100000:1.0:1789049628.412414:0:16204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954089712256 00000100:00100000:1.0:1789049628.412424:0:16204:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954089712256 00000100:00100000:1.0:1789049628.412482:0:16204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.26@tcp, seq: 37 00000100:00100000:1.0:1789049628.412491:0:16204:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8f7ac8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b76d50d5-035a-43d0-9ba1-e61b094296a4+16:14458:x1875954089712256:12345-192.168.206.26@tcp:58:dd.0 00010000:00010000:1.0:1789049628.412591:0:16204:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c3200/0xf4f48ce5e1bc0356 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 16204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049628.412607:0:16204:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c3200/0xf4f48ce5e1bc0356 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 16204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049628.412620:0:16204:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c3200/0xf4f48ce5e1bc0356 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 16204 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1789049628.413379:0:16204:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1789049628.413530:0:16204:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 64 off8320 00000040:00080000:1.0:1789049628.413598:0:16204:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xe:0x0].1, 136 off8328 00000100:00100000:1.0:1789049628.413699:0:16204:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8f7ac8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b76d50d5-035a-43d0-9ba1-e61b094296a4+16:14458:x1875954089712256:12345-192.168.206.26@tcp:58:dd.0 Request processed in 1206us (1379us total) trans 0 rc 0/0 00000100:00100000:1.0:1789049628.413708:0:16204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.26@tcp, seq: 37 00000100:00100000:3.0:1789049628.416391:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.26@tcp (source: 12345-192.168.206.26@tcp) 00000100:00100000:0.0:1789049628.416486:0:16306:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954089712384 00000100:00100000:0.0:1789049628.416495:0:16306:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954089712384 00000100:00100000:0.0:1789049628.416557:0:16306:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.26@tcp, seq: 38 00000100:00100000:0.0:1789049628.416567:0:16306:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8df263b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b76d50d5-035a-43d0-9ba1-e61b094296a4+16:14458:x1875954089712384:12345-192.168.206.26@tcp:101:dd.0 00010000:00010000:0.0:1789049628.416585:0:16306:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789049628.416603:0:16306:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d776e400/0xf4f48ce5e1bc035d lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7fc5e358805a3876 expref: -99 pid: 16306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049628.416654:0:16306:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c3200/0xf4f48ce5e1bc0356 lrc: 2/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 16204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049628.416665:0:16306:0:(ldlm_resource.c:1751:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d776e400/0xf4f48ce5e1bc035d lrc: 4/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a3876 expref: 17 pid: 16306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049628.416694:0:16306:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c3200/0xf4f48ce5e1bc0356 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 16204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049628.416707:0:16306:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d776e400/0xf4f48ce5e1bc035d lrc: 3/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a3876 expref: 17 pid: 16306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049628.416719:0:16306:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8cb8c396d100) 00010000:00010000:0.0:1789049628.416722:0:16306:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1789049628.416725:0:16306:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d776e400/0xf4f48ce5e1bc035d lrc: 3/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a3876 expref: 17 pid: 16306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049628.416732:0:16306:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cb8d776e400, rc 0) 00000100:00100000:0.0:1789049628.416785:0:16306:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8df263b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b76d50d5-035a-43d0-9ba1-e61b094296a4+17:14458:x1875954089712384:12345-192.168.206.26@tcp:101:dd.0 Request processed in 220us (400us total) trans 0 rc 0/0 00000100:00100000:0.0:1789049628.416792:0:16306:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.26@tcp, seq: 38 00010000:00010000:0.0:1789049628.763183:0:14316:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1789049629.085403:0:14362:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:3.0:1789049629.085411:0:14362:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1789049629.085444:0:14362:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:3.0:1789049629.085450:0:14362:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:3.0:1789049629.085557:0:14362:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb8df262300 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:14362:1875954110666240:192.168.206.26@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1789049629.085784:0:14362:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cb9009a8cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1789049629.095919:0:14362:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb8df262300 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:14362:1875954110666240:192.168.206.26@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1789049629.098333:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.26@tcp (source: 12345-192.168.206.26@tcp) 00000100:00100000:1.0:1789049629.099568:0:14338:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954089712512 00000100:00100000:1.0:1789049629.099580:0:14338:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954089712512 00000100:00080000:0.0:1789049629.099777:0:14324:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789049629.099956:0:14338:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.26@tcp, seq: 0 00000100:00100000:1.0:1789049629.099968:0:14338:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8f7ac9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:b76d50d5-035a-43d0-9ba1-e61b094296a4+17:14459:x1875954089712512:12345-192.168.206.26@tcp:900:lhsmtool_posix.0 00000100:00100000:1.0:1789049629.100255:0:14338:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8f7ac9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:b76d50d5-035a-43d0-9ba1-e61b094296a4+17:14459:x1875954089712512:12345-192.168.206.26@tcp:900:lhsmtool_posix.0 Request processed in 288us (1928us total) trans 0 rc 0/0 00000100:00100000:1.0:1789049629.100262:0:14338:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.26@tcp, seq: 0 00000100:00100000:3.0:1789049629.109452:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.26@tcp (source: 12345-192.168.206.26@tcp) 00000100:00100000:0.0:1789049629.109654:0:14328:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954089712640 00000100:00100000:0.0:1789049629.109663:0:14328:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954089712640 00000100:00100000:0.0:1789049629.109724:0:14328:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.26@tcp, seq: 39 00000100:00100000:0.0:1789049629.109735:0:14328:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8df262300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b76d50d5-035a-43d0-9ba1-e61b094296a4+17:14459:x1875954089712640:12345-192.168.206.26@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1789049629.109780:0:14328:0:(mdt_handler.c:7990:mdt_fid2path()) path get [0x200000bd1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1789049629.109901:0:14328:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8df262300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b76d50d5-035a-43d0-9ba1-e61b094296a4+17:14459:x1875954089712640:12345-192.168.206.26@tcp:53:lhsmtool_posix.0 Request processed in 168us (457us total) trans 0 rc 0/0 00000100:00100000:0.0:1789049629.109909:0:14328:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.26@tcp, seq: 39 00000100:00100000:3.0:1789049629.119231:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.26@tcp (source: 12345-192.168.206.26@tcp) 00000100:00100000:2.0:1789049629.119370:0:14329:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954089712768 00000100:00100000:2.0:1789049629.119380:0:14329:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954089712768 00000100:00100000:2.0:1789049629.119436:0:14329:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.26@tcp, seq: 40 00000100:00100000:2.0:1789049629.119446:0:14329:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8df262a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b76d50d5-035a-43d0-9ba1-e61b094296a4+17:14459:x1875954089712768:12345-192.168.206.26@tcp:34:lhsmtool_posix.0 00010000:00010000:2.0:1789049629.119511:0:14329:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb900e62800/0xf4f48ce5e1bc0364 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049629.119526:0:14329:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cb900e62800/0xf4f48ce5e1bc0364 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049629.119539:0:14329:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb900e62800/0xf4f48ce5e1bc0364 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049629.119589:0:14329:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb900e63a00/0xf4f48ce5e1bc036b lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049629.119598:0:14329:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cb900e63a00/0xf4f48ce5e1bc036b lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049629.119614:0:14329:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb900e63a00/0xf4f48ce5e1bc036b lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049629.119660:0:14329:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb900e63c00/0xf4f48ce5e1bc0372 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049629.119677:0:14329:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cb900e63c00/0xf4f48ce5e1bc0372 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049629.119684:0:14329:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb900e63c00/0xf4f48ce5e1bc0372 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14329 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789049629.119720:0:14329:0:(mdt_handler.c:922:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:2.0:1789049629.119724:0:14329:0:(mdt_handler.c:1587:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1789049629.119738:0:14329:0:(mdt_handler.c:2522:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8cb900e63c00/0xf4f48ce5e1bc0372 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049629.119747:0:14329:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb900e62800/0xf4f48ce5e1bc0364 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049629.119755:0:14329:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cb900e62800/0xf4f48ce5e1bc0364 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049629.119761:0:14329:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cb900e62800/0xf4f48ce5e1bc0364 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049629.119778:0:14329:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cb900e62800 already unused, calling callback (ffffffffc20ca4f0) 00010000:00010000:2.0:1789049629.119782:0:14329:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb900e62800/0xf4f48ce5e1bc0364 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049629.119789:0:14329:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb900e62800/0xf4f48ce5e1bc0364 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049629.119799:0:14329:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8cb8ce751900) 00010000:00010000:2.0:1789049629.119808:0:14329:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789049629.119813:0:14329:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cb900e62800/0xf4f48ce5e1bc0364 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049629.119820:0:14329:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb900e62800/0xf4f48ce5e1bc0364 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049629.119834:0:14329:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb900e63a00/0xf4f48ce5e1bc036b lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049629.119840:0:14329:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cb900e63a00/0xf4f48ce5e1bc036b lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049629.120055:0:14329:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cb900e63a00/0xf4f48ce5e1bc036b lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049629.120060:0:14329:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cb900e63a00 already unused, calling callback (ffffffffc20ca4f0) 00010000:00010000:2.0:1789049629.120063:0:14329:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb900e63a00/0xf4f48ce5e1bc036b lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049629.120069:0:14329:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb900e63a00/0xf4f48ce5e1bc036b lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049629.120078:0:14329:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x4549062c (ffff8cb8e0130f00) 00010000:00010000:2.0:1789049629.120080:0:14329:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789049629.120084:0:14329:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cb900e63a00/0xf4f48ce5e1bc036b lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049629.120089:0:14329:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb900e63a00/0xf4f48ce5e1bc036b lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049629.120168:0:14329:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb900e63c00/0xf4f48ce5e1bc0372 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049629.120181:0:14329:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cb900e63c00/0xf4f48ce5e1bc0372 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049629.120188:0:14329:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cb900e63c00/0xf4f48ce5e1bc0372 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049629.120193:0:14329:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cb900e63c00 already unused, calling callback (ffffffffc20ca4f0) 00010000:00010000:2.0:1789049629.120206:0:14329:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb900e63c00/0xf4f48ce5e1bc0372 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049629.120212:0:14329:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb900e63c00/0xf4f48ce5e1bc0372 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049629.120220:0:14329:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8cb8c396d100) 00010000:00010000:2.0:1789049629.120222:0:14329:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789049629.120224:0:14329:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cb900e63c00/0xf4f48ce5e1bc0372 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049629.120230:0:14329:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb900e63c00/0xf4f48ce5e1bc0372 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14329 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789049629.120344:0:14329:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8df262a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b76d50d5-035a-43d0-9ba1-e61b094296a4+17:14459:x1875954089712768:12345-192.168.206.26@tcp:34:lhsmtool_posix.0 Request processed in 898us (1121us total) trans 0 rc 0/0 00000100:00100000:2.0:1789049629.120352:0:14329:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.26@tcp, seq: 40 00000100:00100000:2.0:1789049629.126388:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.26@tcp (source: 12345-192.168.206.26@tcp) 00000100:00100000:1.0:1789049629.126472:0:14327:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954089713024 00000100:00100000:1.0:1789049629.126481:0:14327:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954089713024 00000100:00100000:1.0:1789049629.127792:0:14327:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.26@tcp, seq: 41 00000100:00100000:1.0:1789049629.128465:0:14327:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8f7ac8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b76d50d5-035a-43d0-9ba1-e61b094296a4+17:14459:x1875954089713024:12345-192.168.206.26@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1789049629.128488:0:14327:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789049629.128508:0:14327:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c3800/0xf4f48ce5e1bc0379 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7fc5e358805a387d expref: -99 pid: 14327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049629.128602:0:14327:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c2c00/0xf4f48ce5e1bc0380 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049629.128617:0:14327:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c2c00/0xf4f48ce5e1bc0380 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049629.128630:0:14327:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c2c00/0xf4f48ce5e1bc0380 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14327 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789049629.128642:0:14327:0:(mdt_handler.c:922:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:1.0:1789049629.128748:0:14327:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c2c00/0xf4f48ce5e1bc0380 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049629.128756:0:14327:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c2c00/0xf4f48ce5e1bc0380 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049629.128763:0:14327:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c2c00/0xf4f48ce5e1bc0380 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049629.128769:0:14327:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cb8c28c2c00 already unused, calling callback (ffffffffc20ca4f0) 00010000:00010000:1.0:1789049629.128773:0:14327:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c2c00/0xf4f48ce5e1bc0380 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049629.128780:0:14327:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c2c00/0xf4f48ce5e1bc0380 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049629.129145:0:14327:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8cb8c396d100) 00010000:00010000:1.0:1789049629.129148:0:14327:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1789049629.129153:0:14327:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c2c00/0xf4f48ce5e1bc0380 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049629.129160:0:14327:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c2c00/0xf4f48ce5e1bc0380 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049629.129215:0:14327:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c3800/0xf4f48ce5e1bc0379 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a387d expref: 19 pid: 14327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049629.129226:0:14327:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8cb8ce751900) 00010000:00010000:1.0:1789049629.129228:0:14327:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1789049629.129232:0:14327:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c3800/0xf4f48ce5e1bc0379 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a387d expref: 19 pid: 14327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049629.129242:0:14327:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cb8c28c3800, rc 0) 00000100:00100000:1.0:1789049629.129369:0:14327:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8f7ac8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b76d50d5-035a-43d0-9ba1-e61b094296a4+18:14459:x1875954089713024:12345-192.168.206.26@tcp:101:lhsmtool_posix.0 Request processed in 975us (2989us total) trans 8589934613 rc 301/301 00000100:00100000:1.0:1789049629.129378:0:14327:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.26@tcp, seq: 41 00000100:00100000:0.0:1789049629.136477:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.26@tcp (source: 12345-192.168.206.26@tcp) 00000100:00100000:1.0:1789049629.136892:0:16204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954089713152 00000100:00100000:1.0:1789049629.136902:0:16204:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954089713152 00000100:00100000:1.0:1789049629.137027:0:16204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.26@tcp, seq: 42 00000100:00100000:1.0:1789049629.137038:0:16204:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb9009c0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b76d50d5-035a-43d0-9ba1-e61b094296a4+18:14459:x1875954089713152:12345-192.168.206.26@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1789049629.137072:0:16204:0:(mdt_handler.c:7990:mdt_fid2path()) path get [0x200000bd1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1789049629.137182:0:16204:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb9009c0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b76d50d5-035a-43d0-9ba1-e61b094296a4+18:14459:x1875954089713152:12345-192.168.206.26@tcp:53:lhsmtool_posix.0 Request processed in 145us (713us total) trans 0 rc 0/0 00000100:00100000:1.0:1789049629.137223:0:16204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.26@tcp, seq: 42 00000100:00100000:3.0:1789049629.145812:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.26@tcp (source: 12345-192.168.206.26@tcp) 00000100:00100000:2.0:1789049629.148361:0:14329:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954089713408 00000100:00100000:2.0:1789049629.148375:0:14329:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954089713408 00000100:00100000:2.0:1789049629.148518:0:14329:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.26@tcp, seq: 43 00000100:00100000:2.0:1789049629.148529:0:14329:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8df263480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b76d50d5-035a-43d0-9ba1-e61b094296a4+18:14459:x1875954089713408:12345-192.168.206.26@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789049629.148566:0:14329:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789049629.148586:0:14329:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb900e63a00/0xf4f48ce5e1bc038e lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7fc5e358805a3884 expref: -99 pid: 14329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1789049629.149549:0:14329:0:(osp_internal.h:553:osp_update_last_fid()) Gap in objids: start=[0x240000400:0x7:0x0], count =27 00000004:00080000:2.0:1789049629.149557:0:14329:0:(osp_object.c:1650:osp_create()) Writing gap [0x240000400:0x7:0x0]+27 in llog 00000004:00080000:2.0:1789049629.149604:0:14329:0:(osp_object.c:1667:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x22:0x0], index 0: 0 00010000:00010000:2.0:1789049629.149901:0:14329:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb900e62800/0xf4f48ce5e1bc0395 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049629.149917:0:14329:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cb900e62800/0xf4f48ce5e1bc0395 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049629.149928:0:14329:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb900e62800/0xf4f48ce5e1bc0395 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049629.149986:0:14329:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb900e63a00/0xf4f48ce5e1bc038e lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a3884 expref: 21 pid: 14329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049629.150002:0:14329:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb900e62800/0xf4f48ce5e1bc0395 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a3884 expref: 20 pid: 14329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049629.150010:0:14329:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8cb8e0130f00) 00010000:00010000:2.0:1789049629.150013:0:14329:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789049629.150016:0:14329:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cb900e62800, rc 0) 00000100:00100000:2.0:1789049629.150094:0:14329:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8df263480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b76d50d5-035a-43d0-9ba1-e61b094296a4+20:14459:x1875954089713408:12345-192.168.206.26@tcp:101:lhsmtool_posix.0 Request processed in 1566us (4291us total) trans 8589934614 rc 0/0 00000100:00100000:2.0:1789049629.150103:0:14329:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.26@tcp, seq: 43 00000100:00100000:2.0:1789049629.155961:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.26@tcp (source: 12345-192.168.206.26@tcp) 00000100:00100000:1.0:1789049629.156879:0:14327:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954089713664 00000100:00100000:1.0:1789049629.156890:0:14327:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954089713664 00000100:00100000:1.0:1789049629.156943:0:14327:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.26@tcp, seq: 44 00000100:00100000:1.0:1789049629.156952:0:14327:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8f7acb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b76d50d5-035a-43d0-9ba1-e61b094296a4+20:14459:x1875954089713664:12345-192.168.206.26@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1789049629.157003:0:14327:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789049629.157027:0:14327:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb900e62800/0xf4f48ce5e1bc0395 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a3884 expref: 20 pid: 14329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049629.157046:0:14327:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8cb8e0130f00) 00010000:00010000:1.0:1789049629.157056:0:14327:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789049629.157089:0:14327:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c2c00/0xf4f48ce5e1bc03a3 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049629.157102:0:14327:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c2c00/0xf4f48ce5e1bc03a3 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049629.157112:0:14327:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c2c00/0xf4f48ce5e1bc03a3 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049629.157127:0:14327:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c3800/0xf4f48ce5e1bc03aa lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0xf57f4c6b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049629.157133:0:14327:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c3800/0xf4f48ce5e1bc03aa lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xf57f4c6b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049629.157140:0:14327:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c3800/0xf4f48ce5e1bc03aa lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xf57f4c6b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049629.157346:0:14327:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c2c00/0xf4f48ce5e1bc03a3 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049629.157355:0:14327:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c2c00/0xf4f48ce5e1bc03a3 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049629.157361:0:14327:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c2c00/0xf4f48ce5e1bc03a3 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049629.157367:0:14327:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cb8c28c2c00 already unused, calling callback (ffffffffc20ca4f0) 00010000:00010000:1.0:1789049629.157371:0:14327:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c2c00/0xf4f48ce5e1bc03a3 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049629.157379:0:14327:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c2c00/0xf4f48ce5e1bc03a3 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049629.157389:0:14327:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8cb8ce751300) 00010000:00010000:1.0:1789049629.157392:0:14327:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789049629.157395:0:14327:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c2c00/0xf4f48ce5e1bc03a3 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049629.157402:0:14327:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c2c00/0xf4f48ce5e1bc03a3 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049629.157412:0:14327:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c3800/0xf4f48ce5e1bc03aa lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xf57f4c6b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049629.157417:0:14327:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c3800/0xf4f48ce5e1bc03aa lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xf57f4c6b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049629.157423:0:14327:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c3800/0xf4f48ce5e1bc03aa lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xf57f4c6b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049629.157435:0:14327:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cb8c28c3800 already unused, calling callback (ffffffffc20ca4f0) 00010000:00010000:1.0:1789049629.157438:0:14327:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c3800/0xf4f48ce5e1bc03aa lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xf57f4c6b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049629.157445:0:14327:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c3800/0xf4f48ce5e1bc03aa lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xf57f4c6b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049629.157454:0:14327:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xf57f4c6b (ffff8cb8c396de00) 00010000:00010000:1.0:1789049629.157456:0:14327:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789049629.157460:0:14327:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c3800/0xf4f48ce5e1bc03aa lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0xf57f4c6b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049629.157466:0:14327:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c3800/0xf4f48ce5e1bc03aa lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0xf57f4c6b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14327 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789049629.157549:0:14327:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8f7acb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b76d50d5-035a-43d0-9ba1-e61b094296a4+19:14459:x1875954089713664:12345-192.168.206.26@tcp:36:lhsmtool_posix.0 Request processed in 597us (1595us total) trans 0 rc -2/-2 00000100:00100000:1.0:1789049629.157556:0:14327:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.26@tcp, seq: 44 00000100:00100000:1.0:1789049629.160560:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.26@tcp (source: 12345-192.168.206.26@tcp) 00000100:00100000:0.0:1789049629.160836:0:16306:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954089713792 00000100:00100000:0.0:1789049629.160878:0:16306:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954089713792 00000100:00100000:0.0:1789049629.160923:0:16306:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.26@tcp, seq: 45 00000100:00100000:0.0:1789049629.160932:0:16306:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb900e41f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b76d50d5-035a-43d0-9ba1-e61b094296a4+19:14459:x1875954089713792:12345-192.168.206.26@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789049629.160949:0:16306:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789049629.160970:0:16306:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d776e200/0xf4f48ce5e1bc03b1 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7fc5e358805a388b expref: -99 pid: 16306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049629.161001:0:16306:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d776fa00/0xf4f48ce5e1bc03b8 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 16306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049629.161015:0:16306:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d776fa00/0xf4f48ce5e1bc03b8 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 16306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049629.161026:0:16306:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d776fa00/0xf4f48ce5e1bc03b8 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 16306 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049629.161232:0:16306:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d776e200/0xf4f48ce5e1bc03b1 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a388b expref: 21 pid: 16306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049629.161258:0:16306:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d776fa00/0xf4f48ce5e1bc03b8 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a388b expref: 20 pid: 16306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049629.161266:0:16306:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8cb8ce751400) 00010000:00010000:0.0:1789049629.161269:0:16306:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1789049629.161272:0:16306:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cb8d776fa00, rc 0) 00000100:00100000:0.0:1789049629.161367:0:16306:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb900e41f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b76d50d5-035a-43d0-9ba1-e61b094296a4+20:14459:x1875954089713792:12345-192.168.206.26@tcp:101:lhsmtool_posix.0 Request processed in 434us (824us total) trans 0 rc 0/0 00000100:00100000:0.0:1789049629.161374:0:16306:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.26@tcp, seq: 45 00000100:00100000:2.0:1789049629.171086:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.26@tcp (source: 12345-192.168.206.26@tcp) 00000100:00100000:3.0:1789049629.175409:0:14329:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954089714048 00000100:00100000:3.0:1789049629.175423:0:14329:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954089714048 00000100:00100000:3.0:1789049629.175484:0:14329:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.26@tcp, seq: 46 00000100:00100000:3.0:1789049629.175494:0:14329:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8f7aca300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b76d50d5-035a-43d0-9ba1-e61b094296a4+20:14459:x1875954089714048:12345-192.168.206.26@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1789049629.180074:0:14329:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb900e62000/0xf4f48ce5e1bc03bf lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049629.180096:0:14329:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cb900e62000/0xf4f48ce5e1bc03bf lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049629.180107:0:14329:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb900e62000/0xf4f48ce5e1bc03bf lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14329 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1789049629.181724:0:14329:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].2, 88 off8344 00000004:00080000:2.0:1789049629.181742:0:14329:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 455233897865ns, next at 456233894095ns, rc = 0 00000004:00010000:2.0:1789049629.181835:0:14329:0:(mdt_handler.c:4507:mdt_save_lock()) ### save lock request 0000000090ff0ae6 reply state 000000005bf8c9a4 transno 8589934615 ns: mdt-lustre-MDT0000_UUID lock: ffff8cb900e62000/0xf4f48ce5e1bc03bf lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14329 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789049629.181872:0:14329:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1789049629.182500:0:14329:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8f7aca300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b76d50d5-035a-43d0-9ba1-e61b094296a4+22:14459:x1875954089714048:12345-192.168.206.26@tcp:36:lhsmtool_posix.0 Request processed in 7003us (11419us total) trans 8589934615 rc 0/0 00000100:00100000:2.0:1789049629.182508:0:14329:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.26@tcp, seq: 46 00010000:00010000:1.0:1789049629.188096:0:3294:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb900e62000/0xf4f48ce5e1bc03bf lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049629.188113:0:3294:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cb900e62000/0xf4f48ce5e1bc03bf lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049629.188120:0:3294:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cb900e62000/0xf4f48ce5e1bc03bf lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049629.188126:0:3294:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cb900e62000 already unused, calling callback (ffffffffc20ca4f0) 00010000:00010000:1.0:1789049629.188131:0:3294:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb900e62000/0xf4f48ce5e1bc03bf lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049629.188152:0:3294:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb900e62000/0xf4f48ce5e1bc03bf lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049629.188167:0:3294:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8cb8ce751400) 00010000:00010000:1.0:1789049629.188170:0:3294:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1789049629.188176:0:3294:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cb900e62000/0xf4f48ce5e1bc03bf lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049629.188181:0:3294:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb900e62000/0xf4f48ce5e1bc03bf lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14329 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789049629.196762:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.26@tcp (source: 12345-192.168.206.26@tcp) 00000100:00100000:1.0:1789049629.197053:0:16204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954089714176 00000100:00100000:1.0:1789049629.197063:0:16204:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954089714176 00000100:00100000:1.0:1789049629.197117:0:16204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.26@tcp, seq: 47 00000100:00100000:1.0:1789049629.197126:0:16204:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8f7aca680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b76d50d5-035a-43d0-9ba1-e61b094296a4+21:14459:x1875954089714176:12345-192.168.206.26@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1789049629.197148:0:16204:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789049629.197165:0:16204:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c2c00/0xf4f48ce5e1bc03c6 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7fc5e358805a3892 expref: -99 pid: 16204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049629.197233:0:16204:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c2c00/0xf4f48ce5e1bc03c6 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a3892 expref: 22 pid: 16204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049629.197248:0:16204:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c2c00/0xf4f48ce5e1bc03c6 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a3892 expref: 22 pid: 16204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049629.197274:0:16204:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8cb8ce751400) 00010000:00010000:1.0:1789049629.197278:0:16204:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1789049629.197281:0:16204:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cb8c28c2c00, rc 0) 00000100:00100000:1.0:1789049629.197398:0:16204:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8f7aca680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b76d50d5-035a-43d0-9ba1-e61b094296a4+22:14459:x1875954089714176:12345-192.168.206.26@tcp:101:lhsmtool_posix.0 Request processed in 272us (645us total) trans 0 rc 0/0 00000100:00100000:1.0:1789049629.197406:0:16204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.26@tcp, seq: 47 00000100:00100000:2.0:1789049629.209380:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.26@tcp (source: 12345-192.168.206.26@tcp) 00000100:00100000:0.0:1789049629.209473:0:15011:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954089714304 00000100:00100000:0.0:1789049629.209483:0:15011:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954089714304 00000100:00100000:0.0:1789049629.209625:0:15011:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.26@tcp, seq: 12 00000100:00080000:1.0:1789049629.211544:0:14324:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789049629.212703:0:15011:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8f7acb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b76d50d5-035a-43d0-9ba1-e61b094296a4+5:2358:x1875954089714304:12345-192.168.206.26@tcp:2:lhsmtool_posix.0 00000100:00100000:0.0:1789049629.213257:0:15011:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8f7acb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b76d50d5-035a-43d0-9ba1-e61b094296a4+6:2358:x1875954089714304:12345-192.168.206.26@tcp:2:lhsmtool_posix.0 Request processed in 573us (3884us total) trans 8589934594 rc 0/0 00000100:00100000:0.0:1789049629.213707:0:15011:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.26@tcp, seq: 12 00000100:00100000:0.0:1789049629.218668:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.26@tcp (source: 12345-192.168.206.26@tcp) 00000100:00100000:2.0:1789049629.218948:0:14331:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954089714560 00000100:00100000:2.0:1789049629.218958:0:14331:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954089714560 00000100:00100000:2.0:1789049629.219022:0:14331:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.26@tcp, seq: 9 00000100:00100000:2.0:1789049629.219032:0:14331:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb9009c0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b76d50d5-035a-43d0-9ba1-e61b094296a4+22:14459:x1875954089714560:12345-192.168.206.26@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1789049629.219256:0:14331:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb9009c0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b76d50d5-035a-43d0-9ba1-e61b094296a4+23:14459:x1875954089714560:12345-192.168.206.26@tcp:35:lhsmtool_posix.0 Request processed in 225us (595us total) trans 8589934616 rc 0/0 00000100:00100000:2.0:1789049629.219504:0:14331:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.26@tcp, seq: 9 00000100:00100000:1.0:1789049629.222780:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.26@tcp (source: 12345-192.168.206.26@tcp) 00000100:00100000:0.0:1789049629.222946:0:16306:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954089714816 00000100:00100000:0.0:1789049629.222956:0:16306:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954089714816 00000100:00100000:0.0:1789049629.223053:0:16306:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.26@tcp, seq: 48 00000100:00100000:0.0:1789049629.223063:0:16306:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb900e43480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b76d50d5-035a-43d0-9ba1-e61b094296a4+23:14459:x1875954089714816:12345-192.168.206.26@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1789049629.223175:0:16306:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb900e43480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b76d50d5-035a-43d0-9ba1-e61b094296a4+23:14459:x1875954089714816:12345-192.168.206.26@tcp:57:lhsmtool_posix.0 Request processed in 113us (403us total) trans 0 rc 0/0 00000100:00100000:0.0:1789049629.223183:0:16306:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.26@tcp, seq: 48 00000100:00100000:0.0:1789049629.229597:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.26@tcp (source: 12345-192.168.206.26@tcp) 00000100:00100000:2.0:1789049629.229685:0:14329:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954089714944 00000100:00100000:2.0:1789049629.229707:0:14329:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954089714944 00000100:00100000:2.0:1789049629.229770:0:14329:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.26@tcp, seq: 49 00000100:00100000:2.0:1789049629.229780:0:14329:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb9009c2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b76d50d5-035a-43d0-9ba1-e61b094296a4+23:14459:x1875954089714944:12345-192.168.206.26@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789049629.229800:0:14329:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789049629.229817:0:14329:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb900e63200/0xf4f48ce5e1bc03cd lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7fc5e358805a3899 expref: -99 pid: 14329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049629.230314:0:14329:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb900e62a00/0xf4f48ce5e1bc03d4 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049629.230332:0:14329:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cb900e62a00/0xf4f48ce5e1bc03d4 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049629.230343:0:14329:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb900e62a00/0xf4f48ce5e1bc03d4 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14329 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789049629.230449:0:14329:0:(mdt_handler.c:1587:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1789049629.230540:0:14329:0:(mdt_handler.c:2522:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8cb900e62a00/0xf4f48ce5e1bc03d4 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049629.230571:0:14329:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb900e63200/0xf4f48ce5e1bc03cd lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a3899 expref: 25 pid: 14329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049629.230599:0:14329:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb900e62a00/0xf4f48ce5e1bc03d4 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a3899 expref: 24 pid: 14329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049629.230608:0:14329:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8cb8ce751400) 00010000:00010000:2.0:1789049629.230611:0:14329:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1789049629.230615:0:14329:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cb900e62a00, rc 0) 00000100:00100000:2.0:1789049629.230712:0:14329:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb9009c2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b76d50d5-035a-43d0-9ba1-e61b094296a4+24:14459:x1875954089714944:12345-192.168.206.26@tcp:101:lhsmtool_posix.0 Request processed in 933us (1123us total) trans 0 rc 0/0 00000100:00100000:2.0:1789049629.230729:0:14329:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.26@tcp, seq: 49 00000100:00100000:2.0:1789049629.233951:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.26@tcp (source: 12345-192.168.206.26@tcp) 00000100:00100000:0.0:1789049629.234253:0:15013:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954089715072 00000100:00100000:0.0:1789049629.234264:0:15013:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954089715072 00000100:00100000:0.0:1789049629.234319:0:15013:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.26@tcp, seq: 13 00000100:00100000:0.0:1789049629.234329:0:15013:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8f7ac9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b76d50d5-035a-43d0-9ba1-e61b094296a4+6:2355:x1875954089715072:12345-192.168.206.26@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789049629.234345:0:15013:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789049629.234365:0:15013:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b2b735dc/0xf4f48ce5e1bc03db lrc: 2/0,0 mode: --/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x7fc5e358805a38a0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789049629.234389:0:15013:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x22:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x18d3fb2887555900, blocks: 0x1 00010000:00010000:0.0:1789049629.234408:0:15013:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=455s v=(0 0) 00010000:00010000:0.0:1789049629.234412:0:15013:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789049629.234421:0:15013:0:(ldlm_resource.c:1751:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b2b735dc/0xf4f48ce5e1bc03db lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a38a0 expref: 7 pid: 15013 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049629.234438:0:15013:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000b2b735dc/0xf4f48ce5e1bc03db lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a38a0 expref: 7 pid: 15013 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049629.234451:0:15013:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cb8d776f000, rc 0) 00000100:00100000:0.0:1789049629.234510:0:15013:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8f7ac9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b76d50d5-035a-43d0-9ba1-e61b094296a4+7:2355:x1875954089715072:12345-192.168.206.26@tcp:101:lhsmtool_posix.0 Request processed in 182us (566us total) trans 0 rc 0/0 00000100:00100000:0.0:1789049629.234517:0:15013:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.26@tcp, seq: 13 00000100:00100000:1.0:1789049629.237936:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.26@tcp (source: 12345-192.168.206.26@tcp) 00000100:00100000:3.0:1789049629.238151:0:14328:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954089715328 00000100:00100000:3.0:1789049629.238160:0:14328:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954089715328 00000100:00100000:3.0:1789049629.238220:0:14328:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.26@tcp, seq: 50 00000100:00100000:3.0:1789049629.238229:0:14328:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb900e42a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b76d50d5-035a-43d0-9ba1-e61b094296a4+24:14459:x1875954089715328:12345-192.168.206.26@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1789049629.238339:0:14328:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb900e42a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b76d50d5-035a-43d0-9ba1-e61b094296a4+24:14459:x1875954089715328:12345-192.168.206.26@tcp:57:lhsmtool_posix.0 Request processed in 110us (411us total) trans 0 rc 0/0 00000100:00100000:3.0:1789049629.238346:0:14328:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.26@tcp, seq: 50 00000100:00100000:1.0:1789049629.247022:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.26@tcp (source: 12345-192.168.206.26@tcp) 00000100:00100000:0.0:1789049629.249994:0:16306:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954089715456 00000100:00100000:0.0:1789049629.250260:0:16306:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954089715456 00000100:00100000:0.0:1789049629.250326:0:16306:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.26@tcp, seq: 51 00000100:00100000:0.0:1789049629.250337:0:16306:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb900e43100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b76d50d5-035a-43d0-9ba1-e61b094296a4+24:14459:x1875954089715456:12345-192.168.206.26@tcp:44:lhsmtool_posix.0 00000100:00100000:1.0:1789049629.305058:0:16306:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb900e43100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b76d50d5-035a-43d0-9ba1-e61b094296a4+24:14459:x1875954089715456:12345-192.168.206.26@tcp:44:lhsmtool_posix.0 Request processed in 54713us (58034us total) trans 0 rc 0/0 00000100:00100000:1.0:1789049629.305132:0:16306:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.26@tcp, seq: 51 00000001:00080000:3.0:1789049629.305211:0:5872:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934612 is committed 00000001:00080000:3.0:1789049629.305223:0:5872:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934613 is committed 00000001:00080000:3.0:1789049629.305233:0:5872:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934616 is committed 00000004:00080000:3.0:1789049629.305238:0:5872:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2 committed 00000100:00100000:3.0:1789049629.305804:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb900e40e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3309:1875954110666368:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1789049629.305883:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789049629.305993:0:15014:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954110666368 00000100:00100000:1.0:1789049629.306000:0:15014:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954110666368 00000100:00100000:1.0:1789049629.306051:0:15014:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1789049629.306059:0:15014:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8df261c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3309:x1875954110666368:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:1.0:1789049629.306346:0:15014:0:(ofd_lvb.c:321:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1789049629.306350:0:15014:0:(ofd_lvb.c:328:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:1.0:1789049629.306352:0:15014:0:(ofd_lvb.c:334:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1789049629.306354:0:15014:0:(ofd_lvb.c:340:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb ctime from disk: 1789049628484000000 -> 1789049628484000000 00002000:00010000:1.0:1789049629.306356:0:15014:0:(ofd_lvb.c:346:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:1.0:1789049629.306394:0:15014:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8df261c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3309:x1875954110666368:12345-0@lo:2:osp-syn-0-0.0 Request processed in 336us (512us total) trans 8589934595 rc 0/0 00000100:00100000:1.0:1789049629.306401:0:15014:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000004:00080000:1.0:1789049629.306440:0:3309:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8cb900e40e00/2, rc 0, transno 8589934595 00000100:00100000:1.0:1789049629.306445:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb900e40e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3309:1875954110666368:0@lo:2:osp-syn-0-0.0 00000100:00080000:0.0:1789049629.306712:0:14324:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789049629.307995:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.26@tcp (source: 12345-192.168.206.26@tcp) 00000100:00100000:0.0:1789049629.308254:0:15011:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954089715584 00000100:00100000:0.0:1789049629.308263:0:15011:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954089715584 00000100:00100000:0.0:1789049629.308321:0:15011:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.26@tcp, seq: 15 00000100:00100000:0.0:1789049629.308331:0:15011:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8f7ac8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b76d50d5-035a-43d0-9ba1-e61b094296a4+7:2357:x1875954089715584:12345-192.168.206.26@tcp:16:lhsmtool_posix.0 00000100:00100000:0.0:1789049629.308424:0:15011:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8f7ac8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b76d50d5-035a-43d0-9ba1-e61b094296a4+7:2357:x1875954089715584:12345-192.168.206.26@tcp:16:lhsmtool_posix.0 Request processed in 94us (435us total) trans 0 rc 0/0 00000100:00100000:0.0:1789049629.308432:0:15011:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.26@tcp, seq: 15 00000100:00100000:1.0:1789049629.319090:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.26@tcp (source: 12345-192.168.206.26@tcp) 00000100:00100000:2.0:1789049629.319320:0:14329:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954089715840 00000100:00100000:2.0:1789049629.319329:0:14329:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954089715840 00000100:00100000:2.0:1789049629.319649:0:14329:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.26@tcp, seq: 52 00000100:00100000:2.0:1789049629.319753:0:14329:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb900e40700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b76d50d5-035a-43d0-9ba1-e61b094296a4+14:14459:x1875954089715840:12345-192.168.206.26@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1789049629.319804:0:14329:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789049629.319831:0:14329:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb900e62a00/0xf4f48ce5e1bc03d4 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a3899 expref: 14 pid: 14329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049629.320255:0:14329:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8cb8ce751400) 00010000:00010000:2.0:1789049629.320261:0:14329:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789049629.320302:0:14329:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb900e62800/0xf4f48ce5e1bc03e2 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049629.320316:0:14329:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cb900e62800/0xf4f48ce5e1bc03e2 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049629.320326:0:14329:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb900e62800/0xf4f48ce5e1bc03e2 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14329 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789049629.320763:0:14329:0:(mdt_handler.c:4507:mdt_save_lock()) ### save lock request 00000000343d32a1 reply state 00000000d7b6ba59 transno 8589934617 ns: mdt-lustre-MDT0000_UUID lock: ffff8cb900e62800/0xf4f48ce5e1bc03e2 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14329 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789049629.320773:0:14329:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1789049629.320991:0:14329:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb900e40700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b76d50d5-035a-43d0-9ba1-e61b094296a4+15:14459:x1875954089715840:12345-192.168.206.26@tcp:36:lhsmtool_posix.0 Request processed in 1329us (1909us total) trans 8589934617 rc 0/0 00000100:00100000:2.0:1789049629.321015:0:14329:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.26@tcp, seq: 52 00010000:00010000:3.0:1789049629.324230:0:3295:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb900e62800/0xf4f48ce5e1bc03e2 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049629.324246:0:3295:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cb900e62800/0xf4f48ce5e1bc03e2 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049629.324252:0:3295:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cb900e62800/0xf4f48ce5e1bc03e2 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049629.324258:0:3295:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cb900e62800 already unused, calling callback (ffffffffc20ca4f0) 00010000:00010000:3.0:1789049629.324262:0:3295:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb900e62800/0xf4f48ce5e1bc03e2 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049629.324284:0:3295:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb900e62800/0xf4f48ce5e1bc03e2 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049629.324300:0:3295:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8cb8ce751400) 00010000:00010000:3.0:1789049629.324303:0:3295:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789049629.324307:0:3295:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cb900e62800/0xf4f48ce5e1bc03e2 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14329 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049629.324313:0:3295:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb900e62800/0xf4f48ce5e1bc03e2 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14329 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789049629.329566:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.26@tcp (source: 12345-192.168.206.26@tcp) 00000100:00100000:3.0:1789049629.329775:0:15013:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954089715968 00000100:00100000:3.0:1789049629.329784:0:15013:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954089715968 00000100:00100000:3.0:1789049629.329974:0:15013:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.26@tcp, seq: 16 00000100:00100000:3.0:1789049629.329986:0:15013:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb900e97100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b76d50d5-035a-43d0-9ba1-e61b094296a4+7:14459:x1875954089715968:12345-192.168.206.26@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789049629.330002:0:15013:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789049629.330019:0:15013:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000147d38c/0xf4f48ce5e1bc03e9 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x7fc5e358805a38a7 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049629.330048:0:15013:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000b2b735dc/0xf4f48ce5e1bc03db lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a38a0 expref: 8 pid: 15013 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049629.330057:0:15013:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789049629.330061:0:15013:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789049629.330066:0:15013:0:(ldlm_resource.c:1751:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000147d38c/0xf4f48ce5e1bc03e9 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a38a7 expref: 8 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049629.330122:0:15013:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000b2b735dc/0xf4f48ce5e1bc03db lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a38a0 expref: 8 pid: 15013 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049629.330136:0:15013:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000b2b735dc/0xf4f48ce5e1bc03db lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a38a0 expref: 8 pid: 15013 timeout: 555 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789049629.330149:0:15013:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb8df262680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:15013:1875954110666496:192.168.206.26@tcp:104: 00000100:00100000:3.0:1789049629.330246:0:15013:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cb9009a8cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1789049629.335949:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.26@tcp (source: 12345-192.168.206.26@tcp) 00000100:00100000:0.0:1789049629.336031:0:16447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954089716096 00000100:00100000:0.0:1789049629.336040:0:16447:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954089716096 00010000:00010000:0.0:1789049629.336079:0:16447:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000b2b735dc/0xf4f48ce5e1bc03db lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a38a0 expref: 9 pid: 15013 timeout: 555 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789049629.336133:0:16447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.26@tcp, seq: 13 00000100:00100000:0.0:1789049629.336148:0:16447:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb900e43800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b76d50d5-035a-43d0-9ba1-e61b094296a4+9:2358:x1875954089716096:12345-192.168.206.26@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789049629.336163:0:16447:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789049629.336186:0:16447:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000b2b735dc/0xf4f48ce5e1bc03db lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a38a0 expref: 9 pid: 15013 timeout: 555 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049629.336210:0:16447:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000b2b735dc/0xf4f48ce5e1bc03db lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a38a0 expref: 9 pid: 15013 timeout: 555 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049629.336234:0:16447:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789049629.336238:0:16447:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789049629.336245:0:16447:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000000147d38c/0xf4f48ce5e1bc03e9 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50080000000000 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a38a7 expref: 9 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049629.336269:0:16447:0:(ldlm_resource.c:1751:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000147d38c/0xf4f48ce5e1bc03e9 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50080000000000 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a38a7 expref: 9 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049629.336305:0:16447:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 000000000147d38c/0xf4f48ce5e1bc03e9 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a38a7 expref: 9 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789049629.336319:0:16447:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb9009c2a00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:16447:1875954110666624:192.168.206.26@tcp:105: 00000100:00100000:0.0:1789049629.336408:0:16447:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cb8ff336180 going to sleep for 11 seconds 00010000:00010000:3.0:1789049629.336654:0:15013:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b2b735dc/0xf4f48ce5e1bc03db lrc: 0/0,0 mode: --/PR res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a38a0 expref: 9 pid: 15013 timeout: 555 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789049629.336681:0:15013:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb8df262680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:15013:1875954110666496:192.168.206.26@tcp:104: 00010000:00010000:3.0:1789049629.336709:0:15013:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000000147d38c/0xf4f48ce5e1bc03e9 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a38a7 expref: 8 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049629.336721:0:15013:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cb8d6715600, rc 0) 00000100:00100000:3.0:1789049629.336758:0:15013:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb900e97100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b76d50d5-035a-43d0-9ba1-e61b094296a4+8:14459:x1875954089715968:12345-192.168.206.26@tcp:101:lhsmtool_posix.0 Request processed in 6774us (7198us total) trans 0 rc 0/0 00000100:00100000:3.0:1789049629.336767:0:15013:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.26@tcp, seq: 16 00000100:00100000:1.0:1789049629.340722:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.26@tcp (source: 12345-192.168.206.26@tcp) 00000100:00100000:3.0:1789049629.340964:0:15014:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954089716224 00000100:00100000:3.0:1789049629.340974:0:15014:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954089716224 00000100:00100000:3.0:1789049629.341027:0:15014:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.26@tcp, seq: 17 00000100:00100000:3.0:1789049629.341036:0:15014:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb900e40000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b76d50d5-035a-43d0-9ba1-e61b094296a4+8:2358:x1875954089716224:12345-192.168.206.26@tcp:2:lhsmtool_posix.0 00002000:00010000:3.0:1789049629.341243:0:15014:0:(ofd_lvb.c:321:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1789049629.341247:0:15014:0:(ofd_lvb.c:328:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb mtime from disk: 0 -> 1789049627701000000 00002000:00010000:3.0:1789049629.341249:0:15014:0:(ofd_lvb.c:334:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb atime from disk: 0 -> 1789049627052957886 00002000:00010000:3.0:1789049629.341252:0:15014:0:(ofd_lvb.c:340:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb ctime from disk: 1789049628484000000 -> 1789049627701000000 00002000:00010000:3.0:1789049629.341255:0:15014:0:(ofd_lvb.c:346:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:3.0:1789049629.341311:0:15014:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb900e40000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b76d50d5-035a-43d0-9ba1-e61b094296a4+9:2358:x1875954089716224:12345-192.168.206.26@tcp:2:lhsmtool_posix.0 Request processed in 276us (598us total) trans 8589934596 rc 0/0 00000100:00100000:3.0:1789049629.341319:0:15014:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.26@tcp, seq: 17 00000100:00100000:3.0:1789049629.345157:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.26@tcp (source: 12345-192.168.206.26@tcp) 00000100:00100000:0.0:1789049629.345443:0:16447:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb9009c2a00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:16447:1875954110666624:192.168.206.26@tcp:105: 00010000:00010000:0.0:1789049629.345469:0:16447:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789049629.345572:0:15013:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954089716352 00000100:00100000:1.0:1789049629.345579:0:15013:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954089716352 00000100:00100000:1.0:1789049629.345640:0:15013:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.26@tcp, seq: 18 00000100:00100000:1.0:1789049629.345651:0:15013:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8df262680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b76d50d5-035a-43d0-9ba1-e61b094296a4+9:2357:x1875954089716352:12345-192.168.206.26@tcp:1:lhsmtool_posix.0 00010000:00010000:1.0:1789049629.345902:0:15013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000001870f5eb/0xf4f48ce5e1bc03f0 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049629.345922:0:15013:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000000147d38c/0xf4f48ce5e1bc03e9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a38a7 expref: 9 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049629.345931:0:15013:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789049629.345935:0:15013:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1789049629.345939:0:15013:0:(ldlm_resource.c:1751:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001870f5eb/0xf4f48ce5e1bc03f0 lrc: 4/1,0 mode: --/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049629.345973:0:15013:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000000147d38c/0xf4f48ce5e1bc03e9 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000020020 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a38a7 expref: 9 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049629.345986:0:15013:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000000147d38c/0xf4f48ce5e1bc03e9 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400020020 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a38a7 expref: 9 pid: 15013 timeout: 555 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789049629.345998:0:15013:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb900e40380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:15013:1875954110666752:192.168.206.26@tcp:104: 00000100:00100000:1.0:1789049629.346069:0:15013:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cb8c5976780 going to sleep for 11 seconds 00000100:00100000:1.0:1789049629.346096:0:16447:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb900e43800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b76d50d5-035a-43d0-9ba1-e61b094296a4+9:2358:x1875954089716096:12345-192.168.206.26@tcp:103:ldlm_bl.0 Request processed in 9955us (10157us total) trans 0 rc 0/0 00000100:00100000:1.0:1789049629.346105:0:16447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.26@tcp, seq: 13 00000100:00100000:1.0:1789049629.350332:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.26@tcp (source: 12345-192.168.206.26@tcp) 00000100:00100000:3.0:1789049629.350452:0:15013:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb900e40380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:15013:1875954110666752:192.168.206.26@tcp:104: 00010000:00010000:3.0:1789049629.350480:0:15013:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000001870f5eb/0xf4f48ce5e1bc03f0 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789049629.351030:0:14314:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954089716480 00000100:00100000:0.0:1789049629.351039:0:14314:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954089716480 00010000:00010000:1.0:1789049629.351216:0:14314:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000000147d38c/0xf4f48ce5e1bc03e9 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a38a7 expref: 9 pid: 15013 timeout: 555 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789049629.351301:0:14314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.26@tcp, seq: 14 00000100:00100000:1.0:1789049629.351311:0:14314:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8f7b92680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b76d50d5-035a-43d0-9ba1-e61b094296a4+9:2358:x1875954089716480:12345-192.168.206.26@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789049629.351327:0:14314:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789049629.351357:0:14314:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000000147d38c/0xf4f48ce5e1bc03e9 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a38a7 expref: 9 pid: 15013 timeout: 555 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049629.351371:0:14314:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000000147d38c/0xf4f48ce5e1bc03e9 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400020020 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a38a7 expref: 9 pid: 15013 timeout: 555 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049629.351393:0:14314:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000147d38c/0xf4f48ce5e1bc03e9 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400020020 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a38a7 expref: 9 pid: 15013 timeout: 555 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049629.351409:0:14314:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1789049629.351413:0:14314:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1789049629.351418:0:14314:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000001870f5eb/0xf4f48ce5e1bc03f0 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049629.351428:0:14314:0:(ldlm_resource.c:1751:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001870f5eb/0xf4f48ce5e1bc03f0 lrc: 4/1,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049629.351458:0:14314:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789049629.351513:0:14314:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8f7b92680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b76d50d5-035a-43d0-9ba1-e61b094296a4+8:2358:x1875954089716480:12345-192.168.206.26@tcp:103:ldlm_bl.0 Request processed in 204us (1190us total) trans 0 rc 0/0 00000100:00100000:1.0:1789049629.351533:0:14314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.26@tcp, seq: 14 00010000:00010000:3.0:1789049629.352503:0:15013:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000001870f5eb/0xf4f48ce5e1bc03f0 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049629.352521:0:15013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001870f5eb/0xf4f48ce5e1bc03f0 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049629.352564:0:15013:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000001870f5eb/0xf4f48ce5e1bc03f0 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049629.352574:0:15013:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001870f5eb/0xf4f48ce5e1bc03f0 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049629.352599:0:15013:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001870f5eb/0xf4f48ce5e1bc03f0 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049629.352615:0:15013:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cb8c28c3800 already unused, calling callback (ffffffffc166a8f0) 00010000:00010000:3.0:1789049629.352619:0:15013:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001870f5eb/0xf4f48ce5e1bc03f0 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049629.352629:0:15013:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001870f5eb/0xf4f48ce5e1bc03f0 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049629.352646:0:15013:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001870f5eb/0xf4f48ce5e1bc03f0 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049629.352654:0:15013:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001870f5eb/0xf4f48ce5e1bc03f0 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789049629.352919:0:15013:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8df262680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b76d50d5-035a-43d0-9ba1-e61b094296a4+8:2357:x1875954089716352:12345-192.168.206.26@tcp:1:lhsmtool_posix.0 Request processed in 7268us (7769us total) trans 0 rc 0/0 00000100:00100000:3.0:1789049629.352930:0:15013:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.26@tcp, seq: 18 00000100:00100000:3.0:1789049629.356241:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.26@tcp (source: 12345-192.168.206.26@tcp) 00000100:00100000:0.0:1789049629.356333:0:14327:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954089716736 00000100:00100000:0.0:1789049629.356353:0:14327:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954089716736 00000100:00100000:0.0:1789049629.356404:0:14327:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.26@tcp, seq: 53 00000100:00100000:0.0:1789049629.356414:0:14327:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8df261500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b76d50d5-035a-43d0-9ba1-e61b094296a4+14:14459:x1875954089716736:12345-192.168.206.26@tcp:57:lhsmtool_posix.0 00010000:00010000:0.0:1789049629.356491:0:14327:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d776e800/0xf4f48ce5e1bc03f7 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049629.356508:0:14327:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d776e800/0xf4f48ce5e1bc03f7 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049629.356519:0:14327:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d776e800/0xf4f48ce5e1bc03f7 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049629.356786:0:14327:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d776f400/0xf4f48ce5e1bc03fe lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049629.356804:0:14327:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c2c00/0xf4f48ce5e1bc03c6 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a3892 expref: 15 pid: 16204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049629.356811:0:14327:0:(ldlm_resource.c:1751:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d776f400/0xf4f48ce5e1bc03fe lrc: 4/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049629.356871:0:14327:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c2c00/0xf4f48ce5e1bc03c6 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a3892 expref: 15 pid: 16204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049629.356885:0:14327:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c2c00/0xf4f48ce5e1bc03c6 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a3892 expref: 15 pid: 16204 timeout: 555 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789049629.356900:0:14327:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb9009c2a00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14327:1875954110666880:192.168.206.26@tcp:104: 00000100:00100000:0.0:1789049629.356974:0:14327:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cb8ff336180 going to sleep for 11 seconds 00000100:00100000:0.0:1789049629.360012:0:14327:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb9009c2a00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14327:1875954110666880:192.168.206.26@tcp:104: 00010000:00010000:0.0:1789049629.360039:0:14327:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d776f400/0xf4f48ce5e1bc03fe lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14327 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789049629.361442:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.26@tcp (source: 12345-192.168.206.26@tcp) 00000100:00100000:2.0:1789049629.361822:0:14315:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954089716864 00000100:00100000:2.0:1789049629.361832:0:14315:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954089716864 00010000:00010000:2.0:1789049629.361913:0:14315:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c2c00/0xf4f48ce5e1bc03c6 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a3892 expref: 16 pid: 16204 timeout: 555 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789049629.361946:0:14315:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.26@tcp, seq: 15 00000100:00100000:2.0:1789049629.361955:0:14315:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8df260e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b76d50d5-035a-43d0-9ba1-e61b094296a4+16:2357:x1875954089716864:12345-192.168.206.26@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789049629.361969:0:14315:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789049629.361975:0:14315:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c2c00/0xf4f48ce5e1bc03c6 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a3892 expref: 16 pid: 16204 timeout: 555 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049629.361987:0:14315:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c2c00/0xf4f48ce5e1bc03c6 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a3892 expref: 16 pid: 16204 timeout: 555 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049629.362007:0:14315:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c2c00/0xf4f48ce5e1bc03c6 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a3892 expref: 16 pid: 16204 timeout: 555 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049629.362023:0:14315:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8cb8ce751400) 00010000:00010000:2.0:1789049629.362028:0:14315:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d776f400/0xf4f48ce5e1bc03fe lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049629.362039:0:14315:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d776f400/0xf4f48ce5e1bc03fe lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 14327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049629.362046:0:14315:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d776f400/0xf4f48ce5e1bc03fe lrc: 4/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 14327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049629.362088:0:14315:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789049629.362138:0:14315:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8df260e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b76d50d5-035a-43d0-9ba1-e61b094296a4+15:2357:x1875954089716864:12345-192.168.206.26@tcp:103:ldlm_bl.0 Request processed in 183us (702us total) trans 0 rc 0/0 00000100:00100000:2.0:1789049629.362145:0:14315:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.26@tcp, seq: 15 00010000:00010000:3.0:1789049629.363235:0:14327:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d776f400/0xf4f48ce5e1bc03fe lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049629.363249:0:14327:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d776f400/0xf4f48ce5e1bc03fe lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14327 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789049629.363482:0:14327:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934618 00000001:00080000:3.0:1789049629.363956:0:14327:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934619 00000001:00080000:3.0:1789049629.364005:0:14327:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934620 00000100:00100000:3.0:1789049629.364092:0:14327:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb8df260380 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:14327:1875954110667008:0@lo:1000:mdt00_000.0 00000100:00100000:3.0:1789049629.364202:0:14327:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789049629.364228:0:14327:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cb9009a8a80 going to sleep for 11 seconds 00000100:00100000:0.0:1789049629.364640:0:14332:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954110667008 00000100:00100000:0.0:1789049629.364649:0:14332:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954110667008 00000100:00100000:0.0:1789049629.364708:0:14332:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1789049629.364717:0:14332:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8df260700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:14327:x1875954110667008:12345-0@lo:1000:mdt00_000.0 00000100:00100000:0.0:1789049629.364810:0:14332:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8df260700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:14327:x1875954110667008:12345-0@lo:1000:mdt00_000.0 Request processed in 94us (617us total) trans 0 rc 0/0 00000100:00100000:0.0:1789049629.364817:0:14332:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1789049629.365002:0:14327:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb8df260380 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:14327:1875954110667008:0@lo:1000:mdt00_000.0 00000001:00080000:2.0:1789049629.365646:0:14327:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934621 00000100:00100000:2.0:1789049629.365727:0:14327:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb900e97b80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:14327:1875954110667136:0@lo:1000:mdt00_000.0 00000100:00100000:2.0:1789049629.365769:0:14327:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789049629.365796:0:14327:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cb8c7c97000 going to sleep for 11 seconds 00000100:00100000:2.0:1789049629.365820:0:14332:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954110667136 00000100:00100000:2.0:1789049629.365825:0:14332:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954110667136 00000100:00100000:2.0:1789049629.365878:0:14332:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1789049629.365885:0:14332:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8d0ab5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:14327:x1875954110667136:12345-0@lo:1000:mdt00_000.0 00000100:00100000:2.0:1789049629.366023:0:14332:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8d0ab5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:14327:x1875954110667136:12345-0@lo:1000:mdt00_000.0 Request processed in 137us (253us total) trans 8589934597 rc 0/0 00000100:00100000:2.0:1789049629.366030:0:14332:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1789049629.366063:0:14327:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb900e97b80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:14327:1875954110667136:0@lo:1000:mdt00_000.0 00010000:00010000:2.0:1789049629.366092:0:14327:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d776f400/0xf4f48ce5e1bc03fe lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049629.366102:0:14327:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d776f400/0xf4f48ce5e1bc03fe lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049629.366109:0:14327:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d776f400/0xf4f48ce5e1bc03fe lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049629.366115:0:14327:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cb8d776f400 already unused, calling callback (ffffffffc20ca4f0) 00010000:00010000:2.0:1789049629.366128:0:14327:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d776f400/0xf4f48ce5e1bc03fe lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049629.366136:0:14327:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d776f400/0xf4f48ce5e1bc03fe lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049629.366151:0:14327:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8cb8ce751400) 00010000:00010000:2.0:1789049629.366154:0:14327:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1789049629.366158:0:14327:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d776f400/0xf4f48ce5e1bc03fe lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049629.366165:0:14327:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d776f400/0xf4f48ce5e1bc03fe lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049629.366204:0:14327:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c3200/0xf4f48ce5e1bc0356 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 16204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049629.366211:0:14327:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c3200/0xf4f48ce5e1bc0356 lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 16204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049629.366217:0:14327:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c3200/0xf4f48ce5e1bc0356 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 16204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049629.366223:0:14327:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cb8c28c3200 already unused, calling callback (ffffffffc20ca4f0) 00010000:00010000:2.0:1789049629.366226:0:14327:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c3200/0xf4f48ce5e1bc0356 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 16204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049629.366232:0:14327:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c3200/0xf4f48ce5e1bc0356 lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 16204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049629.366240:0:14327:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8cb8c396d100) 00010000:00010000:2.0:1789049629.366242:0:14327:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1789049629.366256:0:14327:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d776e400/0xf4f48ce5e1bc035d lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a3876 expref: 18 pid: 16306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049629.366267:0:14327:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d776e400/0xf4f48ce5e1bc035d lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a3876 expref: 18 pid: 16306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049629.366276:0:14327:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d776e400/0xf4f48ce5e1bc035d lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a3876 expref: 18 pid: 16306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049629.366300:0:14327:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d776e400/0xf4f48ce5e1bc035d lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.26@tcp remote: 0x7fc5e358805a3876 expref: 18 pid: 16306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789049629.366311:0:14327:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb8d0ab7800 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14327:1875954110667264:192.168.206.26@tcp:105: 00000100:00100000:2.0:1789049629.366366:0:14327:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cb8c7c97000 going to sleep for 11 seconds 00000100:00100000:2.0:1789049629.372008:0:14327:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb8d0ab7800 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14327:1875954110667264:192.168.206.26@tcp:105: 00010000:00010000:2.0:1789049629.372039:0:14327:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c3200/0xf4f48ce5e1bc0356 lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 16204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049629.372049:0:14327:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8c28c3200/0xf4f48ce5e1bc0356 lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 16204 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049629.372083:0:14327:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb900e63c00/0xf4f48ce5e1bc0405 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049629.372102:0:14327:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cb900e63c00/0xf4f48ce5e1bc0405 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049629.372114:0:14327:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb900e63c00/0xf4f48ce5e1bc0405 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049629.372144:0:14327:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb900e63c00/0xf4f48ce5e1bc0405 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049629.372151:0:14327:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cb900e63c00/0xf4f48ce5e1bc0405 lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049629.372157:0:14327:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cb900e63c00/0xf4f48ce5e1bc0405 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049629.372164:0:14327:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cb900e63c00 already unused, calling callback (ffffffffc20ca4f0) 00010000:00010000:2.0:1789049629.372169:0:14327:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb900e63c00/0xf4f48ce5e1bc0405 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049629.372175:0:14327:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb900e63c00/0xf4f48ce5e1bc0405 lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049629.372186:0:14327:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8cb8c396d100) 00010000:00010000:2.0:1789049629.372189:0:14327:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789049629.372202:0:14327:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cb900e63c00/0xf4f48ce5e1bc0405 lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049629.372208:0:14327:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb900e63c00/0xf4f48ce5e1bc0405 lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049629.372217:0:14327:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d776e800/0xf4f48ce5e1bc03f7 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049629.372224:0:14327:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d776e800/0xf4f48ce5e1bc03f7 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049629.372229:0:14327:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d776e800/0xf4f48ce5e1bc03f7 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049629.372241:0:14327:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cb8d776e800 already unused, calling callback (ffffffffc20ca4f0) 00010000:00010000:2.0:1789049629.372244:0:14327:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d776e800/0xf4f48ce5e1bc03f7 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049629.372251:0:14327:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d776e800/0xf4f48ce5e1bc03f7 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049629.372260:0:14327:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8cb8c396d100) 00010000:00010000:2.0:1789049629.372262:0:14327:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1789049629.372265:0:14327:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d776e800/0xf4f48ce5e1bc03f7 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14327 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049629.372270:0:14327:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d776e800/0xf4f48ce5e1bc03f7 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14327 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789049629.372508:0:14327:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8df261500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b76d50d5-035a-43d0-9ba1-e61b094296a4+18:14459:x1875954089716736:12345-192.168.206.26@tcp:57:lhsmtool_posix.0 Request processed in 16094us (16273us total) trans 8589934622 rc 0/0 00000100:00100000:2.0:1789049629.372518:0:14327:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.26@tcp, seq: 53 00000020:00080000:2.0:1789049629.372525:0:14327:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:3.0:1789049629.372955:0:14362:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:3.0:1789049629.372960:0:14362:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1789049629.372983:0:14362:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:3.0:1789049629.372987:0:14362:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:2.0:1789049629.375815:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.26@tcp (source: 12345-192.168.206.26@tcp) 00000100:00100000:1.0:1789049629.375930:0:14330:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954089716992 00000100:00100000:1.0:1789049629.375939:0:14330:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954089716992 00000100:00100000:1.0:1789049629.375994:0:14330:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.26@tcp, seq: 10 00000100:00100000:1.0:1789049629.376004:0:14330:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8db326450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b76d50d5-035a-43d0-9ba1-e61b094296a4+18:14458:x1875954089716992:12345-192.168.206.26@tcp:49:dd.0 00000100:00100000:1.0:1789049629.376125:0:14330:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8db326450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b76d50d5-035a-43d0-9ba1-e61b094296a4+18:14458:x1875954089716992:12345-192.168.206.26@tcp:49:dd.0 Request processed in 121us (319us total) trans 0 rc 0/0 00000100:00100000:1.0:1789049629.376133:0:14330:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.26@tcp, seq: 10 00000100:00100000:1.0:1789049629.388269:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.26@tcp (source: 12345-192.168.206.26@tcp) 00000100:00100000:3.0:1789049629.388370:0:14330:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954089717248 00000100:00100000:3.0:1789049629.388380:0:14330:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954089717248 00000100:00100000:3.0:1789049629.388435:0:14330:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.26@tcp, seq: 11 00000100:00100000:3.0:1789049629.388445:0:14330:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8f7b90e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b76d50d5-035a-43d0-9ba1-e61b094296a4+18:14459:x1875954089717248:12345-192.168.206.26@tcp:35:lhsmtool_posix.0 00000004:00080000:3.0:1789049629.389599:0:14330:0:(mdd_object.c:4014:mdd_close()) Object [0x200000bd1:0x3:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:3.0:1789049629.389827:0:14330:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934623 00010000:00010000:3.0:1789049629.389901:0:14330:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6714800/0xf4f48ce5e1bc040c lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14330 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049629.389918:0:14330:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6714800/0xf4f48ce5e1bc040c lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 14330 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049629.389931:0:14330:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6714800/0xf4f48ce5e1bc040c lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 14330 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049629.389938:0:14330:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6714800/0xf4f48ce5e1bc040c lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 14330 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049629.389945:0:14330:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6714800/0xf4f48ce5e1bc040c lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 14330 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049629.389958:0:14330:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6714800/0xf4f48ce5e1bc040c lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 14330 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049629.390032:0:14330:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1789049629.390136:0:14330:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8f7b90e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b76d50d5-035a-43d0-9ba1-e61b094296a4+20:14459:x1875954089717248:12345-192.168.206.26@tcp:35:lhsmtool_posix.0 Request processed in 1690us (1873us total) trans 8589934624 rc 0/0 00000100:00100000:3.0:1789049629.390145:0:14330:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.26@tcp, seq: 11 00000020:00080000:3.0:1789049629.390150:0:14330:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1789049629.398055:0:15620:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789049629.398069:0:15620:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6714800/0xf4f48ce5e1bc040c lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 14330 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049629.398081:0:15620:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cb8d6714800 already unused, calling callback (ffffffffc166a8f0) 00010000:00010000:2.0:1789049629.398085:0:15620:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6714800/0xf4f48ce5e1bc040c lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 14330 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049629.398108:0:15620:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6714800/0xf4f48ce5e1bc040c lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 14330 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049629.398142:0:15620:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8cb8ce751400) 00010000:00010000:2.0:1789049629.398145:0:15620:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1789049629.398150:0:15620:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6714800/0xf4f48ce5e1bc040c lrc: 1/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 14330 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049629.398156:0:15620:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cb8d6714800/0xf4f48ce5e1bc040c lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 14330 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049629.398175:0:15620:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789049629.398177:0:15620:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789049629.398179:0:15620:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789049629.589320:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.26@tcp (source: 12345-192.168.206.26@tcp) 00000100:00100000:3.0:1789049629.589361:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.26@tcp (source: 12345-192.168.206.26@tcp) 00000100:00100000:3.0:1789049629.589401:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.26@tcp (source: 12345-192.168.206.26@tcp) 00000100:00100000:2.0:1789049629.589505:0:15019:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954089717376 00000100:00100000:2.0:1789049629.589514:0:15019:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954089717376 00000100:00100000:2.0:1789049629.589562:0:15019:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954089717632 00000100:00100000:2.0:1789049629.589566:0:15019:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954089717632 00000100:00100000:2.0:1789049629.589579:0:15019:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954089717504 00000100:00100000:2.0:1789049629.589581:0:15019:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954089717504 00000100:00100000:2.0:1789049629.589609:0:15019:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.26@tcp, seq: 0 00000100:00100000:2.0:1789049629.589619:0:15019:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8df261180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:b76d50d5-035a-43d0-9ba1-e61b094296a4+9:2358:x1875954089717376:12345-192.168.206.26@tcp:4:dd.0 00002000:00010000:2.0:1789049629.589666:0:15019:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x22:0x0] initial LVB size: 0, mtime: 0x18d3fb2858a9b740, atime: 0x18d3fb28320960be, ctime: 0x18d3fb2858a9b740, blocks: 0x1 00010000:00010000:2.0:1789049629.589676:0:15019:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e43ebbe8/0xf4f48ce5e1bc0413 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15019 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049629.589691:0:15019:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=455s v=(0 0) 00010000:00010000:2.0:1789049629.589696:0:15019:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789049629.589702:0:15019:0:(ldlm_resource.c:1751:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e43ebbe8/0xf4f48ce5e1bc0413 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15019 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049629.589716:0:15019:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e43ebbe8/0xf4f48ce5e1bc0413 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15019 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789049629.595352:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb9009c2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1875954110667392:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789049629.595429:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789049629.596610:0:15016:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954110667392 00000100:00100000:2.0:1789049629.596618:0:15016:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954110667392 00000100:00100000:0.0:1789049629.596806:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb8d0ab7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:817823bd-3ba1-432d-9714-f03a15bff403:3311:1875954110667520:0@lo:400:kworker.0 00000100:00100000:0.0:1789049629.596868:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789049629.596916:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb8d0ab7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3310:1875954110667904:0@lo:400:kworker.0 00000100:00100000:1.0:1789049629.596947:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789049629.596982:0:16306:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954110667904 00000100:00100000:1.0:1789049629.596987:0:16306:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954110667904 00000100:00100000:1.0:1789049629.597021:0:16306:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1789049629.597029:0:16306:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb7c7145f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1875954110667904:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789049629.597077:0:16306:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb7c7145f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1875954110667904:12345-0@lo:400:kworker.0 Request processed in 49us (129us total) trans 0 rc 0/0 00000100:00100000:1.0:1789049629.597084:0:16306:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1789049629.597125:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb8d0ab7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3310:1875954110667904:0@lo:400:kworker.0 00000100:00080000:0.0:1789049629.603091:0:14324:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789049629.603101:0:14324:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789049629.603118:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb8d0ab5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3308:1875954110667648:0@lo:400:kworker.0 00000100:00100000:0.0:1789049629.603170:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789049629.603208:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789049629.603215:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb8d0ab4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3308:1875954110667776:0@lo:400:kworker.0 00000100:00100000:0.0:1789049629.603237:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789049629.603281:0:14321:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954110667520 00000100:00100000:0.0:1789049629.603289:0:14321:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954110667520 00000100:00100000:0.0:1789049629.603327:0:14321:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:0.0:1789049629.603335:0:14321:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb900c58050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:817823bd-3ba1-432d-9714-f03a15bff403+19:3311:x1875954110667520:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789049629.603382:0:14321:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb900c58050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:817823bd-3ba1-432d-9714-f03a15bff403+19:3311:x1875954110667520:12345-0@lo:400:kworker.0 Request processed in 47us (6513us total) trans 0 rc 0/0 00000100:00100000:0.0:1789049629.603389:0:14321:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00000100:00100000:0.0:1789049629.603418:0:15015:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1789049629.603426:0:15015:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb9009c3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1875954110667392:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1789049629.603464:0:15015:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789049629.603500:0:15015:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb9009c3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1875954110667392:12345-0@lo:13:osp-pre-1-0.0 Request processed in 75us (8071us total) trans 0 rc 0/0 00000100:00100000:0.0:1789049629.603506:0:15015:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1789049629.603550:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb8d0ab7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:817823bd-3ba1-432d-9714-f03a15bff403:3311:1875954110667520:0@lo:400:kworker.0 00000100:00100000:0.0:1789049629.603793:0:14329:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954110667648 00000100:00100000:0.0:1789049629.603811:0:14329:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954110667648 00000100:00100000:0.0:1789049629.603838:0:14329:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954110667776 00000100:00100000:0.0:1789049629.603865:0:14329:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954110667776 00000100:00100000:0.0:1789049629.603892:0:14329:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1789049629.603899:0:14329:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb9009c0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1875954110667648:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789049629.603939:0:14329:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb9009c0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1875954110667648:12345-0@lo:400:kworker.0 Request processed in 40us (768us total) trans 0 rc 0/0 00000100:00100000:0.0:1789049629.603946:0:14329:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1789049629.603958:0:14329:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1789049629.603963:0:14329:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb9009c1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1875954110667776:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789049629.603990:0:14329:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb9009c1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1875954110667776:12345-0@lo:400:kworker.0 Request processed in 26us (752us total) trans 0 rc 0/0 00000100:00100000:0.0:1789049629.603996:0:14329:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00080000:0.0:1789049629.604009:0:14324:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789049629.604028:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb8d0ab4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3308:1875954110667776:0@lo:400:kworker.0 00000100:00100000:0.0:1789049629.604038:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb8d0ab5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3308:1875954110667648:0@lo:400:kworker.0 00000100:00100000:1.0:1789049629.604282:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb9009c2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1875954110667392:0@lo:13:osp-pre-1-0.0 00002000:00010000:0.0:1789049629.744705:0:15019:0:(ofd_lvb.c:321:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb size from disk: 0 -> 1048576 00002000:00010000:0.0:1789049629.744719:0:15019:0:(ofd_lvb.c:328:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb mtime from disk: 1789049627701000000 -> 1789049628701000000 00002000:00010000:0.0:1789049629.744723:0:15019:0:(ofd_lvb.c:346:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb blocks from disk: 1 -> 2051 00010000:00010000:0.0:1789049629.744743:0:15019:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e43ebbe8/0xf4f48ce5e1bc0413 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15019 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049629.744760:0:15019:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e43ebbe8/0xf4f48ce5e1bc0413 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 15019 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049629.744771:0:15019:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e43ebbe8/0xf4f48ce5e1bc0413 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15019 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049629.744798:0:15019:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cb900e63c00 already unused, calling callback (ffffffffc166a8f0) 00010000:00010000:0.0:1789049629.744804:0:15019:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e43ebbe8/0xf4f48ce5e1bc0413 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15019 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049629.744815:0:15019:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e43ebbe8/0xf4f48ce5e1bc0413 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 15019 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049629.744841:0:15019:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e43ebbe8/0xf4f48ce5e1bc0413 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15019 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049629.744886:0:15019:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e43ebbe8/0xf4f48ce5e1bc0413 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15019 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789049629.745010:0:15019:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8df261180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:b76d50d5-035a-43d0-9ba1-e61b094296a4+11:2358:x1875954089717376:12345-192.168.206.26@tcp:4:dd.0 Request processed in 155387us (155693us total) trans 8589934598 rc 0/0 00000100:00100000:0.0:1789049629.745026:0:15019:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.26@tcp, seq: 0 00000100:00100000:0.0:1789049629.745064:0:15019:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.26@tcp, seq: 1 00000100:00100000:0.0:1789049629.745077:0:15019:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8df261880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:b76d50d5-035a-43d0-9ba1-e61b094296a4+10:2357:x1875954089717632:12345-192.168.206.26@tcp:4:dd.0 00002000:00010000:0.0:1789049629.745125:0:15019:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x22:0x0] initial LVB size: 1048576, mtime: 0x18d3fb2894448140, atime: 0x18d3fb28320960be, ctime: 0x0, blocks: 0x803 00010000:00010000:0.0:1789049629.745132:0:15019:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d7e13274/0xf4f48ce5e1bc041a lrc: 3/0,1 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15019 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049629.745145:0:15019:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=455s v=(0 0) 00010000:00010000:0.0:1789049629.745150:0:15019:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789049629.745158:0:15019:0:(ldlm_resource.c:1751:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d7e13274/0xf4f48ce5e1bc041a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15019 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049629.745178:0:15019:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d7e13274/0xf4f48ce5e1bc041a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15019 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789049629.745559:0:6731:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934598 is committed 00000001:00080000:1.0:1789049629.745586:0:6731:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934595 is committed 00000001:00080000:1.0:1789049629.745593:0:6731:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934597 is committed 00010000:00010000:2.0:1789049629.787411:0:14317:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1789049629.823956:0:6731:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934599 is committed 00002000:00010000:2.0:1789049629.825299:0:15019:0:(ofd_lvb.c:321:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb size from disk: 1048576 -> 3145728 00002000:00010000:2.0:1789049629.825311:0:15019:0:(ofd_lvb.c:346:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb blocks from disk: 2051 -> 4103 00010000:00010000:2.0:1789049629.825342:0:15019:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d7e13274/0xf4f48ce5e1bc041a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15019 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049629.825359:0:15019:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d7e13274/0xf4f48ce5e1bc041a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 15019 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049629.825370:0:15019:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d7e13274/0xf4f48ce5e1bc041a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15019 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049629.825378:0:15019:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cb8d776fc00 already unused, calling callback (ffffffffc166a8f0) 00010000:00010000:2.0:1789049629.825384:0:15019:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d7e13274/0xf4f48ce5e1bc041a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15019 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049629.825395:0:15019:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d7e13274/0xf4f48ce5e1bc041a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 15019 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049629.825651:0:15019:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d7e13274/0xf4f48ce5e1bc041a lrc: 2/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15019 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049629.825777:0:15019:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d7e13274/0xf4f48ce5e1bc041a lrc: 0/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15019 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789049629.826474:0:15019:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8df261880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:b76d50d5-035a-43d0-9ba1-e61b094296a4+6:2357:x1875954089717632:12345-192.168.206.26@tcp:4:dd.0 Request processed in 81391us (237102us total) trans 8589934599 rc 0/0 00000100:00100000:2.0:1789049629.826490:0:15019:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.26@tcp, seq: 1 00000100:00100000:2.0:1789049629.826536:0:15019:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.26@tcp, seq: 2 00000100:00100000:2.0:1789049629.826552:0:15019:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8df260380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:b76d50d5-035a-43d0-9ba1-e61b094296a4+5:2357:x1875954089717504:12345-192.168.206.26@tcp:4:dd.0 00002000:00010000:2.0:1789049629.826630:0:15019:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x22:0x0] initial LVB size: 3145728, mtime: 0x18d3fb2894448140, atime: 0x18d3fb28320960be, ctime: 0x0, blocks: 0x1007 00010000:00010000:2.0:1789049629.826641:0:15019:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fdd0598c/0xf4f48ce5e1bc0421 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15019 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049629.826659:0:15019:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=455s v=(0 0) 00010000:00010000:2.0:1789049629.827808:0:15019:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789049629.827818:0:15019:0:(ldlm_resource.c:1751:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fdd0598c/0xf4f48ce5e1bc0421 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15019 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049629.827867:0:15019:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fdd0598c/0xf4f48ce5e1bc0421 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15019 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789049629.851401:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.26@tcp (source: 12345-192.168.206.26@tcp) 00000100:00100000:1.0:1789049629.851445:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.26@tcp (source: 12345-192.168.206.26@tcp) 00000100:00100000:1.0:1789049629.851599:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.26@tcp (source: 12345-192.168.206.26@tcp) 00000100:00100000:2.0:1789049629.853719:0:15018:0:(service.c:3467:ptlrpc_start_thread()) ost_io[0] started 3 min 3 max 116 00000100:00100000:0.0:1789049629.857571:0:15017:0:(service.c:3467:ptlrpc_start_thread()) ost_io[0] started 3 min 3 max 116 00000100:00100000:1.0:1789049629.859887:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.26@tcp (source: 12345-192.168.206.26@tcp) 00000100:00100000:2.0:1789049629.863451:0:15018:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_io00_003' 00000100:00100000:3.0:1789049629.865056:0:15018:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954089717760 00000100:00100000:3.0:1789049629.865073:0:15018:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954089717760 00000100:00100000:3.0:1789049629.865159:0:15018:0:(service.c:3467:ptlrpc_start_thread()) ost_io[0] started 3 min 3 max 116 00000100:00100000:3.0:1789049629.865170:0:15018:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954089717888 00000100:00100000:3.0:1789049629.865173:0:15018:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954089717888 00000100:00100000:3.0:1789049629.865188:0:15018:0:(service.c:3467:ptlrpc_start_thread()) ost_io[0] started 3 min 3 max 116 00000100:00100000:3.0:1789049629.865206:0:15018:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954089718016 00000100:00100000:3.0:1789049629.865210:0:15018:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954089718016 00000100:00100000:2.0:1789049629.870536:0:16560:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.26@tcp, seq: 3 00000100:00100000:2.0:1789049629.870556:0:16560:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb7c7144a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:b76d50d5-035a-43d0-9ba1-e61b094296a4+11:2358:x1875954089717760:12345-192.168.206.26@tcp:4:dd.0 00010000:00010000:2.0:1789049629.870598:0:16560:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e43ebbe8/0xf4f48ce5e1bc0428 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049629.870628:0:16560:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789049629.870632:0:16560:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789049629.870638:0:16560:0:(ldlm_resource.c:1751:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e43ebbe8/0xf4f48ce5e1bc0428 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049629.870653:0:16560:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e43ebbe8/0xf4f48ce5e1bc0428 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789049629.871158:0:15017:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_io00_004' 00000100:00100000:0.0:1789049629.872487:0:16561:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.26@tcp, seq: 4 00000100:00100000:0.0:1789049629.872507:0:16561:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb7c7144000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:b76d50d5-035a-43d0-9ba1-e61b094296a4+12:2357:x1875954089717888:12345-192.168.206.26@tcp:4:dd.0 00010000:00010000:0.0:1789049629.872557:0:16561:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005641f1fd/0xf4f48ce5e1bc042f lrc: 3/0,1 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049629.872579:0:16561:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789049629.872584:0:16561:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789049629.872592:0:16561:0:(ldlm_resource.c:1751:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005641f1fd/0xf4f48ce5e1bc042f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049629.872609:0:16561:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005641f1fd/0xf4f48ce5e1bc042f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789049629.873836:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.26@tcp (source: 12345-192.168.206.26@tcp) 00000100:00100000:2.0:1789049629.873945:0:15018:0:(service.c:3467:ptlrpc_start_thread()) ost_io[0] started 5 min 3 max 116 00000100:00100000:2.0:1789049629.873955:0:15018:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_io00_005' 00000100:00100000:1.0:1789049629.874178:0:15018:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954089718272 00000100:00100000:1.0:1789049629.874188:0:15018:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954089718272 00000100:00100000:1.0:1789049629.874270:0:15018:0:(service.c:3467:ptlrpc_start_thread()) ost_io[0] started 5 min 3 max 116 00000100:00100000:1.0:1789049629.874277:0:15018:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954089718144 00000100:00100000:1.0:1789049629.874280:0:15018:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954089718144 00000100:00100000:2.0:1789049629.875474:0:16562:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.26@tcp, seq: 5 00000100:00100000:2.0:1789049629.875490:0:16562:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb7c7145880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b76d50d5-035a-43d0-9ba1-e61b094296a4+14:2358:x1875954089718016:12345-192.168.206.26@tcp:4:dd.0 00010000:00010000:2.0:1789049629.875527:0:16562:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e0b64209/0xf4f48ce5e1bc0436 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16562 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049629.877712:0:16562:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789049629.877728:0:16562:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789049629.877739:0:16562:0:(ldlm_resource.c:1751:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e0b64209/0xf4f48ce5e1bc0436 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16562 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049629.877761:0:16562:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e0b64209/0xf4f48ce5e1bc0436 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16562 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789049629.966608:0:6731:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934600 is committed 00002000:00010000:2.0:1789049629.968926:0:15019:0:(ofd_lvb.c:321:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb size from disk: 3145728 -> 6291456 00002000:00010000:2.0:1789049629.968939:0:15019:0:(ofd_lvb.c:346:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb blocks from disk: 4103 -> 8199 00010000:00010000:2.0:1789049629.968959:0:15019:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fdd0598c/0xf4f48ce5e1bc0421 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15019 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049629.968991:0:15019:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000fdd0598c/0xf4f48ce5e1bc0421 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 15019 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049629.969002:0:15019:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000fdd0598c/0xf4f48ce5e1bc0421 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15019 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049629.969010:0:15019:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cb900e62400 already unused, calling callback (ffffffffc166a8f0) 00010000:00010000:2.0:1789049629.969017:0:15019:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000fdd0598c/0xf4f48ce5e1bc0421 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15019 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049629.969027:0:15019:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000fdd0598c/0xf4f48ce5e1bc0421 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 15019 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049629.969056:0:15019:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000fdd0598c/0xf4f48ce5e1bc0421 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15019 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049629.969065:0:15019:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fdd0598c/0xf4f48ce5e1bc0421 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15019 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789049629.969206:0:15019:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8df260380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:b76d50d5-035a-43d0-9ba1-e61b094296a4+19:2357:x1875954089717504:12345-192.168.206.26@tcp:4:dd.0 Request processed in 142645us (379788us total) trans 8589934600 rc 0/0 00000100:00100000:2.0:1789049629.969218:0:15019:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.26@tcp, seq: 2 00000100:00100000:2.0:1789049629.969263:0:15019:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.26@tcp, seq: 6 00000100:00100000:2.0:1789049629.969278:0:15019:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb7c7146680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:b76d50d5-035a-43d0-9ba1-e61b094296a4+18:2357:x1875954089718272:12345-192.168.206.26@tcp:4:dd.0 00010000:00010000:2.0:1789049629.969318:0:15019:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000661c8e5a/0xf4f48ce5e1bc043d lrc: 3/0,1 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15019 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049629.969338:0:15019:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=1s v=(0 0) 00010000:00010000:2.0:1789049629.969342:0:15019:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789049629.969350:0:15019:0:(ldlm_resource.c:1751:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000661c8e5a/0xf4f48ce5e1bc043d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15019 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789049629.969363:0:15019:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000661c8e5a/0xf4f48ce5e1bc043d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15019 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789049630.100524:0:16560:0:(ofd_lvb.c:321:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb size from disk: 6291456 -> 7654321 00002000:00010000:3.0:1789049630.107496:0:16560:0:(ofd_lvb.c:346:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb blocks from disk: 8199 -> 12295 00000001:00080000:2.0:1789049630.107684:0:6731:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934603 is committed 00010000:00010000:0.0:1789049630.109376:0:16562:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e0b64209/0xf4f48ce5e1bc0436 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 6 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16562 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049630.109402:0:16562:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e0b64209/0xf4f48ce5e1bc0436 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 6 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 16562 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049630.109412:0:16562:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e0b64209/0xf4f48ce5e1bc0436 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 6 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16562 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049630.109446:0:16562:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cb900e62600 already unused, calling callback (ffffffffc166a8f0) 00010000:00010000:0.0:1789049630.109452:0:16562:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e0b64209/0xf4f48ce5e1bc0436 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 6 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16562 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049630.109463:0:16562:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e0b64209/0xf4f48ce5e1bc0436 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 6 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 16562 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049630.109491:0:16562:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e0b64209/0xf4f48ce5e1bc0436 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 6 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16562 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049630.109499:0:16562:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e0b64209/0xf4f48ce5e1bc0436 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 6 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16562 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789049630.111403:0:16562:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb7c7145880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b76d50d5-035a-43d0-9ba1-e61b094296a4+14:2358:x1875954089718016:12345-192.168.206.26@tcp:4:dd.0 Request processed in 235903us (259788us total) trans 8589934602 rc 0/0 00000100:00100000:0.0:1789049630.111420:0:16562:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.26@tcp, seq: 5 00000100:00100000:0.0:1789049630.111457:0:16562:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.26@tcp, seq: 7 00000100:00100000:0.0:1789049630.111470:0:16562:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb7c7144380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b76d50d5-035a-43d0-9ba1-e61b094296a4+13:2358:x1875954089718144:12345-192.168.206.26@tcp:4:dd.0 00010000:00010000:0.0:1789049630.111516:0:16562:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000006902404/0xf4f48ce5e1bc0444 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 6 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16562 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049630.111538:0:16562:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789049630.114637:0:16562:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789049630.114652:0:16562:0:(ldlm_resource.c:1751:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000006902404/0xf4f48ce5e1bc0444 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 6 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16562 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789049630.114702:0:16562:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000006902404/0xf4f48ce5e1bc0444 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 6 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16562 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049630.119416:0:16560:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e43ebbe8/0xf4f48ce5e1bc0428 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 6 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049630.119444:0:16560:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e43ebbe8/0xf4f48ce5e1bc0428 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 6 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 16560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049630.119455:0:16560:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e43ebbe8/0xf4f48ce5e1bc0428 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 6 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049630.119833:0:16560:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cb900e63c00 already unused, calling callback (ffffffffc166a8f0) 00010000:00010000:3.0:1789049630.119839:0:16560:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e43ebbe8/0xf4f48ce5e1bc0428 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 6 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049630.119874:0:16560:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e43ebbe8/0xf4f48ce5e1bc0428 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 6 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 16560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049630.119903:0:16560:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e43ebbe8/0xf4f48ce5e1bc0428 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 6 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049630.119912:0:16560:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e43ebbe8/0xf4f48ce5e1bc0428 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 6 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789049630.120046:0:16560:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb7c7144a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:b76d50d5-035a-43d0-9ba1-e61b094296a4+13:2358:x1875954089717760:12345-192.168.206.26@tcp:4:dd.0 Request processed in 249491us (268646us total) trans 8589934601 rc 0/0 00000100:00100000:3.0:1789049630.120058:0:16560:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.26@tcp, seq: 3 00010000:00010000:1.0:1789049630.121270:0:16561:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005641f1fd/0xf4f48ce5e1bc042f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049630.121289:0:16561:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005641f1fd/0xf4f48ce5e1bc042f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 16561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049630.121299:0:16561:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005641f1fd/0xf4f48ce5e1bc042f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049630.121306:0:16561:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cb8d776e200 already unused, calling callback (ffffffffc166a8f0) 00010000:00010000:1.0:1789049630.121311:0:16561:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005641f1fd/0xf4f48ce5e1bc042f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049630.121320:0:16561:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005641f1fd/0xf4f48ce5e1bc042f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 16561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049630.121339:0:16561:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005641f1fd/0xf4f48ce5e1bc042f lrc: 2/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789049630.121368:0:16561:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005641f1fd/0xf4f48ce5e1bc042f lrc: 0/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789049630.121470:0:16561:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb7c7144000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:b76d50d5-035a-43d0-9ba1-e61b094296a4+11:2357:x1875954089717888:12345-192.168.206.26@tcp:4:dd.0 Request processed in 248965us (270020us total) trans 8589934603 rc 0/0 00000100:00100000:1.0:1789049630.121480:0:16561:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.26@tcp, seq: 4 00000001:00080000:0.0:1789049630.204004:0:6731:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934604 is committed 00002000:00010000:3.0:1789049630.204476:0:15019:0:(ofd_lvb.c:346:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb blocks from disk: 12295 -> 14343 00010000:00010000:3.0:1789049630.204496:0:15019:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000661c8e5a/0xf4f48ce5e1bc043d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15019 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049630.204512:0:15019:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000661c8e5a/0xf4f48ce5e1bc043d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 15019 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049630.204522:0:15019:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000661c8e5a/0xf4f48ce5e1bc043d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15019 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049630.204562:0:15019:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cb900e62a00 already unused, calling callback (ffffffffc166a8f0) 00010000:00010000:3.0:1789049630.204569:0:15019:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000661c8e5a/0xf4f48ce5e1bc043d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15019 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049630.204579:0:15019:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000661c8e5a/0xf4f48ce5e1bc043d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 15019 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049630.204604:0:15019:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000661c8e5a/0xf4f48ce5e1bc043d lrc: 2/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15019 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049630.204613:0:15019:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000661c8e5a/0xf4f48ce5e1bc043d lrc: 0/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15019 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789049630.212142:0:15019:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb7c7146680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:b76d50d5-035a-43d0-9ba1-e61b094296a4+9:2357:x1875954089718272:12345-192.168.206.26@tcp:4:dd.0 Request processed in 242854us (352243us total) trans 8589934604 rc 0/0 00000100:00100000:3.0:1789049630.212161:0:15019:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.26@tcp, seq: 6 00000001:00080000:0.0:1789049630.326889:0:6731:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934605 is committed 00002000:00010000:3.0:1789049630.327090:0:16562:0:(ofd_lvb.c:346:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb blocks from disk: 14343 -> 16391 00010000:00010000:3.0:1789049630.327112:0:16562:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000006902404/0xf4f48ce5e1bc0444 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16562 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049630.327126:0:16562:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000006902404/0xf4f48ce5e1bc0444 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 16562 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049630.327136:0:16562:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000006902404/0xf4f48ce5e1bc0444 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16562 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049630.327167:0:16562:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cb8d776ea00 already unused, calling callback (ffffffffc166a8f0) 00010000:00010000:3.0:1789049630.327173:0:16562:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000006902404/0xf4f48ce5e1bc0444 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16562 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049630.327183:0:16562:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000006902404/0xf4f48ce5e1bc0444 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 16562 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049630.327217:0:16562:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000006902404/0xf4f48ce5e1bc0444 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16562 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789049630.327226:0:16562:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000006902404/0xf4f48ce5e1bc0444 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16562 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789049630.327363:0:16562:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb7c7144380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b76d50d5-035a-43d0-9ba1-e61b094296a4+5:2358:x1875954089718144:12345-192.168.206.26@tcp:4:dd.0 Request processed in 215891us (453529us total) trans 8589934605 rc 0/0 00000100:00100000:3.0:1789049630.327375:0:16562:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.26@tcp, seq: 7 00010000:00010000:0.0:1789049630.811172:0:14316:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789049631.047979:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.26@tcp (source: 12345-192.168.206.26@tcp) 00000100:00100000:3.0:1789049631.048031:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.26@tcp (source: 12345-192.168.206.26@tcp) 00000100:00100000:3.0:1789049631.048070:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.26@tcp (source: 12345-192.168.206.26@tcp) 00000100:00100000:3.0:1789049631.048120:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.26@tcp (source: 12345-192.168.206.26@tcp) 00000100:00100000:3.0:1789049631.048143:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.26@tcp (source: 12345-192.168.206.26@tcp) 00000100:00100000:3.0:1789049631.048162:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.26@tcp (source: 12345-192.168.206.26@tcp) 00000100:00100000:3.0:1789049631.048226:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.26@tcp (source: 12345-192.168.206.26@tcp) 00000100:00100000:3.0:1789049631.048262:0:15014:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954089718656 00000100:00100000:3.0:1789049631.048275:0:15014:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954089718656 00000100:00100000:3.0:1789049631.048354:0:15014:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954089719168 00000100:00100000:3.0:1789049631.048358:0:15014:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954089719168 00000100:00100000:3.0:1789049631.048547:0:15014:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954089718784 00000100:00100000:3.0:1789049631.048552:0:15014:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954089718784 00000100:00100000:3.0:1789049631.048574:0:15014:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954089719040 00000100:00100000:3.0:1789049631.048577:0:15014:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954089719040 00000100:00100000:3.0:1789049631.048606:0:15014:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.26@tcp, seq: 14 00000100:00100000:3.0:1789049631.048620:0:15014:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb900e40380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b76d50d5-035a-43d0-9ba1-e61b094296a4+5:2358:x1875954089718656:12345-192.168.206.26@tcp:400:kworker.0 00000100:00100000:3.0:1789049631.048816:0:15014:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb900e40380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b76d50d5-035a-43d0-9ba1-e61b094296a4+5:2358:x1875954089718656:12345-192.168.206.26@tcp:400:kworker.0 Request processed in 196us (783us total) trans 0 rc 0/0 00000100:00100000:3.0:1789049631.048825:0:15014:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.26@tcp, seq: 14 00000100:00100000:3.0:1789049631.048883:0:15014:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.26@tcp, seq: 15 00000100:00100000:3.0:1789049631.048891:0:15014:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8fcf05180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:45abea75-ce99-406c-bba5-a167dc77aef6+5:2358:x1875954089719168:12345-192.168.206.26@tcp:400:kworker.0 00000100:00100000:3.0:1789049631.048921:0:15014:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8fcf05180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:45abea75-ce99-406c-bba5-a167dc77aef6+5:2358:x1875954089719168:12345-192.168.206.26@tcp:400:kworker.0 Request processed in 31us (801us total) trans 0 rc 0/0 00000100:00100000:3.0:1789049631.048927:0:15014:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.26@tcp, seq: 15 00000100:00100000:3.0:1789049631.048939:0:15014:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.26@tcp, seq: 16 00000100:00100000:3.0:1789049631.048945:0:15014:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8fcf06d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b76d50d5-035a-43d0-9ba1-e61b094296a4+5:2358:x1875954089718784:12345-192.168.206.26@tcp:400:kworker.0 00000100:00100000:3.0:1789049631.048969:0:15014:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8fcf06d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b76d50d5-035a-43d0-9ba1-e61b094296a4+5:2358:x1875954089718784:12345-192.168.206.26@tcp:400:kworker.0 Request processed in 25us (807us total) trans 0 rc 0/0 00000100:00100000:3.0:1789049631.048975:0:15014:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.26@tcp, seq: 16 00000100:00100000:3.0:1789049631.048986:0:15014:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.26@tcp, seq: 17 00000100:00100000:3.0:1789049631.048992:0:15014:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8fcf05880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:45abea75-ce99-406c-bba5-a167dc77aef6+5:2358:x1875954089719040:12345-192.168.206.26@tcp:400:kworker.0 00000100:00100000:3.0:1789049631.049015:0:15014:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8fcf05880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:45abea75-ce99-406c-bba5-a167dc77aef6+5:2358:x1875954089719040:12345-192.168.206.26@tcp:400:kworker.0 Request processed in 22us (789us total) trans 0 rc 0/0 00000100:00100000:3.0:1789049631.049034:0:15014:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.26@tcp, seq: 17 00000100:00100000:3.0:1789049631.049061:0:14329:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954089718912 00000100:00100000:3.0:1789049631.049065:0:14329:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954089718912 00000100:00100000:2.0:1789049631.049245:0:14328:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954089718528 00000100:00100000:2.0:1789049631.049256:0:14328:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954089718528 00000100:00100000:2.0:1789049631.049294:0:14328:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.26@tcp, seq: 29 00000100:00100000:2.0:1789049631.049307:0:14328:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8fcf07480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:45abea75-ce99-406c-bba5-a167dc77aef6+6:2358:x1875954089718912:12345-192.168.206.26@tcp:400:kworker.0 00000100:00100000:2.0:1789049631.049355:0:14328:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8fcf07480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:45abea75-ce99-406c-bba5-a167dc77aef6+6:2358:x1875954089718912:12345-192.168.206.26@tcp:400:kworker.0 Request processed in 55us (1285us total) trans 0 rc 0/0 00000100:00100000:2.0:1789049631.049361:0:14328:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.26@tcp, seq: 29 00000100:00100000:2.0:1789049631.049378:0:14328:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.26@tcp, seq: 30 00000100:00100000:2.0:1789049631.049389:0:14328:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb8fcf04000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b76d50d5-035a-43d0-9ba1-e61b094296a4+20:2358:x1875954089718528:12345-192.168.206.26@tcp:400:kworker.0 00000100:00100000:2.0:1789049631.049421:0:14328:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb8fcf04000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b76d50d5-035a-43d0-9ba1-e61b094296a4+20:2358:x1875954089718528:12345-192.168.206.26@tcp:400:kworker.0 Request processed in 36us (1277us total) trans 0 rc 0/0 00000100:00100000:2.0:1789049631.049427:0:14328:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.26@tcp, seq: 30 00000100:00100000:0.0:1789049631.050745:0:14323:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954089718400 00000100:00100000:0.0:1789049631.050758:0:14323:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954089718400 00000100:00100000:0.0:1789049631.050828:0:14323:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.26@tcp, seq: 123 00000100:00100000:0.0:1789049631.050882:0:14323:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb900c5b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fcaa091b-21fd-4d41-8af7-6b63e4c958e5+13:2358:x1875954089718400:12345-192.168.206.26@tcp:400:kworker.0 00000100:00100000:0.0:1789049631.050953:0:14323:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb900c5b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fcaa091b-21fd-4d41-8af7-6b63e4c958e5+13:2358:x1875954089718400:12345-192.168.206.26@tcp:400:kworker.0 Request processed in 116us (2987us total) trans 0 rc 0/0 00000100:00100000:0.0:1789049631.050962:0:14323:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.26@tcp, seq: 123 00000100:00080000:0.0:1789049631.050997:0:14324:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789049631.051004:0:14324:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789049631.051008:0:14324:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1789049631.835163:0:15620:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1789049632.017387:0:16599:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: sanity-pcc test_1c: @@@@@@ FAIL: expected /mnt/pcc.d1c.sanity-pcc/d1c.sanity-pcc/0bd3/0x200000bd1:0x2:0x0 size: 7654321 got: 0 00000100:00100000:0.0:1789049632.671496:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cb7c7146a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3311:1875954110668032:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789049632.671617:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789049632.671774:0:15015:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875954110668032 00000100:00100000:2.0:1789049632.671785:0:15015:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875954110668032 00000100:00100000:2.0:1789049632.671909:0:15015:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1789049632.671952:0:15015:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cb9009c1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1875954110668032:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789049632.672001:0:15015:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 6815744 granted 64684032 pending 0 free 3851419648 avail 3849322496 00000100:00080000:3.0:1789049632.672405:0:14324:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789049632.673540:0:15015:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cb9009c1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1875954110668032:12345-0@lo:13:osp-pre-0-0.0 Request processed in 1589us (1907us total) trans 0 rc 0/0 00000100:00100000:2.0:1789049632.673555:0:15015:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1789049632.686269:0:3311:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934597 gen 2 00000004:00080000:0.0:1789049632.686288:0:3311:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8cb900e40e00, transno 8589934595 00000004:00080000:0.0:1789049632.686305:0:3311:0:(osp_trans.c:1063:osp_request_commit_cb()) trans no 8589934597 committed transno 8589934597 00000100:00100000:0.0:1789049632.686354:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cb7c7146a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3311:1875954110668032:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1789049632.860060:0:14317:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) Debug log: 29144 lines, 29144 kept, 0 dropped, 0 bad.